2024-09-12T01:36:15.294 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:36:15.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:36:15.409 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901569' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDEkVh2BtX8wzn/HPHEdGFvZLwA552pwMZxOQkZKk91aQyEQozyBuD0Smn9s7aqYEh0RhH8T7STPG6f0Zo2C7yk= smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAybLxojdSreGiKD5KS+nlBMHTSgX6+Gl5daUXuRrCD3RgO3e1T0RXxO/AgxWFoLVSKXpKk41EBKLI3J8DGD76U= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyCgCz2SozER3qjYOKSzYa4Ld+5id0bnta3wWDRy+BzrFUJLaePWwdtBY+/Na/DarBYt8nnDzfdrJZT2E3fyEY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:36:15.410 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:36:15.410 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:36:15.411 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:36:15.412 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:36:15.434 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:36:15.434 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:36:15.434 INFO:teuthology.packaging:ref: None 2024-09-12T01:36:15.434 INFO:teuthology.packaging:tag: None 2024-09-12T01:36:15.434 INFO:teuthology.packaging:branch: squid 2024-09-12T01:36:15.434 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:36:15.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:36:15.682 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:36:15.683 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:36:15.690 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:36:15.690 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:36:15.697 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:36:15.719 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:36:15.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:36:15.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:30:28.095461', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDEkVh2BtX8wzn/HPHEdGFvZLwA552pwMZxOQkZKk91aQyEQozyBuD0Smn9s7aqYEh0RhH8T7STPG6f0Zo2C7yk='} 2024-09-12T01:36:15.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:30:28.094337', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAybLxojdSreGiKD5KS+nlBMHTSgX6+Gl5daUXuRrCD3RgO3e1T0RXxO/AgxWFoLVSKXpKk41EBKLI3J8DGD76U='} 2024-09-12T01:36:15.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:30:28.091365', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyCgCz2SozER3qjYOKSzYa4Ld+5id0bnta3wWDRy+BzrFUJLaePWwdtBY+/Na/DarBYt8nnDzfdrJZT2E3fyEY='} 2024-09-12T01:36:15.824 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:36:15.833 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:36:15.833 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:36:15.833 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:36:15.833 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:36:15.969 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffae2c03be0>, signals=[15]) 2024-09-12T01:36:15.969 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:36:15.978 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:36:15.978 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T01:36:15.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:36:16.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T01:36:16.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:36:16.151 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T01:36:16.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:36:16.252 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:36:16.260 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-12T01:36:16.278 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-12T01:36:16.278 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-12T01:36:16.337 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-09-12T01:36:16.337 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-09-12T01:36:16.337 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-09-12T01:36:16.337 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:36:16.338 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:36:16.339 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:36:16.339 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:36:16.339 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-12T01:36:16.372 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-12T01:36:16.390 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-12T01:36:16.390 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:36:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:36:16.448 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:36:16.448 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-12T01:36:16.480 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-12T01:36:16.499 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-12T01:36:16.499 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-12T01:36:16.557 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:36:16.558 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:36:16.558 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:36:16.558 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:36:16.558 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:36:16.558 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:36:16.558 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-12T01:36:16.588 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:36:16.601 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:36:16.616 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:36:16.616 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:36:16.618 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:36:16.621 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:36:16.637 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:36:16.645 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:36:16.645 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:36:16.675 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:36:16.678 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:36:16.711 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:36:16.816 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:36:16.832 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:36:16.832 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T01:36:16.832 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:36:16.833 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:36:16.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:16.850 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-12T01:36:16.907 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:36:16.907 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-503.el9.x86_64 2024-09-12T01:36:16.907 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-09-12T01:36:20.009 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-09-12T01:36:22.037 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-12T01:36:26.418 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T01:36:27.835 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 19 kB 00:00 2024-09-12T01:36:28.631 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T01:36:34.237 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-12T01:36:36.310 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:36:36.310 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:36:36.396 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:36:36.408 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 79 M 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 126 M 2024-09-12T01:36:36.409 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-12T01:36:36.605 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 261 kB/s | 23 kB 00:00 2024-09-12T01:36:36.964 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-12T01:36:37.447 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-12T01:36:37.756 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-12T01:36:37.756 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:36:37.757 INFO:teuthology.orchestra.run.smithi039.stdout:Total 58 MB/s | 79 MB 00:01 2024-09-12T01:36:38.464 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-12T01:36:38.840 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-12T01:36:38.840 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-12T01:36:39.832 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-12T01:36:39.832 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-12T01:36:42.432 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-12T01:36:43.099 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:36:43.189 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:36:46.119 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:36:51.237 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:36:51.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:36:56.418 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:37:35.756 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:37:35.797 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:37:36.160 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:37:36.160 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:37:36.161 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:37:36.161 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-12T01:37:37.422 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:37:37.512 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.512 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:37:37.512 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:37:37.512 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:37:37.512 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:37:37.513 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:37:37.513 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:37:37.513 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:37:37.571 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:37:37.571 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:37:37.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 82.el9 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8274670 2024-09-12T01:37:37.603 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:37:37.604 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:37:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-09-12T01:37:37.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:37:37.605 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:37:37.605 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:37:37.606 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:37:37.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:37:38.352 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-12T01:37:39.603 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:37:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-12T01:37:39.653 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-12T01:37:39.668 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.1vy45zTCsP 2024-09-12T01:37:39.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1vy45zTCsP 2024-09-12T01:37:39.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.1vy45zTCsP 2024-09-12T01:37:39.868 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.1vy45zTCsP is 6KB 2024-09-12T01:37:39.916 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.1vy45zTCsP 2024-09-12T01:37:39.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:37:39.993 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:37:39.993 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:37:39.993 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:37:39.993 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:37:39.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:37:40.142 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-12T01:38:10.144 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:38:10.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:38:10.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:38:28.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T01:38:37.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:38:37.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:38:40.609 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T01:38:52.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:38:52.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:38:55.681 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T01:39:10.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:39:10.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:40:10.693 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T01:40:28.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:40:28.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:40:29.025 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-12T01:40:29.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:40:29.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:40:29.410 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-12T01:40:29.427 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:40:29.427 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:40:29.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:40:29.427 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:40:30.428 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:30.429 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:40:30.436 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:40:30.436 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:30.439 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:30.441 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:40:30.461 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:40:30.468 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:40:30.477 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:40:30.478 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:30.499 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:30.501 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:40:30.537 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:40:30.544 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:40:30.544 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:40:30.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:30.586 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:40:30.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:30.604 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:30.607 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:30.629 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:40:30.665 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.684 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.686 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.706 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.708 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.726 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:40:30.728 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:40:30.735 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:40:30.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:30.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:30.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:40:30.781 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:40:30.790 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:40:30.790 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:30.809 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:30.811 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:40:30.837 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:30.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:30.959 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.052 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.089 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:40:31.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:31.157 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:31.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:31.253 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.380 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:40:31.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:31.447 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:31.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:40:31.539 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:40:31.667 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:40:31.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:40:31.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-12T01:40:31.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-12T01:40:31.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-12T01:40:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:31.798 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:31.811 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:40:32.300 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:40:32.307 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:40:32.307 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:40:32.376 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:40:32.384 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:40:32.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-09-12T01:40:32.440 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-09-12T01:40:32.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-12T01:40:32.512 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-12T01:40:32.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-12T01:40:32.566 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-12T01:40:32.568 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:40:32.569 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-09-12T01:40:32.602 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-09-12T01:40:32.603 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-12T01:40:32.622 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-12T01:40:32.623 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-12T01:40:32.643 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-12T01:40:32.643 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:40:32.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:32.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:32.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:32.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:32.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:40:32.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:40:32.731 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:40:32.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:32.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:32.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:40:32.838 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:40:32.847 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T01:40:32.850 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T01:40:32.962 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:40:32.974 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:40:32.974 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi044.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:44:45.033 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-12T01:44:45.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:44:45.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:44:45.122 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-12T01:44:45.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T01:44:45.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T01:44:45.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:44:45.306 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-12T01:44:45.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T01:44:45.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T01:44:45.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:44:45.469 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-12T01:44:45.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T01:44:45.507 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:44:45.518 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:44:45.518 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:44:45.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:44:45.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:44:45.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:44:45.524 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:44:45.524 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:44:45.552 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:44:45.568 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:44:45.569 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:44:45.577 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:44:45.587 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:44:45.592 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:44:45.594 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-09-12T01:44:45.606 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-09-12T01:44:45.615 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-12T01:44:45.617 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-12T01:44:45.622 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-12T01:44:45.628 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-12T01:44:45.636 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:44:45.642 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:44:45.643 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:44:45.657 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:44:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.712 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.715 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.719 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:44:45.723 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:44:45.731 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:44:45.731 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:44:45.731 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:44:45.732 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:44:45.736 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:44:45.737 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:44:45.740 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:44:45.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:44:45.742 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:44:45.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:44:45.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:44:45.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:44:45.892 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:44:45.892 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:44:45.904 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:44:45.904 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:44:45.915 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:44:45.915 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:44:46.015 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:44:46.016 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:44:46.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:44:46.025 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:44:46.026 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:44:46.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:44:46.034 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:44:46.034 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:44:46.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:44:46.043 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:44:46.043 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:44:46.051 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:44:46.051 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:44:46.060 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:44:46.060 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:44:46.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:44:46.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:44:46.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:44:46.187 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:44:46.192 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:44:46.199 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:44:46.252 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-09-12T01:44:46.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-09-12T01:44:46.256 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-12T01:44:46.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-12T01:44:46.264 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-12T01:44:46.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-12T01:44:46.489 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-12T01:44:46.491 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-12T01:44:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:45 files removed 2024-09-12T01:44:46.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:44:46.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:44:46.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:44:47.069 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-12T01:44:47.073 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-12T01:44:47.104 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-12T01:44:47.353 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:44:47.357 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:44:47.397 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T01:44:47.629 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:44:47.633 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T01:44:47.680 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T01:44:48.395 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T01:44:48.723 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.2 MB 00:01 2024-09-12T01:44:48.891 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.2 MB 00:01 2024-09-12T01:44:50.524 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-12T01:44:50.709 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T01:44:52.629 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-12T01:44:55.902 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.5 MB 00:01 2024-09-12T01:44:56.141 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-12T01:44:57.238 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-12T01:44:57.477 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-12T01:44:57.592 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:44:58.521 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:44:58.705 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-12T01:44:59.460 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T01:45:04.179 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-12T01:45:04.219 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T01:45:04.990 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-12T01:45:06.573 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.574 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.586 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:06.587 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.588 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:06.589 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.591 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:06.593 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.594 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.655 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.655 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.661 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-12T01:45:06.668 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:06.668 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:06.669 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:06.670 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.672 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:06.674 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.675 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:06.684 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T01:45:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:06.688 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T01:45:06.697 INFO:teuthology.orchestra.run.smithi044.stdout:Install 148 Packages 2024-09-12T01:45:06.698 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 8 Packages 2024-09-12T01:45:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:06.698 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 226 M 2024-09-12T01:45:06.698 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-12T01:45:06.741 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-12T01:45:06.769 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:06.770 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:06.771 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:06.772 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:06.773 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:06.774 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:06.775 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:06.776 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:06.777 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:06.778 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:06.779 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:06.780 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:06.781 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-12T01:45:06.782 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout:Install 148 Packages 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:45:06.783 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 226 M 2024-09-12T01:45:06.784 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-12T01:45:07.089 INFO:teuthology.orchestra.run.smithi044.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 58 kB/s | 6.5 kB 00:00 2024-09-12T01:45:07.295 INFO:teuthology.orchestra.run.smithi039.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 41 kB/s | 6.5 kB 00:00 2024-09-12T01:45:07.301 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:07.302 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:45:07.313 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:45:07.314 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:45:07.315 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:45:07.315 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:45:07.317 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:45:07.319 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:45:07.320 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:45:07.331 INFO:teuthology.orchestra.run.smithi044.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-12T01:45:07.384 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:45:07.402 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:45:07.403 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:45:07.404 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:45:07.405 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:45:07.406 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:45:07.407 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:45:07.408 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:45:07.409 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:45:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:45:07.411 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:45:07.412 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:45:07.413 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:45:07.414 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-12T01:45:07.415 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 226 M 2024-09-12T01:45:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-12T01:45:07.431 INFO:teuthology.orchestra.run.smithi044.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T01:45:07.456 INFO:teuthology.orchestra.run.smithi044.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T01:45:07.548 INFO:teuthology.orchestra.run.smithi044.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-12T01:45:07.623 INFO:teuthology.orchestra.run.smithi044.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-12T01:45:07.882 INFO:teuthology.orchestra.run.smithi044.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-12T01:45:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-09-12T01:45:08.012 INFO:teuthology.orchestra.run.smithi039.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.2 MB/s | 897 kB 00:00 2024-09-12T01:45:08.096 INFO:teuthology.orchestra.run.smithi039.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-12T01:45:08.141 INFO:teuthology.orchestra.run.smithi044.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T01:45:08.192 INFO:teuthology.orchestra.run.smithi172.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.8 MB/s | 897 kB 00:00 2024-09-12T01:45:08.216 INFO:teuthology.orchestra.run.smithi044.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 337 kB/s | 25 kB 00:00 2024-09-12T01:45:08.284 INFO:teuthology.orchestra.run.smithi172.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T01:45:08.476 INFO:teuthology.orchestra.run.smithi172.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 5.9 MB/s | 5.4 MB 00:00 2024-09-12T01:45:08.751 INFO:teuthology.orchestra.run.smithi172.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.5 MB/s | 1.5 MB 00:00 2024-09-12T01:45:08.943 INFO:teuthology.orchestra.run.smithi172.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-12T01:45:09.000 INFO:teuthology.orchestra.run.smithi044.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T01:45:09.076 INFO:teuthology.orchestra.run.smithi044.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.0 MB/s | 228 kB 00:00 2024-09-12T01:45:09.150 INFO:teuthology.orchestra.run.smithi044.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 361 kB/s | 27 kB 00:00 2024-09-12T01:45:09.154 INFO:teuthology.orchestra.run.smithi039.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 2.7 MB/s | 5.4 MB 00:02 2024-09-12T01:45:09.201 INFO:teuthology.orchestra.run.smithi172.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-12T01:45:09.217 INFO:teuthology.orchestra.run.smithi044.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-12T01:45:09.254 INFO:teuthology.orchestra.run.smithi039.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.1 MB/s | 2.4 MB 00:01 2024-09-12T01:45:09.384 INFO:teuthology.orchestra.run.smithi044.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.4 MB/s | 752 kB 00:00 2024-09-12T01:45:09.542 INFO:teuthology.orchestra.run.smithi044.stdout:(15/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 6.4 MB/s | 11 MB 00:01 2024-09-12T01:45:09.568 INFO:teuthology.orchestra.run.smithi044.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 891 kB/s | 163 kB 00:00 2024-09-12T01:45:09.596 INFO:teuthology.orchestra.run.smithi039.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-09-12T01:45:09.626 INFO:teuthology.orchestra.run.smithi044.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T01:45:09.652 INFO:teuthology.orchestra.run.smithi044.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T01:45:09.735 INFO:teuthology.orchestra.run.smithi044.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 541 kB/s | 45 kB 00:00 2024-09-12T01:45:09.819 INFO:teuthology.orchestra.run.smithi044.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T01:45:09.911 INFO:teuthology.orchestra.run.smithi044.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-12T01:45:10.011 INFO:teuthology.orchestra.run.smithi044.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.1 MB/s | 321 kB 00:00 2024-09-12T01:45:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T01:45:10.162 INFO:teuthology.orchestra.run.smithi044.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 100 kB 00:00 2024-09-12T01:45:10.168 INFO:teuthology.orchestra.run.smithi172.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 11 MB/s | 11 MB 00:00 2024-09-12T01:45:10.229 INFO:teuthology.orchestra.run.smithi044.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.3 MB/s | 85 kB 00:00 2024-09-12T01:45:10.235 INFO:teuthology.orchestra.run.smithi172.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 378 kB/s | 25 kB 00:00 2024-09-12T01:45:10.629 INFO:teuthology.orchestra.run.smithi044.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.8 MB/s | 3.1 MB 00:00 2024-09-12T01:45:10.696 INFO:teuthology.orchestra.run.smithi044.stdout:(27/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.0 MB/s | 5.3 MB 00:01 2024-09-12T01:45:10.721 INFO:teuthology.orchestra.run.smithi044.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T01:45:11.080 INFO:teuthology.orchestra.run.smithi039.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 2.6 MB/s | 4.7 MB 00:01 2024-09-12T01:45:11.164 INFO:teuthology.orchestra.run.smithi044.stdout:(29/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 17 MB/s | 49 MB 00:02 2024-09-12T01:45:11.189 INFO:teuthology.orchestra.run.smithi044.stdout:(30/156): ceph-grafana-dashboards-19.1.1-298.gb 65 kB/s | 32 kB 00:00 2024-09-12T01:45:11.222 INFO:teuthology.orchestra.run.smithi044.stdout:(31/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 292 kB/s | 146 kB 00:00 2024-09-12T01:45:11.315 INFO:teuthology.orchestra.run.smithi044.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.6 MB/s | 249 kB 00:00 2024-09-12T01:45:11.407 INFO:teuthology.orchestra.run.smithi044.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 538 kB/s | 49 kB 00:00 2024-09-12T01:45:11.474 INFO:teuthology.orchestra.run.smithi044.stdout:(34/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 11 MB/s | 3.6 MB 00:00 2024-09-12T01:45:11.499 INFO:teuthology.orchestra.run.smithi044.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 179 kB/s | 16 kB 00:00 2024-09-12T01:45:11.549 INFO:teuthology.orchestra.run.smithi044.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T01:45:11.625 INFO:teuthology.orchestra.run.smithi044.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.0 MB/s | 765 kB 00:00 2024-09-12T01:45:11.650 INFO:teuthology.orchestra.run.smithi044.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 182 kB/s | 18 kB 00:00 2024-09-12T01:45:11.767 INFO:teuthology.orchestra.run.smithi044.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-12T01:45:11.834 INFO:teuthology.orchestra.run.smithi044.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-12T01:45:11.867 INFO:teuthology.orchestra.run.smithi044.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-12T01:45:11.885 INFO:teuthology.orchestra.run.smithi172.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.7 MB/s | 17 MB 00:02 2024-09-12T01:45:11.893 INFO:teuthology.orchestra.run.smithi044.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-12T01:45:11.943 INFO:teuthology.orchestra.run.smithi044.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-12T01:45:11.968 INFO:teuthology.orchestra.run.smithi044.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T01:45:11.994 INFO:teuthology.orchestra.run.smithi044.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T01:45:12.019 INFO:teuthology.orchestra.run.smithi044.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T01:45:12.044 INFO:teuthology.orchestra.run.smithi044.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T01:45:12.077 INFO:teuthology.orchestra.run.smithi172.stdout:(11/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 4.7 MB/s | 21 MB 00:04 2024-09-12T01:45:12.102 INFO:teuthology.orchestra.run.smithi172.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.0 MB/s | 228 kB 00:00 2024-09-12T01:45:12.119 INFO:teuthology.orchestra.run.smithi172.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 649 kB/s | 27 kB 00:00 2024-09-12T01:45:12.136 INFO:teuthology.orchestra.run.smithi172.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 946 kB/s | 32 kB 00:00 2024-09-12T01:45:12.153 INFO:teuthology.orchestra.run.smithi044.stdout:(48/156): ceph-mgr-diskprediction-local-19.1.1- 7.7 MB/s | 7.4 MB 00:00 2024-09-12T01:45:12.178 INFO:teuthology.orchestra.run.smithi172.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 163 kB 00:00 2024-09-12T01:45:12.237 INFO:teuthology.orchestra.run.smithi172.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 6.3 MB/s | 752 kB 00:00 2024-09-12T01:45:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T01:45:12.329 INFO:teuthology.orchestra.run.smithi044.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-12T01:45:12.329 INFO:teuthology.orchestra.run.smithi172.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.4 MB/s | 506 kB 00:00 2024-09-12T01:45:12.354 INFO:teuthology.orchestra.run.smithi044.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 534 kB/s | 107 kB 00:00 2024-09-12T01:45:12.371 INFO:teuthology.orchestra.run.smithi044.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-12T01:45:12.387 INFO:teuthology.orchestra.run.smithi172.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 777 kB/s | 45 kB 00:00 2024-09-12T01:45:12.421 INFO:teuthology.orchestra.run.smithi044.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-12T01:45:12.446 INFO:teuthology.orchestra.run.smithi172.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T01:45:12.446 INFO:teuthology.orchestra.run.smithi044.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-12T01:45:12.472 INFO:teuthology.orchestra.run.smithi044.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T01:45:12.496 INFO:teuthology.orchestra.run.smithi172.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T01:45:12.497 INFO:teuthology.orchestra.run.smithi044.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-12T01:45:12.505 INFO:teuthology.orchestra.run.smithi039.stdout:(8/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86_ 5.8 MB/s | 17 MB 00:02 2024-09-12T01:45:12.522 INFO:teuthology.orchestra.run.smithi044.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T01:45:12.556 INFO:teuthology.orchestra.run.smithi044.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T01:45:12.581 INFO:teuthology.orchestra.run.smithi044.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-12T01:45:12.588 INFO:teuthology.orchestra.run.smithi172.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-12T01:45:12.647 INFO:teuthology.orchestra.run.smithi172.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 301 kB 00:00 2024-09-12T01:45:12.656 INFO:teuthology.orchestra.run.smithi044.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-12T01:45:12.681 INFO:teuthology.orchestra.run.smithi044.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-12T01:45:12.705 INFO:teuthology.orchestra.run.smithi172.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-12T01:45:12.707 INFO:teuthology.orchestra.run.smithi044.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-12T01:45:12.730 INFO:teuthology.orchestra.run.smithi039.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 3.8 MB/s | 21 MB 00:05 2024-09-12T01:45:12.755 INFO:teuthology.orchestra.run.smithi039.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 101 kB/s | 25 kB 00:00 2024-09-12T01:45:12.764 INFO:teuthology.orchestra.run.smithi172.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T01:45:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-09-12T01:45:12.791 INFO:teuthology.orchestra.run.smithi044.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-12T01:45:12.822 INFO:teuthology.orchestra.run.smithi039.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.3 MB/s | 228 kB 00:00 2024-09-12T01:45:12.831 INFO:teuthology.orchestra.run.smithi172.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 9.4 MB/s | 5.3 MB 00:00 2024-09-12T01:45:12.846 INFO:teuthology.orchestra.run.smithi044.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-12T01:45:12.864 INFO:teuthology.orchestra.run.smithi039.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 651 kB/s | 27 kB 00:00 2024-09-12T01:45:12.873 INFO:teuthology.orchestra.run.smithi172.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 4.0 MB/s | 171 kB 00:00 2024-09-12T01:45:12.875 INFO:teuthology.orchestra.run.smithi044.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-12T01:45:12.914 INFO:teuthology.orchestra.run.smithi039.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 633 kB/s | 32 kB 00:00 2024-09-12T01:45:12.917 INFO:teuthology.orchestra.run.smithi044.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-12T01:45:13.006 INFO:teuthology.orchestra.run.smithi039.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-12T01:45:13.057 INFO:teuthology.orchestra.run.smithi039.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-12T01:45:13.067 INFO:teuthology.orchestra.run.smithi044.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-12T01:45:13.107 INFO:teuthology.orchestra.run.smithi039.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:45:13.167 INFO:teuthology.orchestra.run.smithi044.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T01:45:13.234 INFO:teuthology.orchestra.run.smithi044.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:45:13.257 INFO:teuthology.orchestra.run.smithi039.stdout:(17/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 4.9 MB/s | 11 MB 00:02 2024-09-12T01:45:13.283 INFO:teuthology.orchestra.run.smithi039.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 2.8 MB/s | 506 kB 00:00 2024-09-12T01:45:13.309 INFO:teuthology.orchestra.run.smithi044.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-12T01:45:13.316 INFO:teuthology.orchestra.run.smithi039.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.3 MB/s | 45 kB 00:00 2024-09-12T01:45:13.331 INFO:teuthology.orchestra.run.smithi172.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 16 MB/s | 49 MB 00:03 2024-09-12T01:45:13.357 INFO:teuthology.orchestra.run.smithi172.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 66 kB/s | 32 kB 00:00 2024-09-12T01:45:13.360 INFO:teuthology.orchestra.run.smithi039.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 3.2 MB/s | 136 kB 00:00 2024-09-12T01:45:13.382 INFO:teuthology.orchestra.run.smithi172.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T01:45:13.385 INFO:teuthology.orchestra.run.smithi044.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.2 MB/s | 4.9 MB 00:00 2024-09-12T01:45:13.408 INFO:teuthology.orchestra.run.smithi039.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-12T01:45:13.441 INFO:teuthology.orchestra.run.smithi172.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 4.6 MB/s | 3.1 MB 00:00 2024-09-12T01:45:13.452 INFO:teuthology.orchestra.run.smithi044.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-12T01:45:13.475 INFO:teuthology.orchestra.run.smithi039.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T01:45:13.477 INFO:teuthology.orchestra.run.smithi044.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 952 kB/s | 87 kB 00:00 2024-09-12T01:45:13.491 INFO:teuthology.orchestra.run.smithi172.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T01:45:13.541 INFO:teuthology.orchestra.run.smithi172.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 991 kB/s | 49 kB 00:00 2024-09-12T01:45:13.544 INFO:teuthology.orchestra.run.smithi044.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 922 kB/s | 61 kB 00:00 2024-09-12T01:45:13.558 INFO:teuthology.orchestra.run.smithi039.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T01:45:13.583 INFO:teuthology.orchestra.run.smithi172.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 394 kB/s | 16 kB 00:00 2024-09-12T01:45:13.609 INFO:teuthology.orchestra.run.smithi039.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:45:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-12T01:45:13.642 INFO:teuthology.orchestra.run.smithi172.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T01:45:13.667 INFO:teuthology.orchestra.run.smithi039.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T01:45:13.695 INFO:teuthology.orchestra.run.smithi044.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-12T01:45:13.720 INFO:teuthology.orchestra.run.smithi044.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T01:45:13.742 INFO:teuthology.orchestra.run.smithi172.stdout:(36/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.3 MB/s | 3.6 MB 00:00 2024-09-12T01:45:13.745 INFO:teuthology.orchestra.run.smithi044.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T01:45:13.779 INFO:teuthology.orchestra.run.smithi044.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T01:45:13.804 INFO:teuthology.orchestra.run.smithi044.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T01:45:13.838 INFO:teuthology.orchestra.run.smithi044.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-12T01:45:13.842 INFO:teuthology.orchestra.run.smithi172.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-12T01:45:13.859 INFO:teuthology.orchestra.run.smithi172.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 156 kB/s | 18 kB 00:00 2024-09-12T01:45:13.884 INFO:teuthology.orchestra.run.smithi172.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.1 MB/s | 765 kB 00:00 2024-09-12T01:45:13.921 INFO:teuthology.orchestra.run.smithi044.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-12T01:45:13.947 INFO:teuthology.orchestra.run.smithi044.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-12T01:45:13.981 INFO:teuthology.orchestra.run.smithi044.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T01:45:14.006 INFO:teuthology.orchestra.run.smithi044.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:45:14.009 INFO:teuthology.orchestra.run.smithi039.stdout:(26/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.1 MB/s | 3.1 MB 00:00 2024-09-12T01:45:14.018 INFO:teuthology.orchestra.run.smithi172.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-12T01:45:14.039 INFO:teuthology.orchestra.run.smithi044.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-12T01:45:14.064 INFO:teuthology.orchestra.run.smithi044.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T01:45:14.084 INFO:teuthology.orchestra.run.smithi039.stdout:(27/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 5.3 MB 00:00 2024-09-12T01:45:14.110 INFO:teuthology.orchestra.run.smithi039.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T01:45:14.127 INFO:teuthology.orchestra.run.smithi172.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 790 kB/s | 191 kB 00:00 2024-09-12T01:45:14.131 INFO:teuthology.orchestra.run.smithi044.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-12T01:45:14.135 INFO:teuthology.orchestra.run.smithi039.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 636 kB/s | 32 kB 00:00 2024-09-12T01:45:14.160 INFO:teuthology.orchestra.run.smithi172.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-12T01:45:14.161 INFO:teuthology.orchestra.run.smithi039.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T01:45:14.165 INFO:teuthology.orchestra.run.smithi044.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T01:45:14.190 INFO:teuthology.orchestra.run.smithi044.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-12T01:45:14.216 INFO:teuthology.orchestra.run.smithi044.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-12T01:45:14.241 INFO:teuthology.orchestra.run.smithi044.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-09-12T01:45:14.244 INFO:teuthology.orchestra.run.smithi172.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-12T01:45:14.266 INFO:teuthology.orchestra.run.smithi044.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-12T01:45:14.300 INFO:teuthology.orchestra.run.smithi044.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-12T01:45:14.319 INFO:teuthology.orchestra.run.smithi172.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-12T01:45:14.342 INFO:teuthology.orchestra.run.smithi044.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T01:45:14.367 INFO:teuthology.orchestra.run.smithi044.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-12T01:45:14.377 INFO:teuthology.orchestra.run.smithi172.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-12T01:45:14.401 INFO:teuthology.orchestra.run.smithi044.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-12T01:45:14.436 INFO:teuthology.orchestra.run.smithi172.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T01:45:14.478 INFO:teuthology.orchestra.run.smithi172.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-09-12T01:45:14.484 INFO:teuthology.orchestra.run.smithi044.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T01:45:14.510 INFO:teuthology.orchestra.run.smithi044.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-12T01:45:14.528 INFO:teuthology.orchestra.run.smithi172.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-12T01:45:14.543 INFO:teuthology.orchestra.run.smithi044.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T01:45:14.568 INFO:teuthology.orchestra.run.smithi044.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T01:45:14.569 INFO:teuthology.orchestra.run.smithi039.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 8.2 MB/s | 3.6 MB 00:00 2024-09-12T01:45:14.602 INFO:teuthology.orchestra.run.smithi044.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-09-12T01:45:14.612 INFO:teuthology.orchestra.run.smithi172.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-12T01:45:14.636 INFO:teuthology.orchestra.run.smithi039.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T01:45:14.671 INFO:teuthology.orchestra.run.smithi172.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-09-12T01:45:14.686 INFO:teuthology.orchestra.run.smithi044.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-12T01:45:14.686 INFO:teuthology.orchestra.run.smithi039.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 990 kB/s | 49 kB 00:00 2024-09-12T01:45:14.704 INFO:teuthology.orchestra.run.smithi172.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-12T01:45:14.729 INFO:teuthology.orchestra.run.smithi172.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-12T01:45:14.737 INFO:teuthology.orchestra.run.smithi039.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 330 kB/s | 16 kB 00:00 2024-09-12T01:45:14.746 INFO:teuthology.orchestra.run.smithi172.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 781 kB/s | 33 kB 00:00 2024-09-12T01:45:14.753 INFO:teuthology.orchestra.run.smithi044.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-12T01:45:14.797 INFO:teuthology.orchestra.run.smithi172.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-12T01:45:14.804 INFO:teuthology.orchestra.run.smithi039.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T01:45:14.822 INFO:teuthology.orchestra.run.smithi172.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-12T01:45:14.847 INFO:teuthology.orchestra.run.smithi172.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-12T01:45:14.889 INFO:teuthology.orchestra.run.smithi172.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T01:45:14.912 INFO:teuthology.orchestra.run.smithi044.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-12T01:45:14.914 INFO:teuthology.orchestra.run.smithi172.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T01:45:14.937 INFO:teuthology.orchestra.run.smithi039.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.5 MB/s | 7.4 MB 00:00 2024-09-12T01:45:14.945 INFO:teuthology.orchestra.run.smithi044.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-09-12T01:45:14.970 INFO:teuthology.orchestra.run.smithi044.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-09-12T01:45:14.996 INFO:teuthology.orchestra.run.smithi039.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-12T01:45:15.004 INFO:teuthology.orchestra.run.smithi044.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-12T01:45:15.021 INFO:teuthology.orchestra.run.smithi039.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 218 kB/s | 18 kB 00:00 2024-09-12T01:45:15.029 INFO:teuthology.orchestra.run.smithi044.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-12T01:45:15.064 INFO:teuthology.orchestra.run.smithi172.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-12T01:45:15.071 INFO:teuthology.orchestra.run.smithi044.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T01:45:15.089 INFO:teuthology.orchestra.run.smithi172.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-12T01:45:15.105 INFO:teuthology.orchestra.run.smithi044.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-09-12T01:45:15.130 INFO:teuthology.orchestra.run.smithi044.stdout:(112/156): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-09-12T01:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-12T01:45:15.165 INFO:teuthology.orchestra.run.smithi172.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 243 kB/s | 24 kB 00:00 2024-09-12T01:45:15.172 INFO:teuthology.orchestra.run.smithi044.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T01:45:15.190 INFO:teuthology.orchestra.run.smithi172.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-12T01:45:15.197 INFO:teuthology.orchestra.run.smithi044.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:45:15.213 INFO:teuthology.orchestra.run.smithi039.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-12T01:45:15.215 INFO:teuthology.orchestra.run.smithi172.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T01:45:15.223 INFO:teuthology.orchestra.run.smithi044.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:45:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 330 kB/s | 80 kB 00:00 2024-09-12T01:45:15.248 INFO:teuthology.orchestra.run.smithi044.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-12T01:45:15.249 INFO:teuthology.orchestra.run.smithi172.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-12T01:45:15.273 INFO:teuthology.orchestra.run.smithi044.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T01:45:15.274 INFO:teuthology.orchestra.run.smithi172.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-12T01:45:15.297 INFO:teuthology.orchestra.run.smithi039.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T01:45:15.307 INFO:teuthology.orchestra.run.smithi044.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T01:45:15.340 INFO:teuthology.orchestra.run.smithi044.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T01:45:15.364 INFO:teuthology.orchestra.run.smithi039.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-12T01:45:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-09-12T01:45:15.414 INFO:teuthology.orchestra.run.smithi039.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-12T01:45:15.433 INFO:teuthology.orchestra.run.smithi044.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-12T01:45:15.439 INFO:teuthology.orchestra.run.smithi039.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T01:45:15.458 INFO:teuthology.orchestra.run.smithi044.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:45:15.481 INFO:teuthology.orchestra.run.smithi039.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-12T01:45:15.483 INFO:teuthology.orchestra.run.smithi044.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-12T01:45:15.509 INFO:teuthology.orchestra.run.smithi044.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-12T01:45:15.523 INFO:teuthology.orchestra.run.smithi039.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T01:45:15.534 INFO:teuthology.orchestra.run.smithi044.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-12T01:45:15.559 INFO:teuthology.orchestra.run.smithi044.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-12T01:45:15.565 INFO:teuthology.orchestra.run.smithi039.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T01:45:15.584 INFO:teuthology.orchestra.run.smithi044.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-12T01:45:15.600 INFO:teuthology.orchestra.run.smithi172.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-09-12T01:45:15.616 INFO:teuthology.orchestra.run.smithi039.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-12T01:45:15.652 INFO:teuthology.orchestra.run.smithi044.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-09-12T01:45:15.657 INFO:teuthology.orchestra.run.smithi039.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-09-12T01:45:15.667 INFO:teuthology.orchestra.run.smithi172.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-12T01:45:15.677 INFO:teuthology.orchestra.run.smithi044.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:45:15.691 INFO:teuthology.orchestra.run.smithi039.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-12T01:45:15.702 INFO:teuthology.orchestra.run.smithi044.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:45:15.725 INFO:teuthology.orchestra.run.smithi172.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-12T01:45:15.727 INFO:teuthology.orchestra.run.smithi044.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:45:15.733 INFO:teuthology.orchestra.run.smithi039.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 287 kB/s | 22 kB 00:00 2024-09-12T01:45:15.761 INFO:teuthology.orchestra.run.smithi044.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T01:45:15.766 INFO:teuthology.orchestra.run.smithi039.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-12T01:45:15.784 INFO:teuthology.orchestra.run.smithi172.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-12T01:45:15.803 INFO:teuthology.orchestra.run.smithi044.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T01:45:15.809 INFO:teuthology.orchestra.run.smithi039.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-12T01:45:15.820 INFO:teuthology.orchestra.run.smithi044.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-12T01:45:15.837 INFO:teuthology.orchestra.run.smithi044.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-12T01:45:15.862 INFO:teuthology.orchestra.run.smithi044.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T01:45:15.879 INFO:teuthology.orchestra.run.smithi044.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-09-12T01:45:15.901 INFO:teuthology.orchestra.run.smithi039.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-12T01:45:15.921 INFO:teuthology.orchestra.run.smithi044.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-12T01:45:15.925 INFO:teuthology.orchestra.run.smithi039.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-12T01:45:15.926 INFO:teuthology.orchestra.run.smithi172.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-09-12T01:45:15.946 INFO:teuthology.orchestra.run.smithi044.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-09-12T01:45:15.959 INFO:teuthology.orchestra.run.smithi172.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-12T01:45:15.972 INFO:teuthology.orchestra.run.smithi044.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T01:45:15.976 INFO:teuthology.orchestra.run.smithi039.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-12T01:45:15.984 INFO:teuthology.orchestra.run.smithi172.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T01:45:15.997 INFO:teuthology.orchestra.run.smithi044.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-12T01:45:16.018 INFO:teuthology.orchestra.run.smithi039.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T01:45:16.023 INFO:teuthology.orchestra.run.smithi044.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-12T01:45:16.043 INFO:teuthology.orchestra.run.smithi172.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T01:45:16.048 INFO:teuthology.orchestra.run.smithi044.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:45:16.073 INFO:teuthology.orchestra.run.smithi044.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-12T01:45:16.085 INFO:teuthology.orchestra.run.smithi039.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-12T01:45:16.098 INFO:teuthology.orchestra.run.smithi044.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T01:45:16.119 INFO:teuthology.orchestra.run.smithi039.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-12T01:45:16.123 INFO:teuthology.orchestra.run.smithi044.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:45:16.149 INFO:teuthology.orchestra.run.smithi044.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T01:45:16.152 INFO:teuthology.orchestra.run.smithi172.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-12T01:45:16.177 INFO:teuthology.orchestra.run.smithi172.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-12T01:45:16.194 INFO:teuthology.orchestra.run.smithi039.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-12T01:45:16.199 INFO:teuthology.orchestra.run.smithi044.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:45:16.210 INFO:teuthology.orchestra.run.smithi172.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-12T01:45:16.228 INFO:teuthology.orchestra.run.smithi039.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-12T01:45:16.236 INFO:teuthology.orchestra.run.smithi172.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-12T01:45:16.262 INFO:teuthology.orchestra.run.smithi039.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-12T01:45:16.270 INFO:teuthology.orchestra.run.smithi172.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T01:45:16.295 INFO:teuthology.orchestra.run.smithi172.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T01:45:16.328 INFO:teuthology.orchestra.run.smithi172.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-12T01:45:16.345 INFO:teuthology.orchestra.run.smithi039.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T01:45:16.362 INFO:teuthology.orchestra.run.smithi039.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-12T01:45:16.383 INFO:teuthology.orchestra.run.smithi044.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-12T01:45:16.404 INFO:teuthology.orchestra.run.smithi172.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-12T01:45:16.429 INFO:teuthology.orchestra.run.smithi039.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-12T01:45:16.467 INFO:teuthology.orchestra.run.smithi044.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T01:45:16.470 INFO:teuthology.orchestra.run.smithi172.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-12T01:45:16.508 INFO:teuthology.orchestra.run.smithi044.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-12T01:45:16.546 INFO:teuthology.orchestra.run.smithi039.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-09-12T01:45:16.567 INFO:teuthology.orchestra.run.smithi044.stdout:(152/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.7 MB/s | 3.4 MB 00:00 2024-09-12T01:45:16.579 INFO:teuthology.orchestra.run.smithi172.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 9.6 MB/s | 6.0 MB 00:00 2024-09-12T01:45:16.592 INFO:teuthology.orchestra.run.smithi044.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 325 kB/s | 41 kB 00:00 2024-09-12T01:45:16.604 INFO:teuthology.orchestra.run.smithi172.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 578 kB/s | 77 kB 00:00 2024-09-12T01:45:16.618 INFO:teuthology.orchestra.run.smithi044.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-12T01:45:16.621 INFO:teuthology.orchestra.run.smithi039.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-12T01:45:16.629 INFO:teuthology.orchestra.run.smithi172.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-12T01:45:16.663 INFO:teuthology.orchestra.run.smithi172.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T01:45:16.688 INFO:teuthology.orchestra.run.smithi172.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T01:45:16.692 INFO:teuthology.orchestra.run.smithi044.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-12T01:45:16.704 INFO:teuthology.orchestra.run.smithi039.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-12T01:45:16.722 INFO:teuthology.orchestra.run.smithi172.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T01:45:16.738 INFO:teuthology.orchestra.run.smithi039.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-12T01:45:16.747 INFO:teuthology.orchestra.run.smithi172.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 869 kB/s | 51 kB 00:00 2024-09-12T01:45:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:45:16.780 INFO:teuthology.orchestra.run.smithi039.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-12T01:45:16.835 INFO:teuthology.orchestra.run.smithi044.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-12T01:45:16.845 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:45:16.845 INFO:teuthology.orchestra.run.smithi044.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-12T01:45:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.2 MB/s | 5.1 MB 00:00 2024-09-12T01:45:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T01:45:16.889 INFO:teuthology.orchestra.run.smithi039.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-12T01:45:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-12T01:45:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:45:16.964 INFO:teuthology.orchestra.run.smithi039.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-12T01:45:16.966 INFO:teuthology.orchestra.run.smithi172.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-12T01:45:16.982 INFO:teuthology.orchestra.run.smithi172.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T01:45:16.989 INFO:teuthology.orchestra.run.smithi039.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-09-12T01:45:17.033 INFO:teuthology.orchestra.run.smithi172.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T01:45:17.050 INFO:teuthology.orchestra.run.smithi172.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 862 kB/s | 58 kB 00:00 2024-09-12T01:45:17.065 INFO:teuthology.orchestra.run.smithi039.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 816 kB/s | 61 kB 00:00 2024-09-12T01:45:17.092 INFO:teuthology.orchestra.run.smithi172.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T01:45:17.109 INFO:teuthology.orchestra.run.smithi172.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T01:45:17.142 INFO:teuthology.orchestra.run.smithi172.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-12T01:45:17.157 INFO:teuthology.orchestra.run.smithi039.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-12T01:45:17.159 INFO:teuthology.orchestra.run.smithi172.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-12T01:45:17.209 INFO:teuthology.orchestra.run.smithi172.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:45:17.210 INFO:teuthology.orchestra.run.smithi039.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-12T01:45:17.241 INFO:teuthology.orchestra.run.smithi039.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T01:45:17.252 INFO:teuthology.orchestra.run.smithi172.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-09-12T01:45:17.282 INFO:teuthology.orchestra.run.smithi039.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 358 kB/s | 26 kB 00:00 2024-09-12T01:45:17.285 INFO:teuthology.orchestra.run.smithi172.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-12T01:45:17.310 INFO:teuthology.orchestra.run.smithi172.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-12T01:45:17.316 INFO:teuthology.orchestra.run.smithi039.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-09-12T01:45:17.335 INFO:teuthology.orchestra.run.smithi172.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:45:17.350 INFO:teuthology.orchestra.run.smithi039.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-12T01:45:17.361 INFO:teuthology.orchestra.run.smithi172.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:45:17.375 INFO:teuthology.orchestra.run.smithi039.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-12T01:45:17.386 INFO:teuthology.orchestra.run.smithi172.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T01:45:17.411 INFO:teuthology.orchestra.run.smithi172.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:45:17.450 INFO:teuthology.orchestra.run.smithi039.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-12T01:45:17.462 INFO:teuthology.orchestra.run.smithi172.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T01:45:17.504 INFO:teuthology.orchestra.run.smithi172.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T01:45:17.529 INFO:teuthology.orchestra.run.smithi172.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:45:17.534 INFO:teuthology.orchestra.run.smithi039.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-12T01:45:17.554 INFO:teuthology.orchestra.run.smithi172.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:45:17.559 INFO:teuthology.orchestra.run.smithi039.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T01:45:17.580 INFO:teuthology.orchestra.run.smithi172.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-12T01:45:17.592 INFO:teuthology.orchestra.run.smithi039.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:45:17.626 INFO:teuthology.orchestra.run.smithi039.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-12T01:45:17.677 INFO:teuthology.orchestra.run.smithi039.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-12T01:45:17.702 INFO:teuthology.orchestra.run.smithi039.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T01:45:17.755 INFO:teuthology.orchestra.run.smithi172.stdout:(117/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-12T01:45:17.780 INFO:teuthology.orchestra.run.smithi172.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 859 kB/s | 172 kB 00:00 2024-09-12T01:45:17.786 INFO:teuthology.orchestra.run.smithi039.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-12T01:45:17.811 INFO:teuthology.orchestra.run.smithi039.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-12T01:45:17.822 INFO:teuthology.orchestra.run.smithi172.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.6 MB/s | 303 kB 00:00 2024-09-12T01:45:17.853 INFO:teuthology.orchestra.run.smithi039.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 803 kB/s | 54 kB 00:00 2024-09-12T01:45:17.889 INFO:teuthology.orchestra.run.smithi172.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-12T01:45:17.906 INFO:teuthology.orchestra.run.smithi172.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T01:45:17.940 INFO:teuthology.orchestra.run.smithi172.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-09-12T01:45:17.965 INFO:teuthology.orchestra.run.smithi172.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-12T01:45:17.990 INFO:teuthology.orchestra.run.smithi172.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T01:45:18.015 INFO:teuthology.orchestra.run.smithi172.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-12T01:45:18.041 INFO:teuthology.orchestra.run.smithi172.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T01:45:18.066 INFO:teuthology.orchestra.run.smithi172.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T01:45:18.088 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-12T01:45:18.091 INFO:teuthology.orchestra.run.smithi172.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T01:45:18.117 INFO:teuthology.orchestra.run.smithi172.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:45:18.142 INFO:teuthology.orchestra.run.smithi172.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:45:18.167 INFO:teuthology.orchestra.run.smithi172.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:45:18.201 INFO:teuthology.orchestra.run.smithi172.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T01:45:18.226 INFO:teuthology.orchestra.run.smithi172.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T01:45:18.251 INFO:teuthology.orchestra.run.smithi172.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:45:18.253 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-12T01:45:18.253 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-12T01:45:18.285 INFO:teuthology.orchestra.run.smithi172.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T01:45:18.303 INFO:teuthology.orchestra.run.smithi039.stdout:(92/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 8.7 MB/s | 49 MB 00:05 2024-09-12T01:45:18.310 INFO:teuthology.orchestra.run.smithi172.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-12T01:45:18.328 INFO:teuthology.orchestra.run.smithi039.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 88 kB/s | 42 kB 00:00 2024-09-12T01:45:18.335 INFO:teuthology.orchestra.run.smithi172.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-12T01:45:18.361 INFO:teuthology.orchestra.run.smithi172.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:45:18.386 INFO:teuthology.orchestra.run.smithi172.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T01:45:18.403 INFO:teuthology.orchestra.run.smithi172.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-09-12T01:45:18.404 INFO:teuthology.orchestra.run.smithi039.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T01:45:18.428 INFO:teuthology.orchestra.run.smithi172.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-12T01:45:18.437 INFO:teuthology.orchestra.run.smithi039.stdout:(95/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-12T01:45:18.463 INFO:teuthology.orchestra.run.smithi039.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-12T01:45:18.482 INFO:teuthology.orchestra.run.smithi172.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T01:45:18.503 INFO:teuthology.orchestra.run.smithi172.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-12T01:45:18.529 INFO:teuthology.orchestra.run.smithi172.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T01:45:18.530 INFO:teuthology.orchestra.run.smithi039.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-09-12T01:45:18.546 INFO:teuthology.orchestra.run.smithi172.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-12T01:45:18.555 INFO:teuthology.orchestra.run.smithi039.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-12T01:45:18.571 INFO:teuthology.orchestra.run.smithi172.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-12T01:45:18.596 INFO:teuthology.orchestra.run.smithi172.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-12T01:45:18.597 INFO:teuthology.orchestra.run.smithi039.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 58 kB 00:00 2024-09-12T01:45:18.622 INFO:teuthology.orchestra.run.smithi039.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T01:45:18.638 INFO:teuthology.orchestra.run.smithi172.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T01:45:18.672 INFO:teuthology.orchestra.run.smithi039.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi039.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-12T01:45:18.789 INFO:teuthology.orchestra.run.smithi039.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-12T01:45:18.855 INFO:teuthology.orchestra.run.smithi172.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-12T01:45:18.914 INFO:teuthology.orchestra.run.smithi172.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T01:45:18.973 INFO:teuthology.orchestra.run.smithi039.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-12T01:45:18.989 INFO:teuthology.orchestra.run.smithi172.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-12T01:45:18.998 INFO:teuthology.orchestra.run.smithi039.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-12T01:45:19.032 INFO:teuthology.orchestra.run.smithi039.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-12T01:45:19.039 INFO:teuthology.orchestra.run.smithi172.stdout:(152/156): librados2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 3.4 MB 00:00 2024-09-12T01:45:19.064 INFO:teuthology.orchestra.run.smithi172.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 271 kB/s | 41 kB 00:00 2024-09-12T01:45:19.065 INFO:teuthology.orchestra.run.smithi039.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-12T01:45:19.090 INFO:teuthology.orchestra.run.smithi172.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-12T01:45:19.099 INFO:teuthology.orchestra.run.smithi039.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-12T01:45:19.124 INFO:teuthology.orchestra.run.smithi039.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-12T01:45:19.150 INFO:teuthology.orchestra.run.smithi039.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 310 kB/s | 26 kB 00:00 2024-09-12T01:45:19.175 INFO:teuthology.orchestra.run.smithi039.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T01:45:19.200 INFO:teuthology.orchestra.run.smithi039.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T01:45:19.259 INFO:teuthology.orchestra.run.smithi039.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-12T01:45:19.273 INFO:teuthology.orchestra.run.smithi172.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-12T01:45:19.284 INFO:teuthology.orchestra.run.smithi039.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T01:45:19.309 INFO:teuthology.orchestra.run.smithi039.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-09-12T01:45:19.335 INFO:teuthology.orchestra.run.smithi039.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T01:45:19.360 INFO:teuthology.orchestra.run.smithi039.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T01:45:19.381 INFO:teuthology.orchestra.run.smithi172.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.5 MB/s | 2.4 MB 00:00 2024-09-12T01:45:19.385 INFO:teuthology.orchestra.run.smithi039.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T01:45:19.387 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:45:19.387 INFO:teuthology.orchestra.run.smithi172.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-12T01:45:19.418 INFO:teuthology.orchestra.run.smithi039.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:45:19.452 INFO:teuthology.orchestra.run.smithi039.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-12T01:45:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:45:19.513 INFO:teuthology.orchestra.run.smithi039.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T01:45:19.537 INFO:teuthology.orchestra.run.smithi039.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T01:45:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-12T01:45:19.587 INFO:teuthology.orchestra.run.smithi039.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T01:45:19.612 INFO:teuthology.orchestra.run.smithi039.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-12T01:45:19.629 INFO:teuthology.orchestra.run.smithi039.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T01:45:19.713 INFO:teuthology.orchestra.run.smithi039.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-09-12T01:45:19.730 INFO:teuthology.orchestra.run.smithi039.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-12T01:45:19.755 INFO:teuthology.orchestra.run.smithi039.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:45:19.772 INFO:teuthology.orchestra.run.smithi039.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T01:45:19.814 INFO:teuthology.orchestra.run.smithi039.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-12T01:45:19.847 INFO:teuthology.orchestra.run.smithi039.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T01:45:19.864 INFO:teuthology.orchestra.run.smithi039.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 995 kB/s | 16 kB 00:00 2024-09-12T01:45:19.890 INFO:teuthology.orchestra.run.smithi039.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-12T01:45:19.915 INFO:teuthology.orchestra.run.smithi039.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-12T01:45:19.940 INFO:teuthology.orchestra.run.smithi039.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-12T01:45:19.965 INFO:teuthology.orchestra.run.smithi039.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T01:45:19.991 INFO:teuthology.orchestra.run.smithi039.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T01:45:20.016 INFO:teuthology.orchestra.run.smithi039.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-12T01:45:20.041 INFO:teuthology.orchestra.run.smithi039.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:45:20.066 INFO:teuthology.orchestra.run.smithi039.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T01:45:20.092 INFO:teuthology.orchestra.run.smithi039.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:45:20.117 INFO:teuthology.orchestra.run.smithi039.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T01:45:20.142 INFO:teuthology.orchestra.run.smithi039.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T01:45:20.152 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-12T01:45:20.153 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-12T01:45:20.167 INFO:teuthology.orchestra.run.smithi039.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:45:20.193 INFO:teuthology.orchestra.run.smithi039.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T01:45:20.243 INFO:teuthology.orchestra.run.smithi039.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:45:20.385 INFO:teuthology.orchestra.run.smithi039.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-09-12T01:45:20.503 INFO:teuthology.orchestra.run.smithi039.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-12T01:45:20.578 INFO:teuthology.orchestra.run.smithi039.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 545 kB/s | 41 kB 00:00 2024-09-12T01:45:20.623 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-12T01:45:20.628 INFO:teuthology.orchestra.run.smithi039.stdout:(152/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.3 MB/s | 3.2 MB 00:00 2024-09-12T01:45:20.662 INFO:teuthology.orchestra.run.smithi039.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-12T01:45:20.737 INFO:teuthology.orchestra.run.smithi039.stdout:(154/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.0 MB/s | 3.4 MB 00:00 2024-09-12T01:45:20.774 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-12T01:45:20.775 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-12T01:45:20.779 INFO:teuthology.orchestra.run.smithi039.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-12T01:45:20.829 INFO:teuthology.orchestra.run.smithi039.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-12T01:45:20.835 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:45:20.835 INFO:teuthology.orchestra.run.smithi039.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-12T01:45:22.076 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-12T01:45:22.244 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-12T01:45:22.244 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-12T01:45:22.588 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-12T01:45:22.588 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-12T01:45:24.571 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-12T01:45:24.571 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-12T01:45:26.622 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-12T01:45:26.747 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:45:26.787 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:45:26.848 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:45:26.890 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:45:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:45:26.959 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:45:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:45:27.424 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:27.549 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:27.583 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:45:27.862 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:45:27.927 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:45:27.963 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:28.077 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:28.114 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:28.176 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:28.198 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:28.220 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:28.365 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:28.525 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:28.630 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:45:28.724 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:28.806 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:28.821 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-12T01:45:28.943 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:45:28.982 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:45:29.034 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:29.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:45:29.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:45:29.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:45:29.145 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:45:29.147 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:45:29.261 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:45:29.298 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:45:29.342 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:45:29.417 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:45:29.468 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:45:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:45:29.560 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:45:29.562 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:45:29.592 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:45:29.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:45:29.679 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:29.700 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:45:29.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:45:29.790 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:45:29.800 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:29.830 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:29.833 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:45:29.921 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:45:29.922 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:29.950 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:45:29.953 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:45:29.997 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:45:30.025 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:45:30.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:45:30.105 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:45:30.156 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:45:30.157 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:45:30.184 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:30.234 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:45:30.287 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:30.310 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:30.372 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:30.379 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:45:30.394 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:30.434 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:45:30.573 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:30.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:30.859 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:45:30.955 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:30.998 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:45:31.010 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:45:31.125 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:45:31.168 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:45:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:45:31.237 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:31.257 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:45:31.272 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-12T01:45:31.354 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:45:31.392 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:45:31.421 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:45:31.447 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:45:31.479 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:45:31.482 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:45:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:45:31.517 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:45:31.549 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:45:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:45:31.602 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:45:31.624 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:45:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:45:31.643 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:45:31.661 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:45:31.668 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:45:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:45:31.697 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:45:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:45:31.729 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:45:31.744 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:45:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:45:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:45:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:45:31.823 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:45:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:45:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:45:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:45:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:45:32.086 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:45:32.100 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:45:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:45:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:45:32.182 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:45:32.193 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:32.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:45:32.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:45:32.312 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:45:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:45:32.336 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:32.337 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:45:32.383 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:45:32.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:45:32.413 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:45:32.425 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:45:32.442 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:45:32.531 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:45:32.534 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:45:32.566 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:45:32.586 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:45:32.606 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:45:32.624 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:45:32.632 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:45:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:45:32.680 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:45:32.707 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:32.734 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:45:32.814 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:45:32.842 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:32.870 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:45:32.914 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:45:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:45:32.943 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:32.958 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:45:32.969 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:45:33.001 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:45:33.041 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:45:33.080 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:45:33.112 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:45:33.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:45:33.138 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:33.147 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:45:33.180 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:45:33.206 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:45:33.222 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:45:33.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:45:33.258 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:45:33.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:45:33.307 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:45:33.325 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:45:33.346 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:45:33.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:45:33.404 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:45:33.443 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:45:33.449 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:45:33.535 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:45:33.550 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:45:33.572 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:33.586 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:45:33.603 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:45:33.641 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:45:33.651 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:33.714 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:45:33.745 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:45:33.781 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:45:33.820 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:45:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:45:33.889 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:45:33.907 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:45:33.949 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:45:34.003 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:45:34.086 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:45:34.107 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:45:34.134 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:45:34.145 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:45:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:45:34.192 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:45:34.268 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:45:34.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:45:34.326 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:45:34.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:45:34.358 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:45:34.366 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:45:34.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:45:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:45:34.408 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:45:34.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:45:34.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:45:34.450 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:45:34.450 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:45:34.486 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:45:34.499 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:45:34.559 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:45:34.563 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:45:34.622 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:45:34.625 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:45:34.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:45:34.665 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:45:34.665 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:45:34.667 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:45:34.693 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:45:34.723 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:45:34.735 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:45:34.758 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:45:34.775 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:45:34.794 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:45:34.803 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:45:34.831 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:45:34.844 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:45:34.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:45:34.897 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:45:34.924 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:45:34.985 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:45:34.998 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:45:35.039 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:45:35.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:45:35.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:45:35.205 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:45:35.247 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:45:35.279 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:45:35.280 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:45:35.287 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:45:35.343 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:45:35.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:45:35.381 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:45:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:45:35.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:45:35.557 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:45:35.619 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:45:35.897 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:45:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:45:36.025 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:45:36.066 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:45:36.085 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:45:36.123 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:45:36.165 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:45:36.193 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:45:36.335 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:45:36.346 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:45:36.391 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:45:36.409 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:45:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:45:36.473 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:45:36.532 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:45:36.557 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:45:36.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:45:36.601 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:45:36.641 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:45:36.646 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:45:36.730 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:45:36.761 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:45:36.861 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:45:36.938 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:45:36.954 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:45:36.983 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:45:36.989 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:45:37.032 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:45:37.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:45:37.176 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:45:37.224 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:45:37.265 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:45:37.373 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:45:37.416 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:45:37.456 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:45:37.474 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:45:37.489 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:45:37.514 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:45:37.620 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:45:37.637 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:45:37.665 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:45:37.698 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:45:37.698 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:45:37.748 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:45:37.783 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:45:37.812 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:45:37.815 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:45:37.855 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:45:37.893 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:45:37.933 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:45:37.962 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:45:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:45:38.024 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:45:38.030 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:45:38.069 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:38.081 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:45:38.114 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:45:38.144 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:38.174 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:45:38.206 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:45:38.210 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:45:38.254 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:45:38.293 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:45:38.409 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:45:38.462 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:45:38.715 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:45:38.747 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:38.818 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:38.848 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:45:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:45:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:45:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:45:39.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:45:39.219 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:45:39.266 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:45:39.299 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:45:39.412 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:45:39.465 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:45:39.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:45:39.509 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:45:39.536 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:39.609 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:45:39.627 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:39.654 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:45:39.657 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:45:39.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:45:39.852 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:45:39.901 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:45:39.981 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:45:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:45:40.205 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:40.276 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:40.306 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:45:40.670 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:45:40.794 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:45:41.285 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:41.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:41.895 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:41.932 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:42.016 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:42.016 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:45:42.016 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:45:42.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:42.050 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:42.124 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:45:42.196 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:45:42.224 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:45:42.257 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:45:42.602 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:45:42.632 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:42.669 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:42.670 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:42.747 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:45:42.783 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:45:42.847 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:45:43.220 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:43.256 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:43.346 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:43.347 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:45:43.347 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:45:43.347 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:43.355 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:45:43.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:43.554 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:43.679 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:45:43.718 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:45:46.171 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:46.214 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:46.797 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:45:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:45:46.929 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:45:46.929 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:45:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:45:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-12T01:45:54.397 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-12T01:45:54.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:54.568 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:54.584 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:54.584 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:54.585 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:45:54.585 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-12T01:45:55.298 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-12T01:45:55.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:55.476 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:55.492 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:55.492 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:55.493 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:45:55.493 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:56.112 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:45:56.139 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:56.381 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:45:56.404 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:45:56.405 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:56.405 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:45:56.405 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:45:56.405 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:45:56.405 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:56.865 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:45:56.889 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:45:56.889 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:56.889 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:45:56.889 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:45:56.889 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:45:56.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:45:56.979 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:45:56.996 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:45:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:45:57.006 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:57.006 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:45:57.006 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:45:57.006 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:45:57.007 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:57.054 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:45:57.126 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:45:57.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:45:57.262 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:57.318 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:45:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:45:57.446 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:45:57.545 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:45:57.697 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:45:57.697 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:45:57.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:45:57.750 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:45:57.782 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:45:57.809 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:45:57.827 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:45:57.884 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:45:57.939 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:45:58.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:45:58.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:45:58.234 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:45:58.270 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:45:58.299 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:45:58.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:45:58.331 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:45:58.396 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:45:58.422 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:45:58.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:45:58.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:45:58.546 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:45:58.573 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:45:58.924 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:45:58.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:45:58.970 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:45:59.032 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:45:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-09-12T01:45:59.498 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-09-12T01:45:59.499 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-09-12T01:45:59.499 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:45:59.528 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:45:59.566 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:45:59.699 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:59.715 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:45:59.715 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:45:59.715 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:45:59.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:00.120 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:00.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:00.587 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:00.633 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:00.739 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:00.910 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:00.943 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:00.967 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:00.968 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:00.968 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:00.968 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:00.968 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:00.968 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:01.019 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:01.031 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:01.120 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:01.157 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:01.210 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:01.260 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:01.260 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:01.288 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:46:01.289 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:01.289 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:46:01.289 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:01.289 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:46:01.289 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:01.417 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:01.441 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:01.466 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:01.466 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:01.466 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:01.466 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:01.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:01.528 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:01.535 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:01.560 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:46:01.561 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:01.561 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:46:01.561 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:01.561 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:46:01.561 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:01.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:02.028 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:02.052 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:46:02.052 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.052 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:46:02.052 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:02.052 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:46:02.053 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:02.159 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:46:02.187 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:02.213 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:02.216 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:46:02.236 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:02.236 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.237 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:02.237 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:02.237 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:02.237 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:02.280 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:46:02.288 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:02.311 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:02.311 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.312 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:02.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:02.373 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:02.396 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:02.396 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.396 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:02.397 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:02.397 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:02.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:02.485 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:46:02.546 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:46:02.608 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:02.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:46:02.644 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:02.668 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:02.668 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.668 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:02.668 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:02.669 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:02.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:02.715 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:02.732 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:02.733 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:46:02.738 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:02.739 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.739 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:02.739 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:02.739 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:02.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:02.756 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:02.756 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.756 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:02.756 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:02.812 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:02.835 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:02.836 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:02.836 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:02.836 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:02.836 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:02.836 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:02.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:46:02.913 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:46:02.944 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:46:02.971 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:46:03.145 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:03.169 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:03.169 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:03.169 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:03.169 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:03.170 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:03.170 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:03.341 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:03.379 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:46:03.410 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:46:03.476 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:46:03.502 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:04.608 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:46:04.645 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:05.665 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:46:05.695 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:05.806 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:46:05.983 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:46:06.014 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:46:06.039 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:06.098 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:06.110 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:46:06.213 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:46:06.268 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:46:07.245 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:46:07.275 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:07.300 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:46:07.300 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:07.301 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:46:07.301 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:07.301 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:46:07.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:07.343 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:07.367 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:46:07.367 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:07.367 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:46:07.367 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:07.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:46:07.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:46:07.611 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:46:07.651 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:46:07.683 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:46:07.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:46:07.710 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:46:07.748 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:46:07.761 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:07.786 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:46:07.786 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:46:07.786 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:46:07.786 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:07.787 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:46:07.787 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:07.789 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:46:07.813 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:46:07.840 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:46:07.915 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:46:07.966 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:46:07.996 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:46:08.022 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:46:08.025 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:46:08.062 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:46:08.071 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:46:08.092 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:46:08.121 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:46:08.168 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:46:08.724 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:08.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:08.778 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:08.848 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:08.886 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:08.906 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:09.639 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:46:09.729 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:46:09.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:46:09.797 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:46:09.852 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:46:09.898 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:46:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:46:09.931 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:46:09.941 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:46:09.957 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:46:09.958 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:46:10.050 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:10.050 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:46:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:46:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:46:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:10.134 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:10.159 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:46:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.164 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:46:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.445 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:10.508 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:12.657 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:46:12.715 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:46:12.764 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:46:12.796 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:46:12.823 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:46:13.029 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:46:13.070 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:46:13.099 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:46:13.130 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:46:13.176 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:46:13.811 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:13.848 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:13.869 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:46:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:46:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:46:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:46:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:46:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:46:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:46:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:46:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:46:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:46:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:46:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:15.561 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:46:15.561 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:15.645 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:46:15.713 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:16.194 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:16.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:46:16.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:46:16.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:46:16.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:46:16.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:46:16.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:46:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:46:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:46:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:46:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:46:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:46:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:46:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:46:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:46:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:46:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:46:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:16.625 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:46:16.626 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:46:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:46:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:46:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:46:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:46:16.627 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:46:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:46:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:46:16.638 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:46:16.639 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:46:16.640 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:46:16.641 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:46:16.642 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:46:16.643 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:46:16.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:46:16.645 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:46:16.646 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:46:16.647 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:46:16.648 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:18.621 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.622 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.623 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.624 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:46:18.625 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.626 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:46:18.627 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:46:18.628 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:46:18.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:46:18.630 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:46:18.631 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:46:18.632 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:46:18.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:46:18.634 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:46:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:46:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:46:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:46:18.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:46:18.635 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-12T01:46:19.023 DEBUG:teuthology.parallel:result is None 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:19.180 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.181 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.183 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.185 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:46:19.186 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.187 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:46:19.188 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:46:19.189 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:46:19.190 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:46:19.191 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:46:19.192 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:46:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:46:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:19.193 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:46:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:46:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:46:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:46:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:46:19.194 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:46:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:46:19.195 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:46:19.195 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-12T01:46:19.644 DEBUG:teuthology.parallel:result is None 2024-09-12T01:46:21.376 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:21.376 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:46:21.377 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:46:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:46:21.379 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:46:21.391 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:46:21.392 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:46:21.393 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:46:21.394 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:46:21.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:46:21.396 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:46:21.397 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:46:21.398 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:46:21.399 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:46:21.400 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:46:21.401 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:46:21.402 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:46:21.402 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:46:21.402 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:46:21.402 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:46:24.014 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-12T01:46:24.015 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.016 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.017 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:46:24.018 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:46:24.019 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:46:24.020 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:46:24.021 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:46:24.022 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:46:24.023 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.024 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:46:24.025 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:46:24.026 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:46:24.027 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:46:24.027 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:46:24.027 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:46:24.027 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-12T01:46:24.398 DEBUG:teuthology.parallel:result is None 2024-09-12T01:46:24.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:24.552 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:46:24.576 INFO:teuthology.orchestra.run.smithi039.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.576 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.576 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:46:24.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:24.731 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:46:24.758 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.758 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.758 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:46:24.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:24.917 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:46:24.943 INFO:teuthology.orchestra.run.smithi172.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.943 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:46:24.944 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:46:24.946 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:46:24.946 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:46:24.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:46:24.975 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:46:24.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:46:25.007 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:46:25.008 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:46:25.039 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:46:25.039 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:46:25.039 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:46:25.066 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:46:25.132 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:46:25.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:46:25.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:46:25.230 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:46:25.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:46:25.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:46:25.330 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:46:25.330 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:46:25.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:46:25.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:46:25.423 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:46:25.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:46:25.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:46:25.521 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:46:25.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:46:25.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:46:25.620 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:46:25.620 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:46:25.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:46:25.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:46:25.713 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:46:25.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:46:25.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:46:25.811 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:46:25.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:46:25.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:46:25.910 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:46:26.005 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:46:26.005 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:26.005 INFO:tasks.cephadm:Cluster fsid is d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:46:26.006 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:46:26.006 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.39', 'mon.b': '172.21.15.44', 'mon.c': '172.21.15.172'} 2024-09-12T01:46:26.006 INFO:tasks.cephadm:First mon is mon.a on smithi039 2024-09-12T01:46:26.006 INFO:tasks.cephadm:First mgr is x 2024-09-12T01:46:26.006 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:46:26.007 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2024-09-12T01:46:26.034 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-09-12T01:46:26.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-12T01:46:26.094 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T01:46:26.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:26.244 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T01:46:26.398 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:46:26.400 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:46:26.400 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:46:26.400 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:26.794 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:46 /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:26.794 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.176 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:46 /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.176 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:46 /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.568 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.588 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.608 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:46:27.643 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T01:46:27.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:46:27.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:46:27.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:46:29.232 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:46:29.325 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:46:29.444 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:46:57.657 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:46:57.658 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-09-12T01:46:57.658 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:46:57.658 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-12T01:46:57.658 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T01:46:57.682 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:46:57.682 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:46:57.683 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:46:57.683 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2024-09-12T01:46:57.683 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:46:57.683 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T01:46:57.683 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T01:46:57.694 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T01:46:57.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2024-09-12T01:46:57.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-09-12T01:46:57.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-12T01:46:57.816 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2024-09-12T01:46:57.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-09-12T01:46:57.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-12T01:46:57.892 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T01:46:57.894 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:46:57.895 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:46:57.896 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:46:57.897 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T01:46:57.898 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T01:46:57.898 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:46:57.898 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:46:57.914 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d27de812-70a8-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:46:57.915 DEBUG:teuthology.orchestra.run.smithi039:mon.a> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T01:46:57.958 DEBUG:teuthology.orchestra.run.smithi039:mgr.x> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T01:46:58.001 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:46:58.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid d27de812-70a8-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.39 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:46:58.210 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:46:58.210 INFO:teuthology.orchestra.run.smithi039.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'd27de812-70a8-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.39', '--skip-admin-label'] 2024-09-12T01:46:58.211 INFO:teuthology.orchestra.run.smithi039.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:46:58.211 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying podman|docker is present... 2024-09-12T01:46:58.235 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:46:58.235 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying lvm2 is present... 2024-09-12T01:46:58.235 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying time synchronization is in place... 2024-09-12T01:46:58.243 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:46:58.243 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:46:58.250 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:46:58.250 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:46:58.257 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-12T01:46:58.264 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-12T01:46:58.264 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:46:58.264 INFO:teuthology.orchestra.run.smithi039.stdout:Repeating the final host check... 2024-09-12T01:46:58.286 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:46:58.287 INFO:teuthology.orchestra.run.smithi039.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:46:58.287 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl is present 2024-09-12T01:46:58.287 INFO:teuthology.orchestra.run.smithi039.stdout:lvcreate is present 2024-09-12T01:46:58.294 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:46:58.294 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:46:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:46:58.300 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:46:58.307 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-12T01:46:58.314 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-12T01:46:58.314 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:46:58.314 INFO:teuthology.orchestra.run.smithi039.stdout:Host looks OK 2024-09-12T01:46:58.314 INFO:teuthology.orchestra.run.smithi039.stdout:Cluster fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:46:58.314 INFO:teuthology.orchestra.run.smithi039.stdout:Acquiring lock 139832320025600 on /run/cephadm/d27de812-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:46:58.315 INFO:teuthology.orchestra.run.smithi039.stdout:Lock 139832320025600 acquired on /run/cephadm/d27de812-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:46:58.315 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 3300 ... 2024-09-12T01:46:58.315 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 6789 ... 2024-09-12T01:46:58.315 INFO:teuthology.orchestra.run.smithi039.stdout:Base mon IP(s) is [172.21.15.39:3300, 172.21.15.39:6789], mon addrv is [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T01:46:58.319 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.39 metric 100 2024-09-12T01:46:58.319 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.39 metric 100 2024-09-12T01:46:58.321 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:46:58.322 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T01:46:58.322 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-12T01:46:58.324 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:46:58.325 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-12T01:46:58.325 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-12T01:46:58.325 INFO:teuthology.orchestra.run.smithi039.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:46:58.326 INFO:teuthology.orchestra.run.smithi039.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:46:58.326 INFO:teuthology.orchestra.run.smithi039.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:46:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:46:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:46:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:46:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T01:46:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:46:58.828 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:46:58.828 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:46:59.749 INFO:teuthology.orchestra.run.smithi039.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:46:59.749 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:46:59.749 INFO:teuthology.orchestra.run.smithi039.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:47:00.613 INFO:teuthology.orchestra.run.smithi039.stdout:stat: stdout 167 167 2024-09-12T01:47:00.616 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial keys... 2024-09-12T01:47:01.594 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQAVSOJmgJniARAAj4BbC330JV784UL/icsR4Q== 2024-09-12T01:47:02.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQAVSOJm2yffNRAAAebIpk37ZWWrWqh/2Evhpg== 2024-09-12T01:47:03.331 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQAWSOJmNgi0MhAA54+9N0+eW/atjG+8pGfS9w== 2024-09-12T01:47:03.332 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial monmap... 2024-09-12T01:47:04.230 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:47:04.230 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool for a [v2:172.21.15.39:3300,v1:172.21.15.39:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: set fsid to d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:47:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mon... 2024-09-12T01:47:05.152 INFO:teuthology.orchestra.run.smithi039.stdout:create mon.a on 2024-09-12T01:47:05.360 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:47:05.577 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:47:05.769 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:47:05.769 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:47:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:47:06.021 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T01:47:06.183 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target.wants/ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:47:06.656 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:06 smithi039 ceph-mon[30837]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:47:06.686 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:47:06.686 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T01:47:06.693 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:47:06.693 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:47:06.693 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T01:47:06.693 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:47:06.694 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon to start... 2024-09-12T01:47:06.694 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon... 2024-09-12T01:47:06.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:06 smithi039 bash[30818]: 73c3bd782efbcf225e46eb89c053facd07a6ebc13ea63368b2f7e3834029cfc7 2024-09-12T01:47:06.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:06 smithi039 systemd[1]: Started Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:47:07.754 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout id: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.524879s) 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:47:07.755 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.096+0000 7f5e2cb1b640 1 Processor -- start 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2cb1b640 1 -- start start 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2cb1b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2cb1b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2807bdd0 con 0x7f5e28108080 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60964/0 (socket says 172.21.15.39:60964) 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.097+0000 7f5e2659c640 1 -- 172.21.15.39:0/3959595371 learned_addr learned my addr 172.21.15.39:0/3959595371 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.098+0000 7f5e2659c640 1 -- 172.21.15.39:0/3959595371 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2810a9b0 con 0x7f5e28108080 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e2659c640 1 --2- 172.21.15.39:0/3959595371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009820 tx=0x7f5e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc76bec5bdfec2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e25d9b640 1 -- 172.21.15.39:0/3959595371 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18037070 con 0x7f5e28108080 2024-09-12T01:47:07.756 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e25d9b640 1 -- 172.21.15.39:0/3959595371 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e18032440 con 0x7f5e28108080 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e25d9b640 1 -- 172.21.15.39:0/3959595371 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18032740 con 0x7f5e28108080 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/3959595371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 msgr2=0x7f5e2810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.100+0000 7f5e2cb1b640 1 --2- 172.21.15.39:0/3959595371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009820 tx=0x7f5e1802a270 comp rx=0 tx=0).stop 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/3959595371 shutdown_connections 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 --2- 172.21.15.39:0/3959595371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2810a470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/3959595371 >> 172.21.15.39:0/3959595371 conn(0x7f5e28101cc0 msgr2=0x7f5e281040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/3959595371 shutdown_connections 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/3959595371 wait complete. 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 Processor -- start 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.101+0000 7f5e2cb1b640 1 -- start start 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2cb1b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2cb1b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2810ae30 con 0x7f5e28108080 2024-09-12T01:47:07.757 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60976/0 (socket says 172.21.15.39:60976) 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2659c640 1 -- 172.21.15.39:0/4180322425 learned_addr learned my addr 172.21.15.39:0/4180322425 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2659c640 1 -- 172.21.15.39:0/4180322425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2819b590 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2659c640 1 --2- 172.21.15.39:0/4180322425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5e180090b0 tx=0x7f5e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18041070 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1803c7a0 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2819b820 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18037040 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.102+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2819e510 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.103+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e18044070 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.103+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5e1803d3f0 con 0x7f5e28108080 2024-09-12T01:47:07.758 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.103+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e281084e0 con 0x7f5e28108080 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.106+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5e18046450 con 0x7f5e28108080 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.167+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f5e28075f30 con 0x7f5e28108080 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.168+0000 7f5e1f7fe640 1 -- 172.21.15.39:0/4180322425 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f5e28075f30 con 0x7f5e28108080 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 msgr2=0x7f5e2819b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 --2- 172.21.15.39:0/4180322425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5e180090b0 tx=0x7f5e180046c0 comp rx=0 tx=0).stop 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 shutdown_connections 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 --2- 172.21.15.39:0/4180322425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e28108080 0x7f5e2819b050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 >> 172.21.15.39:0/4180322425 conn(0x7f5e28101cc0 msgr2=0x7f5e28103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 shutdown_connections 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:07.169+0000 7f5e2cb1b640 1 -- 172.21.15.39:0/4180322425 wait complete. 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:mon is available 2024-09-12T01:47:07.759 INFO:teuthology.orchestra.run.smithi039.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:47:07.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:47:07.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: monmap epoch 1 2024-09-12T01:47:07.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:07.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: last_changed 2024-09-12T01:47:03.680293+0000 2024-09-12T01:47:07.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: min_mon_release 19 (squid) 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: election_strategy: 1 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: fsmap 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: mgrmap e1: no daemons active 2024-09-12T01:47:07.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:07 smithi039 ceph-mon[30837]: from='client.? 172.21.15.39:0/4180322425' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:47:09.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:08 smithi039 ceph-mon[30837]: from='client.? 172.21.15.39:0/202140509' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:47:09.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:08 smithi039 ceph-mon[30837]: from='client.? 172.21.15.39:0/202140509' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:47:13.616 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.159+0000 7f575a676640 1 Processor -- start 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f575a676640 1 -- start start 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f575a676640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f575a676640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f575407bde0 con 0x7f5754108000 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f5753fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:13.617 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f5753fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60982/0 (socket says 172.21.15.39:60982) 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f5753fff640 1 -- 172.21.15.39:0/369048964 learned_addr learned my addr 172.21.15.39:0/369048964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.160+0000 7f5753fff640 1 -- 172.21.15.39:0/369048964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575410a930 con 0x7f5754108000 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.161+0000 7f5753fff640 1 --2- 172.21.15.39:0/369048964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5744009820 tx=0x7f574402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2de1679f9b645a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.161+0000 7f5752ffd640 1 -- 172.21.15.39:0/369048964 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5744037070 con 0x7f5754108000 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.161+0000 7f5752ffd640 1 -- 172.21.15.39:0/369048964 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5744032440 con 0x7f5754108000 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.161+0000 7f5752ffd640 1 -- 172.21.15.39:0/369048964 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5744032740 con 0x7f5754108000 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 -- 172.21.15.39:0/369048964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 msgr2=0x7f575410a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 --2- 172.21.15.39:0/369048964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5744009820 tx=0x7f574402a270 comp rx=0 tx=0).stop 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 -- 172.21.15.39:0/369048964 shutdown_connections 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 --2- 172.21.15.39:0/369048964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575410a3f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 -- 172.21.15.39:0/369048964 >> 172.21.15.39:0/369048964 conn(0x7f5754101b80 msgr2=0x7f5754103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 -- 172.21.15.39:0/369048964 shutdown_connections 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 -- 172.21.15.39:0/369048964 wait complete. 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.162+0000 7f575a676640 1 Processor -- start 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f575a676640 1 -- start start 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f575a676640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f575a676640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f575410ada0 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f5753fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f5753fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60984/0 (socket says 172.21.15.39:60984) 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f5753fff640 1 -- 172.21.15.39:0/202140509 learned_addr learned my addr 172.21.15.39:0/202140509 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.163+0000 7f5753fff640 1 -- 172.21.15.39:0/202140509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575419b540 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f5753fff640 1 --2- 172.21.15.39:0/202140509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f57440090b0 tx=0x7f57440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5744041070 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574403c7a0 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575419b7d0 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5744037040 con 0x7f5754108000 2024-09-12T01:47:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575419e4c0 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5744044070 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.164+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f574403d3f0 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.165+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5754108460 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.167+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5744046450 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.227+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f5754075f40 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.230+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f5744046630 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f57517fa640 1 -- 172.21.15.39:0/202140509 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5744058970 con 0x7f5754108000 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 msgr2=0x7f575419b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f575a676640 1 --2- 172.21.15.39:0/202140509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f57440090b0 tx=0x7f57440046c0 comp rx=0 tx=0).stop 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 shutdown_connections 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f575a676640 1 --2- 172.21.15.39:0/202140509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5754108000 0x7f575419b000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.231+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 >> 172.21.15.39:0/202140509 conn(0x7f5754101b80 msgr2=0x7f5754102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.232+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 shutdown_connections 2024-09-12T01:47:13.621 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:08.232+0000 7f575a676640 1 -- 172.21.15.39:0/202140509 wait complete. 2024-09-12T01:47:13.621 INFO:teuthology.orchestra.run.smithi039.stdout:Generating new minimal ceph.conf... 2024-09-12T01:47:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:16 smithi039 ceph-mon[30837]: from='client.? 172.21.15.39:0/3749059008' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:19.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.627+0000 7fda6e1b8640 1 Processor -- start 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.627+0000 7fda6e1b8640 1 -- start start 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda6e1b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda6e1b8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda68107380 con 0x7fda681069b0 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33604/0 (socket says 172.21.15.39:33604) 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda677fe640 1 -- 172.21.15.39:0/86779053 learned_addr learned my addr 172.21.15.39:0/86779053 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.628+0000 7fda677fe640 1 -- 172.21.15.39:0/86779053 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681076d0 con 0x7fda681069b0 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.629+0000 7fda677fe640 1 --2- 172.21.15.39:0/86779053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fda58009820 tx=0x7fda5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d25158806be8983 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.629+0000 7fda66ffd640 1 -- 172.21.15.39:0/86779053 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58037070 con 0x7fda681069b0 2024-09-12T01:47:19.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.629+0000 7fda66ffd640 1 -- 172.21.15.39:0/86779053 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda58032900 con 0x7fda681069b0 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.629+0000 7fda66ffd640 1 -- 172.21.15.39:0/86779053 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58030850 con 0x7fda681069b0 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- 172.21.15.39:0/86779053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 msgr2=0x7fda68106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 --2- 172.21.15.39:0/86779053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fda58009820 tx=0x7fda5802a270 comp rx=0 tx=0).stop 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- 172.21.15.39:0/86779053 shutdown_connections 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 --2- 172.21.15.39:0/86779053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda68106db0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- 172.21.15.39:0/86779053 >> 172.21.15.39:0/86779053 conn(0x7fda68101400 msgr2=0x7fda68103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- 172.21.15.39:0/86779053 shutdown_connections 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- 172.21.15.39:0/86779053 wait complete. 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 Processor -- start 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.630+0000 7fda6e1b8640 1 -- start start 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda6e1b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:19.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda6e1b8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810aa80 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda677fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33616/0 (socket says 172.21.15.39:33616) 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda677fe640 1 -- 172.21.15.39:0/3749059008 learned_addr learned my addr 172.21.15.39:0/3749059008 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda677fe640 1 -- 172.21.15.39:0/3749059008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68191c10 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda677fe640 1 --2- 172.21.15.39:0/3749059008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda580097f0 tx=0x7fda58030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda58037040 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda58040070 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6818fe00 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.631+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5803a390 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.632+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda681902e0 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.632+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda5803a5e0 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.632+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda58045950 con 0x7fda681069b0 2024-09-12T01:47:19.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.633+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68106e30 con 0x7fda681069b0 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.635+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fda58045460 con 0x7fda681069b0 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.696+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fda68194fe0 con 0x7fda681069b0 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.696+0000 7fda657fa640 1 -- 172.21.15.39:0/3749059008 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fda5803b430 con 0x7fda681069b0 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 msgr2=0x7fda681916d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 --2- 172.21.15.39:0/3749059008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda580097f0 tx=0x7fda58030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 shutdown_connections 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 --2- 172.21.15.39:0/3749059008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda681069b0 0x7fda681916d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 >> 172.21.15.39:0/3749059008 conn(0x7fda68101400 msgr2=0x7fda68102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 shutdown_connections 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:16.697+0000 7fda6e1b8640 1 -- 172.21.15.39:0/3749059008 wait complete. 2024-09-12T01:47:19.646 INFO:teuthology.orchestra.run.smithi039.stdout:Restarting the monitor... 2024-09-12T01:47:19.939 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:19 smithi039 systemd[1]: Stopping Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:47:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[30833]: 2024-09-12T01:47:19.937+0000 7f24d5ae4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:47:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[30833]: 2024-09-12T01:47:19.937+0000 7f24d5ae4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:47:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 podman[31079]: 2024-09-12 01:47:20.184293007 +0000 UTC m=+0.356998642 container died 73c3bd782efbcf225e46eb89c053facd07a6ebc13ea63368b2f7e3834029cfc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:47:20.688 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 podman[31079]: 2024-09-12 01:47:20.505016536 +0000 UTC m=+0.677722171 container cleanup 73c3bd782efbcf225e46eb89c053facd07a6ebc13ea63368b2f7e3834029cfc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:47:20.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 bash[31079]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:47:21.114 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 podman[31094]: 2024-09-12 01:47:20.689039302 +0000 UTC m=+0.503625346 container remove 73c3bd782efbcf225e46eb89c053facd07a6ebc13ea63368b2f7e3834029cfc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T01:47:21.115 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 systemd[1]: ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:47:21.115 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 systemd[1]: Stopped Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:47:21.115 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:20 smithi039 systemd[1]: Starting Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:47:21.376 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 podman[31185]: 2024-09-12 01:47:21.114995259 +0000 UTC m=+0.092871557 container create dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:47:21.376 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 podman[31185]: 2024-09-12 01:47:21.03889125 +0000 UTC m=+0.016767564 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:21.376 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 podman[31185]: 2024-09-12 01:47:21.292317786 +0000 UTC m=+0.270194096 container init dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 podman[31185]: 2024-09-12 01:47:21.295567529 +0000 UTC m=+0.273443828 container start dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: pidfile_write: ignore empty --pid-file 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: load: jerasure load: lrc 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Git sha 0 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: DB SUMMARY 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: DB Session ID: U4XMQXJV2B4NTF81H9VZ 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T01:47:21.377 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:47:21.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104816 ; 2024-09-12T01:47:21.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:47:21.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:47:21.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:47:21.378 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.env: 0x5601016db940 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.info_log: 0x5601023b36e0 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.statistics: (nil) 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.use_fsync: 0 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:47:21.379 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.db_log_dir: 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.wal_dir: 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:47:21.380 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.write_buffer_manager: 0x5601023c2dc0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:47:21.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.unordered_write: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.row_cache: None 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.wal_filter: None 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.wal_compression: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:47:21.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:47:21.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_open_files: -1 2024-09-12T01:47:21.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Compression algorithms supported: 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kZSTD supported: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:47:21.385 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.merge_operator: 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_filter: None 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5601023b3320) 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:47:21.386 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_type: 0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_index_type: 0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_shortening: 1 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: checksum: 4 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: no_block_cache: 0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache: 0x5601023a71f0 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_options: 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: capacity : 536870912 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_shard_bits : 4 2024-09-12T01:47:21.387 INFO:journalctl@ceph.mon.a.smithi039.stdout: strict_capacity_limit : 0 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_compressed: (nil) 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: persistent_cache: (nil) 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size: 4096 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size_deviation: 10 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_restart_interval: 16 2024-09-12T01:47:21.388 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_block_restart_interval: 1 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: metadata_block_size: 4096 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: partition_filters: 0 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: use_delta_encoding: 1 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: filter_policy: bloomfilter 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: whole_key_filtering: 1 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: verify_compression: 0 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: format_version: 5 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_index_compression: 1 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_align: 0 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: max_auto_readahead_size: 262144 2024-09-12T01:47:21.389 INFO:journalctl@ceph.mon.a.smithi039.stdout: prepopulate_block_cache: 0 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression: NoCompression 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.num_levels: 7 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:47:21.390 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:21.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:47:21.392 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:47:21.392 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:21.392 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:47:21.392 INFO:teuthology.orchestra.run.smithi039.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:47:21.393 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:47:21.394 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:47:21.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.ttl: 2592000 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:47:21.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a1c0df7f-3b6b-4706-b655-f0fb03264042 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105641322111, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T01:47:21.397 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105641323204, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99920, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97806, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14179, "raw_average_key_size": 49, "raw_value_size": 90142, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105641, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a1c0df7f-3b6b-4706-b655-f0fb03264042", "db_session_id": "U4XMQXJV2B4NTF81H9VZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105641323301, "job": 1, "event": "recovery_finished"} 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5601023d4e00 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: DB pointer 0x5601024d0000 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** DB Stats ** 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:21.398 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: L0 2/0 99.44 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Sum 2/0 99.44 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 141.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:47:21.399 INFO:journalctl@ceph.mon.a.smithi039.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 141.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative compaction: 0.00 GB write, 11.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval compaction: 0.00 GB write, 11.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache BinnedLRUCache@0x5601023a71f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:47:21.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: starting mon.a rank 0 at public addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] at bind addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???) e1 preinit fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).mds e1 new map 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).mds e1 print_map 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: e1 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: btime 2024-09-12T01:47:06:646574+0000 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: legacy client fscid: -1 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T01:47:21.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: No filesystems configured 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 bash[31185]: dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da 2024-09-12T01:47:21.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 systemd[1]: Started Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:47:21.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:47:21.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: monmap epoch 1 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: last_changed 2024-09-12T01:47:03.680293+0000 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: min_mon_release 19 (squid) 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: election_strategy: 1 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: fsmap 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:47:21.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:21 smithi039 ceph-mon[31204]: mgrmap e1: no daemons active 2024-09-12T01:47:22.430 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.819+0000 7f5bcc31b640 1 Processor -- start 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.819+0000 7f5bcc31b640 1 -- start start 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bcc31b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bcc31b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc407be20 con 0x7f5bc4107fc0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bca0b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bca0b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33626/0 (socket says 172.21.15.39:33626) 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bca0b7640 1 -- 172.21.15.39:0/673010965 learned_addr learned my addr 172.21.15.39:0/673010965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.820+0000 7f5bca0b7640 1 -- 172.21.15.39:0/673010965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc410a8f0 con 0x7f5bc4107fc0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.822+0000 7f5bca0b7640 1 --2- 172.21.15.39:0/673010965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009820 tx=0x7f5bc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b71070de56039f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bc90b5640 1 -- 172.21.15.39:0/673010965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0037070 con 0x7f5bc4107fc0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bc90b5640 1 -- 172.21.15.39:0/673010965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5bc0032900 con 0x7f5bc4107fc0 2024-09-12T01:47:22.431 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bc90b5640 1 -- 172.21.15.39:0/673010965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0030850 con 0x7f5bc4107fc0 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 -- 172.21.15.39:0/673010965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 msgr2=0x7f5bc410a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 --2- 172.21.15.39:0/673010965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009820 tx=0x7f5bc002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 -- 172.21.15.39:0/673010965 shutdown_connections 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 --2- 172.21.15.39:0/673010965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc410a3b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 -- 172.21.15.39:0/673010965 >> 172.21.15.39:0/673010965 conn(0x7f5bc4101b80 msgr2=0x7f5bc4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 -- 172.21.15.39:0/673010965 shutdown_connections 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.823+0000 7f5bcc31b640 1 -- 172.21.15.39:0/673010965 wait complete. 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bcc31b640 1 Processor -- start 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bcc31b640 1 -- start start 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bcc31b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bcc31b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc410b930 con 0x7f5bc4107fc0 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bca0b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:22.432 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bca0b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33642/0 (socket says 172.21.15.39:33642) 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.824+0000 7f5bca0b7640 1 -- 172.21.15.39:0/3255549342 learned_addr learned my addr 172.21.15.39:0/3255549342 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bca0b7640 1 -- 172.21.15.39:0/3255549342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc419bd70 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bca0b7640 1 --2- 172.21.15.39:0/3255549342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0032ce0 tx=0x7f5bc0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0042070 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5bc00308c0 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bc0037040 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc419c000 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc419ecf0 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5bc0045070 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.825+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5bc0047b80 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.826+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc4108420 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.828+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5bc003c740 con 0x7f5bc4107fc0 2024-09-12T01:47:22.433 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.888+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f5bc41953b0 con 0x7f5bc4107fc0 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.894+0000 7f5bbb7fe640 1 -- 172.21.15.39:0/3255549342 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f5bc003c920 con 0x7f5bc4107fc0 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 msgr2=0x7f5bc419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 --2- 172.21.15.39:0/3255549342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0032ce0 tx=0x7f5bc0032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 shutdown_connections 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 --2- 172.21.15.39:0/3255549342 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bc4107fc0 0x7f5bc419b830 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 >> 172.21.15.39:0/3255549342 conn(0x7f5bc4101b80 msgr2=0x7f5bc4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 shutdown_connections 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:21.895+0000 7f5bcc31b640 1 -- 172.21.15.39:0/3255549342 wait complete. 2024-09-12T01:47:22.434 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:47:22.449 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:47:22.449 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mgr... 2024-09-12T01:47:22.449 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:47:22.450 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:47:22.721 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:47:22.721 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T01:47:22.879 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968.target.wants/ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d27de812-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:47:23.121 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:22 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3255549342' entity='client.admin' 2024-09-12T01:47:23.121 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:22 smithi039 systemd[1]: Starting Ceph mgr.x for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:47:23.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 podman[31412]: 2024-09-12 01:47:23.023493461 +0000 UTC m=+0.016062423 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:23.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 podman[31412]: 2024-09-12 01:47:23.126702995 +0000 UTC m=+0.119271946 container create 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:47:23.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 podman[31412]: 2024-09-12 01:47:23.371102316 +0000 UTC m=+0.363671268 container init 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:47:23.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 podman[31412]: 2024-09-12 01:47:23.373921425 +0000 UTC m=+0.366490376 container start 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:47:23.487 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:47:23.487 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T01:47:23.495 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:47:23.495 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:47:23.496 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T01:47:23.496 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:47:23.505 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:47:23.505 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T01:47:23.513 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:47:23.514 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:47:23.514 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T01:47:23.514 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T01:47:23.514 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr to start... 2024-09-12T01:47:23.514 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr... 2024-09-12T01:47:23.646 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 bash[31412]: 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 2024-09-12T01:47:23.646 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 systemd[1]: Started Ceph mgr.x for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:47:23.646 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:23.501+0000 7fa329468040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:47:23.646 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:23.574+0000 7fa329468040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:47:23.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:23.731+0000 7fa329468040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:47:23.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:23.803+0000 7fa329468040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:47:24.373 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:24 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1536665554' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:47:24.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:23.961+0000 7fa329468040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:47:24.373 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:24.112+0000 7fa329468040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:47:24.624 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:24.624 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:47:24.624 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:47:24.624 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:47:24.624 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:24.625 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:47:24.626 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:47:24.634 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:47:06:646574+0000", 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:47:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:47:24.636 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:47:06.648514+0000", 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.963+0000 7f4ebbf95640 1 Processor -- start 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.963+0000 7f4ebbf95640 1 -- start start 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4ebbf95640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4ebbf95640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb407be60 con 0x7f4eb4107f80 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4eb9d31640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4eb9d31640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42508/0 (socket says 172.21.15.39:42508) 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4eb9d31640 1 -- 172.21.15.39:0/109724196 learned_addr learned my addr 172.21.15.39:0/109724196 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.964+0000 7f4eb9d31640 1 -- 172.21.15.39:0/109724196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb410a8b0 con 0x7f4eb4107f80 2024-09-12T01:47:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.965+0000 7f4eb9d31640 1 --2- 172.21.15.39:0/109724196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009820 tx=0x7f4eb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efc0f1fd09b16de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.965+0000 7f4eb8d2f640 1 -- 172.21.15.39:0/109724196 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb0037070 con 0x7f4eb4107f80 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.965+0000 7f4eb8d2f640 1 -- 172.21.15.39:0/109724196 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4eb0032900 con 0x7f4eb4107f80 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.965+0000 7f4eb8d2f640 1 -- 172.21.15.39:0/109724196 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb0030850 con 0x7f4eb4107f80 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 -- 172.21.15.39:0/109724196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 msgr2=0x7f4eb410a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 --2- 172.21.15.39:0/109724196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009820 tx=0x7f4eb002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 -- 172.21.15.39:0/109724196 shutdown_connections 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 --2- 172.21.15.39:0/109724196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb410a370 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 -- 172.21.15.39:0/109724196 >> 172.21.15.39:0/109724196 conn(0x7f4eb4101b80 msgr2=0x7f4eb4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 -- 172.21.15.39:0/109724196 shutdown_connections 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.966+0000 7f4ebbf95640 1 -- 172.21.15.39:0/109724196 wait complete. 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4ebbf95640 1 Processor -- start 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4ebbf95640 1 -- start start 2024-09-12T01:47:24.638 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4ebbf95640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4ebbf95640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb410b950 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4eb9d31640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4eb9d31640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42514/0 (socket says 172.21.15.39:42514) 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.967+0000 7f4eb9d31640 1 -- 172.21.15.39:0/1536665554 learned_addr learned my addr 172.21.15.39:0/1536665554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eb9d31640 1 -- 172.21.15.39:0/1536665554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb419bd70 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eb9d31640 1 --2- 172.21.15.39:0/1536665554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097f0 tx=0x7f4eb0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb0037040 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4eb0040070 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb419c000 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb003a390 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb419ecf0 con 0x7f4eb4107f80 2024-09-12T01:47:24.639 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4eb003a650 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.968+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4eb00459b0 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.969+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb41083e0 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:23.971+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4eb0045460 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.034+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4eb419c480 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.034+0000 7f4eaaffd640 1 -- 172.21.15.39:0/1536665554 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4eb003b430 con 0x7f4eb4107f80 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 msgr2=0x7f4eb419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 --2- 172.21.15.39:0/1536665554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097f0 tx=0x7f4eb0030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 shutdown_connections 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 --2- 172.21.15.39:0/1536665554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4eb4107f80 0x7f4eb419b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 >> 172.21.15.39:0/1536665554 conn(0x7f4eb4101b80 msgr2=0x7f4eb4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.035+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 shutdown_connections 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:24.036+0000 7f4ebbf95640 1 -- 172.21.15.39:0/1536665554 wait complete. 2024-09-12T01:47:24.640 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:47:24.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:24.447+0000 7fa329468040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:47:24.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:24.510+0000 7fa329468040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:47:25.160 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:24.706+0000 7fa329468040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:47:25.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:25.638+0000 7fa329468040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:47:25.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:25.708+0000 7fa329468040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:47:26.739 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:26.465+0000 7fa329468040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:47:26.739 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:26.586+0000 7fa329468040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:47:27.036 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:26.739+0000 7fa329468040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:47:27.036 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:26.803+0000 7fa329468040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:47:27.036 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:26.963+0000 7fa329468040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:47:27.036 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.035+0000 7fa329468040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:47:27.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/588576631' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:47:27.345 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.100+0000 7fa329468040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:47:27.345 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.275+0000 7fa329468040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:47:27.345 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.344+0000 7fa329468040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:47:27.628 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.414+0000 7fa329468040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:47:27.628 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.501+0000 7fa329468040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:47:27.628 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.563+0000 7fa329468040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:47:27.628 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:27.625+0000 7fa329468040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:47:27.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:27.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:47:27.771 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:47:27.778 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:47:27.778 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:47:27.778 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:47:27.778 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:47:27.778 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:47:27.779 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:47:06:646574+0000", 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:27.780 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:47:06.648514+0000", 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.040+0000 7fc951b4b640 1 Processor -- start 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.040+0000 7fc951b4b640 1 -- start start 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc951b4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc951b4b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c07be60 con 0x7fc94c107f80 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42530/0 (socket says 172.21.15.39:42530) 2024-09-12T01:47:27.781 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc94b7fe640 1 -- 172.21.15.39:0/1627985574 learned_addr learned my addr 172.21.15.39:0/1627985574 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.041+0000 7fc94b7fe640 1 -- 172.21.15.39:0/1627985574 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c10a8b0 con 0x7fc94c107f80 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.042+0000 7fc94b7fe640 1 --2- 172.21.15.39:0/1627985574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009820 tx=0x7fc93c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b314844b4786e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.042+0000 7fc94affd640 1 -- 172.21.15.39:0/1627985574 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c037070 con 0x7fc94c107f80 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.042+0000 7fc94affd640 1 -- 172.21.15.39:0/1627985574 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc93c032900 con 0x7fc94c107f80 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.042+0000 7fc94affd640 1 -- 172.21.15.39:0/1627985574 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c030850 con 0x7fc94c107f80 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 -- 172.21.15.39:0/1627985574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 msgr2=0x7fc94c10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 --2- 172.21.15.39:0/1627985574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009820 tx=0x7fc93c02a270 comp rx=0 tx=0).stop 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 -- 172.21.15.39:0/1627985574 shutdown_connections 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 --2- 172.21.15.39:0/1627985574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c10a370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 -- 172.21.15.39:0/1627985574 >> 172.21.15.39:0/1627985574 conn(0x7fc94c101b80 msgr2=0x7fc94c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 -- 172.21.15.39:0/1627985574 shutdown_connections 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.043+0000 7fc951b4b640 1 -- 172.21.15.39:0/1627985574 wait complete. 2024-09-12T01:47:27.782 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc951b4b640 1 Processor -- start 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc951b4b640 1 -- start start 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc951b4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc951b4b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c10b950 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42546/0 (socket says 172.21.15.39:42546) 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc94b7fe640 1 -- 172.21.15.39:0/588576631 learned_addr learned my addr 172.21.15.39:0/588576631 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc94b7fe640 1 -- 172.21.15.39:0/588576631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c107d40 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.044+0000 7fc94b7fe640 1 --2- 172.21.15.39:0/588576631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc93c032ce0 tx=0x7fc93c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c042070 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc93c0308c0 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94c105f30 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc93c037040 con 0x7fc94c107f80 2024-09-12T01:47:27.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94c106470 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc93c045070 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.045+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc93c047bd0 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.046+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94c1083e0 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.048+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc93c03c830 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.111+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc94c075df0 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.111+0000 7fc9497fa640 1 -- 172.21.15.39:0/588576631 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc93c03ca10 con 0x7fc94c107f80 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 msgr2=0x7fc94c107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 --2- 172.21.15.39:0/588576631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc93c032ce0 tx=0x7fc93c032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 shutdown_connections 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 --2- 172.21.15.39:0/588576631 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc94c107f80 0x7fc94c107800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 >> 172.21.15.39:0/588576631 conn(0x7fc94c101b80 msgr2=0x7fc94c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 shutdown_connections 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:27.113+0000 7fc951b4b640 1 -- 172.21.15.39:0/588576631 wait complete. 2024-09-12T01:47:27.784 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (2/15)... 2024-09-12T01:47:28.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:28.453+0000 7fa329468040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: Activating manager daemon x 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: mgrmap e2: x(active, starting, since 0.00324548s) 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: Manager daemon x is now available 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:47:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' 2024-09-12T01:47:28.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:28 smithi039 ceph-mon[31204]: from='mgr.14100 172.21.15.39:0/146571585' entity='mgr.x' 2024-09-12T01:47:30.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:30 smithi039 ceph-mon[31204]: mgrmap e3: x(active, since 1.00916s) 2024-09-12T01:47:31.176 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:31.176 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:47:31.176 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:31.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:47:31.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:47:31.186 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:47:31.187 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:47:06:646574+0000", 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:47:31.188 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:47:06.648514+0000", 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.352+0000 7f623fec5640 1 Processor -- start 2024-09-12T01:47:31.189 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.352+0000 7f623fec5640 1 -- start start 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623fec5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623fec5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f623807c8a0 con 0x7f623807de20 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623dc61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623dc61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42638/0 (socket says 172.21.15.39:42638) 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623dc61640 1 -- 172.21.15.39:0/1074666533 learned_addr learned my addr 172.21.15.39:0/1074666533 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.353+0000 7f623dc61640 1 -- 172.21.15.39:0/1074666533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623807ca20 con 0x7f623807de20 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.354+0000 7f623dc61640 1 --2- 172.21.15.39:0/1074666533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6234009820 tx=0x7f623402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7506019de6c82dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.354+0000 7f623cc5f640 1 -- 172.21.15.39:0/1074666533 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6234037070 con 0x7f623807de20 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.354+0000 7f623cc5f640 1 -- 172.21.15.39:0/1074666533 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6234032900 con 0x7f623807de20 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.354+0000 7f623cc5f640 1 -- 172.21.15.39:0/1074666533 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6234030850 con 0x7f623807de20 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 -- 172.21.15.39:0/1074666533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 msgr2=0x7f623807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.190 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 --2- 172.21.15.39:0/1074666533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6234009820 tx=0x7f623402a270 comp rx=0 tx=0).stop 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 -- 172.21.15.39:0/1074666533 shutdown_connections 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 --2- 172.21.15.39:0/1074666533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623807c2d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 -- 172.21.15.39:0/1074666533 >> 172.21.15.39:0/1074666533 conn(0x7f6238102dc0 msgr2=0x7f62381051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 -- 172.21.15.39:0/1074666533 shutdown_connections 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 -- 172.21.15.39:0/1074666533 wait complete. 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.355+0000 7f623fec5640 1 Processor -- start 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623fec5640 1 -- start start 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623fec5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623fec5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f623810dbe0 con 0x7f623807de20 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623dc61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623dc61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42640/0 (socket says 172.21.15.39:42640) 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623dc61640 1 -- 172.21.15.39:0/2499840597 learned_addr learned my addr 172.21.15.39:0/2499840597 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623dc61640 1 -- 172.21.15.39:0/2499840597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623819dfc0 con 0x7f623807de20 2024-09-12T01:47:31.191 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623dc61640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6234032ce0 tx=0x7f6234032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6234042070 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62340308c0 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.356+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623819e250 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.357+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6234037040 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.357+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62381a0f40 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.357+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f6234045070 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.357+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623807c350 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.358+0000 7f622effd640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 0x7f622403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.358+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f623406bd70 con 0x7f623807de20 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.358+0000 7f623d460640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 0x7f622403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.358+0000 7f623d460640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 0x7f622403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62280098c0 tx=0x7f6228006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.363+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f623404b170 con 0x7f623807de20 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.463+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f623403c780 con 0x7f623807de20 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.605+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f623802d7c0 con 0x7f623807de20 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.605+0000 7f622effd640 1 -- 172.21.15.39:0/2499840597 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f6234042210 con 0x7f623807de20 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 msgr2=0x7f622403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 0x7f622403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62280098c0 tx=0x7f6228006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 msgr2=0x7f623819da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6234032ce0 tx=0x7f6234032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 shutdown_connections 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f6224038e60 0x7f622403b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 --2- 172.21.15.39:0/2499840597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f623807de20 0x7f623819da80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 >> 172.21.15.39:0/2499840597 conn(0x7f6238102dc0 msgr2=0x7f6238103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 shutdown_connections 2024-09-12T01:47:31.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:30.607+0000 7f623fec5640 1 -- 172.21.15.39:0/2499840597 wait complete. 2024-09-12T01:47:31.194 INFO:teuthology.orchestra.run.smithi039.stdout:mgr is available 2024-09-12T01:47:31.724 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:31 smithi039 ceph-mon[31204]: mgrmap e4: x(active, since 2s) 2024-09-12T01:47:31.724 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:31 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2499840597' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:47:32.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce65e45640 1 Processor -- start 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce65e45640 1 -- start start 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce65e45640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce65e45640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fce6010a700 con 0x7fce6007bca0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42648/0 (socket says 172.21.15.39:42648) 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce5f7fe640 1 -- 172.21.15.39:0/1679070376 learned_addr learned my addr 172.21.15.39:0/1679070376 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.536+0000 7fce5f7fe640 1 -- 172.21.15.39:0/1679070376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6010a880 con 0x7fce6007bca0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.537+0000 7fce5f7fe640 1 --2- 172.21.15.39:0/1679070376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce50009820 tx=0x7fce5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344709fa76a4cad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.537+0000 7fce5e7fc640 1 -- 172.21.15.39:0/1679070376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50037070 con 0x7fce6007bca0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.537+0000 7fce5e7fc640 1 -- 172.21.15.39:0/1679070376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce50032900 con 0x7fce6007bca0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.537+0000 7fce5e7fc640 1 -- 172.21.15.39:0/1679070376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50030850 con 0x7fce6007bca0 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 -- 172.21.15.39:0/1679070376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 msgr2=0x7fce6010a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 --2- 172.21.15.39:0/1679070376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fce50009820 tx=0x7fce5002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 -- 172.21.15.39:0/1679070376 shutdown_connections 2024-09-12T01:47:32.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 --2- 172.21.15.39:0/1679070376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6007bca0 0x7fce6010a130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 -- 172.21.15.39:0/1679070376 >> 172.21.15.39:0/1679070376 conn(0x7fce60101cc0 msgr2=0x7fce601040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 -- 172.21.15.39:0/1679070376 shutdown_connections 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.538+0000 7fce65e45640 1 -- 172.21.15.39:0/1679070376 wait complete. 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce65e45640 1 Processor -- start 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce65e45640 1 -- start start 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce65e45640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce65e45640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fce6010b980 con 0x7fce6019b890 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42664/0 (socket says 172.21.15.39:42664) 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce5f7fe640 1 -- 172.21.15.39:0/4009654941 learned_addr learned my addr 172.21.15.39:0/4009654941 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.539+0000 7fce5f7fe640 1 -- 172.21.15.39:0/4009654941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6019c1f0 con 0x7fce6019b890 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce5f7fe640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fce50032ce0 tx=0x7fce50032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50042070 con 0x7fce6019b890 2024-09-12T01:47:32.349 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce500308c0 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6019c480 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce50037040 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6019ef10 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.540+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fce50045070 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.541+0000 7fce5cff9640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 0x7fce4803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.541+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce5006bf70 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.541+0000 7fce5effd640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 0x7fce4803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.541+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce601081a0 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.541+0000 7fce5effd640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 0x7fce4803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce540098c0 tx=0x7fce54006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.546+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce50045360 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.724+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fce6007bca0 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.725+0000 7fce5cff9640 1 -- 172.21.15.39:0/4009654941 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fce5006b990 con 0x7fce6019b890 2024-09-12T01:47:32.350 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 msgr2=0x7fce4803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 0x7fce4803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce540098c0 tx=0x7fce54006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 msgr2=0x7fce6019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fce50032ce0 tx=0x7fce50032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 shutdown_connections 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.727+0000 7fce65e45640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fce48038f70 0x7fce4803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.728+0000 7fce65e45640 1 --2- 172.21.15.39:0/4009654941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce6019b890 0x7fce6019bcb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.728+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 >> 172.21.15.39:0/4009654941 conn(0x7fce60101cc0 msgr2=0x7fce60102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.728+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 shutdown_connections 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:31.728+0000 7fce65e45640 1 -- 172.21.15.39:0/4009654941 wait complete. 2024-09-12T01:47:32.351 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling cephadm module... 2024-09-12T01:47:32.572 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:32 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4009654941' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:47:33.693 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setuser ceph since I am not root 2024-09-12T01:47:33.693 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setgroup ceph since I am not root 2024-09-12T01:47:33.693 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:33.632+0000 7f2d81387040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:47:33.693 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:33.692+0000 7f2d81387040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:47:33.693 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1715172149' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:47:33.943 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:33.852+0000 7f2d81387040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:47:33.943 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:33.924+0000 7f2d81387040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:47:34.093 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.763+0000 7f82b5b03640 1 Processor -- start 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82b5b03640 1 -- start start 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82b5b03640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82b5b03640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f82b0106de0 con 0x7f82b0106410 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35120/0 (socket says 172.21.15.39:35120) 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82af7fe640 1 -- 172.21.15.39:0/902048255 learned_addr learned my addr 172.21.15.39:0/902048255 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.764+0000 7f82af7fe640 1 -- 172.21.15.39:0/902048255 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b0107610 con 0x7f82b0106410 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.765+0000 7f82af7fe640 1 --2- 172.21.15.39:0/902048255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009820 tx=0x7f82a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d982cabc4d907f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.765+0000 7f82aeffd640 1 -- 172.21.15.39:0/902048255 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82a0037070 con 0x7f82b0106410 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.765+0000 7f82aeffd640 1 -- 172.21.15.39:0/902048255 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82a0032900 con 0x7f82b0106410 2024-09-12T01:47:34.094 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.765+0000 7f82aeffd640 1 -- 172.21.15.39:0/902048255 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82a0030850 con 0x7f82b0106410 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 -- 172.21.15.39:0/902048255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 msgr2=0x7f82b0106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 --2- 172.21.15.39:0/902048255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009820 tx=0x7f82a002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 -- 172.21.15.39:0/902048255 shutdown_connections 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 --2- 172.21.15.39:0/902048255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0106810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 -- 172.21.15.39:0/902048255 >> 172.21.15.39:0/902048255 conn(0x7f82b0101b80 msgr2=0x7f82b0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 -- 172.21.15.39:0/902048255 shutdown_connections 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.766+0000 7f82b5b03640 1 -- 172.21.15.39:0/902048255 wait complete. 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82b5b03640 1 Processor -- start 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82b5b03640 1 -- start start 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82b5b03640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82b5b03640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f82b010a9c0 con 0x7f82b0106410 2024-09-12T01:47:34.095 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82af7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35126/0 (socket says 172.21.15.39:35126) 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82af7fe640 1 -- 172.21.15.39:0/1715172149 learned_addr learned my addr 172.21.15.39:0/1715172149 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.767+0000 7f82af7fe640 1 -- 172.21.15.39:0/1715172149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b0191b80 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82af7fe640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009940 tx=0x7f82a0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82a0042070 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82a00308c0 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b018fd70 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82a0037040 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.768+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b01902b0 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.769+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f82a0045070 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.769+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b010ab40 con 0x7f82b0106410 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.769+0000 7f82ad7fa640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 0x7f829c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:34.096 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.769+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f82a006c010 con 0x7f82b0106410 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.769+0000 7f82a7fff640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 0x7f829c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.770+0000 7f82a7fff640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 0x7f829c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82980098c0 tx=0x7f8298006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:32.774+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82a0045360 con 0x7f82b0106410 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.000+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f82b0075df0 con 0x7f82b0106410 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.471+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f82b0075df0 con 0x7f82b0106410 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.473+0000 7f82ad7fa640 1 -- 172.21.15.39:0/1715172149 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f82a003c760 con 0x7f82b0106410 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 msgr2=0x7f829c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 0x7f829c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82980098c0 tx=0x7f8298006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 msgr2=0x7f82b0191640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009940 tx=0x7f82a0032ce0 comp rx=0 tx=0).stop 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 shutdown_connections 2024-09-12T01:47:34.097 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f829c038f70 0x7f829c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:34.098 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 --2- 172.21.15.39:0/1715172149 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f82b0106410 0x7f82b0191640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:34.098 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 >> 172.21.15.39:0/1715172149 conn(0x7f82b0101b80 msgr2=0x7f82b0102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:34.098 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 shutdown_connections 2024-09-12T01:47:34.098 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:33.474+0000 7f82b5b03640 1 -- 172.21.15.39:0/1715172149 wait complete. 2024-09-12T01:47:34.214 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:34.082+0000 7f2d81387040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:47:34.474 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:34.235+0000 7f2d81387040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:47:34.728 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1715172149' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:47:34.728 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-mon[31204]: mgrmap e5: x(active, since 5s) 2024-09-12T01:47:34.728 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:34.573+0000 7f2d81387040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:47:34.728 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:34.637+0000 7f2d81387040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:47:35.091 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:34.839+0000 7f2d81387040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:47:35.355 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:47:35.355 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:47:35.355 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:47:35.356 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:47:35.356 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:47:35.356 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:47:35.356 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.521+0000 7f738a0b4640 1 Processor -- start 2024-09-12T01:47:35.356 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.521+0000 7f738a0b4640 1 -- start start 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f738a0b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f738a0b4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f738407bdc0 con 0x7f7384105e10 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f73837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f73837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35158/0 (socket says 172.21.15.39:35158) 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f73837fe640 1 -- 172.21.15.39:0/967929427 learned_addr learned my addr 172.21.15.39:0/967929427 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:35.357 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.522+0000 7f73837fe640 1 -- 172.21.15.39:0/967929427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7384106750 con 0x7f7384105e10 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.523+0000 7f73837fe640 1 --2- 172.21.15.39:0/967929427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7374009820 tx=0x7f737402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8584c8e58b31d757 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.523+0000 7f73827fc640 1 -- 172.21.15.39:0/967929427 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7374037070 con 0x7f7384105e10 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.523+0000 7f73827fc640 1 -- 172.21.15.39:0/967929427 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7374032900 con 0x7f7384105e10 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.523+0000 7f73827fc640 1 -- 172.21.15.39:0/967929427 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7374030850 con 0x7f7384105e10 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 -- 172.21.15.39:0/967929427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 msgr2=0x7f7384106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:35.358 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 --2- 172.21.15.39:0/967929427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7374009820 tx=0x7f737402a270 comp rx=0 tx=0).stop 2024-09-12T01:47:35.359 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 -- 172.21.15.39:0/967929427 shutdown_connections 2024-09-12T01:47:35.359 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 --2- 172.21.15.39:0/967929427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f7384106210 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:35.359 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 -- 172.21.15.39:0/967929427 >> 172.21.15.39:0/967929427 conn(0x7f7384101b80 msgr2=0x7f7384103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:35.360 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 -- 172.21.15.39:0/967929427 shutdown_connections 2024-09-12T01:47:35.360 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 -- 172.21.15.39:0/967929427 wait complete. 2024-09-12T01:47:35.360 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.524+0000 7f738a0b4640 1 Processor -- start 2024-09-12T01:47:35.360 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f738a0b4640 1 -- start start 2024-09-12T01:47:35.360 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f738a0b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:35.361 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f738a0b4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7384107850 con 0x7f7384105e10 2024-09-12T01:47:35.361 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f73837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:35.361 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f73837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35172/0 (socket says 172.21.15.39:35172) 2024-09-12T01:47:35.361 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f73837fe640 1 -- 172.21.15.39:0/3806119035 learned_addr learned my addr 172.21.15.39:0/3806119035 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:35.361 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f73837fe640 1 -- 172.21.15.39:0/3806119035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738419df60 con 0x7f7384105e10 2024-09-12T01:47:35.362 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.525+0000 7f73837fe640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73740097f0 tx=0x7f7374030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:35.362 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.526+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7374037040 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.526+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7374040070 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.526+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738419e1f0 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.526+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f737403a390 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.526+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73841a0ee0 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f737403a630 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7384106210 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f7380ff9640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 0x7f736c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f737406c300 con 0x7f7384105e10 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f7382ffd640 1 -- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 msgr2=0x7f736c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:35.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.527+0000 7f7382ffd640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 0x7f736c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.532+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73740392f0 con 0x7f7384105e10 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.728+0000 7f7382ffd640 1 -- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 msgr2=0x7f736c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.728+0000 7f7382ffd640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 0x7f736c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.773+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f738402d7c0 con 0x7f7384105e10 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.773+0000 7f7380ff9640 1 -- 172.21.15.39:0/3806119035 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f737403b430 con 0x7f7384105e10 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 msgr2=0x7f736c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 0x7f736c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 msgr2=0x7f738419da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73740097f0 tx=0x7f7374030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 shutdown_connections 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7f736c038f70 0x7f736c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:35.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 --2- 172.21.15.39:0/3806119035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7384105e10 0x7f738419da20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:35.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 >> 172.21.15.39:0/3806119035 conn(0x7f7384101b80 msgr2=0x7f7384194410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:35.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 shutdown_connections 2024-09-12T01:47:35.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:34.776+0000 7f738a0b4640 1 -- 172.21.15.39:0/3806119035 wait complete. 2024-09-12T01:47:35.365 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-12T01:47:35.365 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 5... 2024-09-12T01:47:35.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:35 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3806119035' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:47:35.957 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:35.778+0000 7f2d81387040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:47:35.957 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:35.848+0000 7f2d81387040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:47:36.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:36.593+0000 7f2d81387040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:47:37.081 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:36.714+0000 7f2d81387040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:47:37.082 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:36.862+0000 7f2d81387040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:47:37.082 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:36.926+0000 7f2d81387040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:47:37.082 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.081+0000 7f2d81387040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:47:37.380 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.152+0000 7f2d81387040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:47:37.380 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.215+0000 7f2d81387040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:47:37.380 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.380+0000 7f2d81387040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:47:37.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.447+0000 7f2d81387040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:47:37.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.517+0000 7f2d81387040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:47:37.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.603+0000 7f2d81387040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:47:38.160 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.665+0000 7f2d81387040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:47:38.160 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:37.726+0000 7f2d81387040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:47:38.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:38.552+0000 7f2d81387040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:47:38.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: Active manager daemon x restarted 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: Activating manager daemon x 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: mgrmap e6: x(active, starting, since 0.0051282s) 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: Manager daemon x is now available 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:38.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:47:38.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:38 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:47:40.192 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.750+0000 7fb2de54c640 1 Processor -- start 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.750+0000 7fb2de54c640 1 -- start start 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.750+0000 7fb2de54c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.751+0000 7fb2de54c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d807be60 con 0x7fb2d8107fb0 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.751+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.751+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35188/0 (socket says 172.21.15.39:35188) 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.751+0000 7fb2d7fff640 1 -- 172.21.15.39:0/3285423523 learned_addr learned my addr 172.21.15.39:0/3285423523 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.751+0000 7fb2d7fff640 1 -- 172.21.15.39:0/3285423523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d810a8e0 con 0x7fb2d8107fb0 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.752+0000 7fb2d7fff640 1 --2- 172.21.15.39:0/3285423523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009820 tx=0x7fb2c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a7f932bf14323f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:40.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.752+0000 7fb2d77fe640 1 -- 172.21.15.39:0/3285423523 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8037070 con 0x7fb2d8107fb0 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.752+0000 7fb2d77fe640 1 -- 172.21.15.39:0/3285423523 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2c8032900 con 0x7fb2d8107fb0 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.752+0000 7fb2d77fe640 1 -- 172.21.15.39:0/3285423523 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8030850 con 0x7fb2d8107fb0 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 -- 172.21.15.39:0/3285423523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 msgr2=0x7fb2d810a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 --2- 172.21.15.39:0/3285423523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009820 tx=0x7fb2c802a270 comp rx=0 tx=0).stop 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 -- 172.21.15.39:0/3285423523 shutdown_connections 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 --2- 172.21.15.39:0/3285423523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d810a3a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 -- 172.21.15.39:0/3285423523 >> 172.21.15.39:0/3285423523 conn(0x7fb2d8101b90 msgr2=0x7fb2d8104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 -- 172.21.15.39:0/3285423523 shutdown_connections 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.753+0000 7fb2de54c640 1 -- 172.21.15.39:0/3285423523 wait complete. 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2de54c640 1 Processor -- start 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2de54c640 1 -- start start 2024-09-12T01:47:40.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2de54c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2de54c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d810b980 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35194/0 (socket says 172.21.15.39:35194) 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d7fff640 1 -- 172.21.15.39:0/284209836 learned_addr learned my addr 172.21.15.39:0/284209836 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d7fff640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d819bd70 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d7fff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80097f0 tx=0x7fb2c8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.754+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c8037040 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.755+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2c8040070 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.755+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d819c000 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.755+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2c803a390 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.755+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d819ecf0 con 0x7fb2d8107fb0 2024-09-12T01:47:40.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.755+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb2c803a5e0 con 0x7fb2d8107fb0 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.756+0000 7fb2d5ffb640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.756+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb2d819c480 con 0x7fb2c4038fc0 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.756+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb2c806d1c0 con 0x7fb2d8107fb0 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.756+0000 7fb2cffff640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 msgr2=0x7fb2c403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.756+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.957+0000 7fb2cffff640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 msgr2=0x7fb2c403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:35.957+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:36.358+0000 7fb2cffff640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 msgr2=0x7fb2c403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:36.358+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:37.159+0000 7fb2cffff640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 msgr2=0x7fb2c403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3476444139 2024-09-12T01:47:40.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:37.159+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:38.558+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fb2c802fd60 con 0x7fb2d8107fb0 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:38.558+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 msgr2=0x7fb2c403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:38.558+0000 7fb2d5ffb640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.559+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb2c803a8d0 con 0x7fb2d8107fb0 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.559+0000 7fb2d5ffb640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 0x7fb2c403eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.559+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb2c803de70 con 0x7fb2c403c700 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.559+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 0x7fb2c403eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.560+0000 7fb2cffff640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 0x7fb2c403eaf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0003980 tx=0x7fb2c00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.561+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb2c803de70 con 0x7fb2c403c700 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb2d8108410 con 0x7fb2c403c700 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2d5ffb640 1 -- 172.21.15.39:0/284209836 <== mgr.14118 v2:172.21.15.39:6800/4201782244 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fb2d8108410 con 0x7fb2c403c700 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 msgr2=0x7fb2c403eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:40.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 0x7fb2c403eaf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0003980 tx=0x7fb2c00092b0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 msgr2=0x7fb2d819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80097f0 tx=0x7fb2c8030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 shutdown_connections 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/3476444139,v1:172.21.15.39:6801/3476444139] conn(0x7fb2c4038fc0 0x7fb2c403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fb2c403c700 0x7fb2c403eaf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 --2- 172.21.15.39:0/284209836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2d8107fb0 0x7fb2d819b830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 >> 172.21.15.39:0/284209836 conn(0x7fb2d8101b90 msgr2=0x7fb2d8102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 shutdown_connections 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:39.568+0000 7fb2de54c640 1 -- 172.21.15.39:0/284209836 wait complete. 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 5 is available 2024-09-12T01:47:40.198 INFO:teuthology.orchestra.run.smithi039.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:47:40.433 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-mon[31204]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:47:40.433 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:40.433 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-mon[31204]: mgrmap e7: x(active, since 1.00733s) 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:40.367+0000 7f2ce86e1640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:47:40] ENGINE Error in HTTPServer.serve 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: Traceback (most recent call last): 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._connections.run(self.expiration_interval) 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._run(expiration_interval) 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:47:40.434 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: s = self.context.wrap_socket( 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: return self.sslsocket_class._create( 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self.do_handshake() 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._sslobj.do_handshake() 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:47:40.435 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: [12/Sep/2024:01:47:40] ENGINE Bus STARTING 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: [12/Sep/2024:01:47:40] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: [12/Sep/2024:01:47:40] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: [12/Sep/2024:01:47:40] ENGINE Bus STARTED 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:41.372 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: [12/Sep/2024:01:47:40] ENGINE Error in HTTPServer.serve 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:47:41.373 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:41.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:41 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:41.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f19a5ae4640 1 Processor -- start 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f19a5ae4640 1 -- start start 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f19a5ae4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f19a5ae4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19a007c860 con 0x7f19a007de30 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35266/0 (socket says 172.21.15.39:35266) 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f199f7fe640 1 -- 172.21.15.39:0/1315159393 learned_addr learned my addr 172.21.15.39:0/1315159393 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.616+0000 7f199f7fe640 1 -- 172.21.15.39:0/1315159393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a007c9e0 con 0x7f19a007de30 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.617+0000 7f199f7fe640 1 --2- 172.21.15.39:0/1315159393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1990009820 tx=0x7f199002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef32599568692d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.617+0000 7f199e7fc640 1 -- 172.21.15.39:0/1315159393 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990037070 con 0x7f19a007de30 2024-09-12T01:47:41.381 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.617+0000 7f199e7fc640 1 -- 172.21.15.39:0/1315159393 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1990032900 con 0x7f19a007de30 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.617+0000 7f199e7fc640 1 -- 172.21.15.39:0/1315159393 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990030850 con 0x7f19a007de30 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1315159393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 msgr2=0x7f19a007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1315159393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1990009820 tx=0x7f199002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1315159393 shutdown_connections 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1315159393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a007c290 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1315159393 >> 172.21.15.39:0/1315159393 conn(0x7f19a0102ca0 msgr2=0x7f19a0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1315159393 shutdown_connections 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1315159393 wait complete. 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 Processor -- start 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.618+0000 7f19a5ae4640 1 -- start start 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f19a5ae4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f19a5ae4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19a010db60 con 0x7f19a007de30 2024-09-12T01:47:41.382 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35282/0 (socket says 172.21.15.39:35282) 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199f7fe640 1 -- 172.21.15.39:0/1184357622 learned_addr learned my addr 172.21.15.39:0/1184357622 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199f7fe640 1 -- 172.21.15.39:0/1184357622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a019df20 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199f7fe640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19900097f0 tx=0x7f1990030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990037040 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1990040070 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a019e1b0 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199003a390 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.619+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a01a0ea0 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.620+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f199003a5e0 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.620+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a007c310 con 0x7f19a007de30 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.620+0000 7f199cff9640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 0x7f198803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:41.383 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.620+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f199006c3e0 con 0x7f19a007de30 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.621+0000 7f199effd640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 0x7f198803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.621+0000 7f199effd640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 0x7f198803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19940098c0 tx=0x7f1994006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.625+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1990043360 con 0x7f19a007de30 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.814+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f19a002d830 con 0x7f1988038eb0 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.820+0000 7f199cff9640 1 -- 172.21.15.39:0/1184357622 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f19a002d830 con 0x7f1988038eb0 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 msgr2=0x7f198803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 0x7f198803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19940098c0 tx=0x7f1994006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 msgr2=0x7f19a019d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f19900097f0 tx=0x7f1990030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 shutdown_connections 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f1988038eb0 0x7f198803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 --2- 172.21.15.39:0/1184357622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19a007de30 0x7f19a019d9e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:41.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 >> 172.21.15.39:0/1184357622 conn(0x7f19a0102ca0 msgr2=0x7f19a01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:41.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 shutdown_connections 2024-09-12T01:47:41.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:40.823+0000 7f19a5ae4640 1 -- 172.21.15.39:0/1184357622 wait complete. 2024-09-12T01:47:42.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:42 smithi039 ceph-mon[31204]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:42.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:42 smithi039 ceph-mon[31204]: mgrmap e8: x(active, since 2s) 2024-09-12T01:47:42.836 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.033+0000 7faa885ad640 1 Processor -- start 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.033+0000 7faa885ad640 1 -- start start 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa885ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa885ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faa8007be60 con 0x7faa80107fb0 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa86349640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa86349640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35298/0 (socket says 172.21.15.39:35298) 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa86349640 1 -- 172.21.15.39:0/4078945423 learned_addr learned my addr 172.21.15.39:0/4078945423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.034+0000 7faa86349640 1 -- 172.21.15.39:0/4078945423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8010a8e0 con 0x7faa80107fb0 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.035+0000 7faa86349640 1 --2- 172.21.15.39:0/4078945423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa74009820 tx=0x7faa7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31602fc87e7ddf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.035+0000 7faa85347640 1 -- 172.21.15.39:0/4078945423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74037070 con 0x7faa80107fb0 2024-09-12T01:47:42.837 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.035+0000 7faa85347640 1 -- 172.21.15.39:0/4078945423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa74032900 con 0x7faa80107fb0 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.035+0000 7faa85347640 1 -- 172.21.15.39:0/4078945423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74030850 con 0x7faa80107fb0 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 -- 172.21.15.39:0/4078945423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 msgr2=0x7faa8010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 --2- 172.21.15.39:0/4078945423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa74009820 tx=0x7faa7402a270 comp rx=0 tx=0).stop 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 -- 172.21.15.39:0/4078945423 shutdown_connections 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 --2- 172.21.15.39:0/4078945423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa8010a3a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 -- 172.21.15.39:0/4078945423 >> 172.21.15.39:0/4078945423 conn(0x7faa80101b90 msgr2=0x7faa80104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 -- 172.21.15.39:0/4078945423 shutdown_connections 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.036+0000 7faa885ad640 1 -- 172.21.15.39:0/4078945423 wait complete. 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa885ad640 1 Processor -- start 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa885ad640 1 -- start start 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa885ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa885ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faa8010b980 con 0x7faa80107fb0 2024-09-12T01:47:42.838 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa86349640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa86349640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35312/0 (socket says 172.21.15.39:35312) 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa86349640 1 -- 172.21.15.39:0/2801573048 learned_addr learned my addr 172.21.15.39:0/2801573048 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.037+0000 7faa86349640 1 -- 172.21.15.39:0/2801573048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80107d70 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa86349640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa74032ce0 tx=0x7faa74032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74042070 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa740308c0 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa74037040 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa80105f60 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.038+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa801064a0 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.039+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faa74045070 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.039+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa80108410 con 0x7faa80107fb0 2024-09-12T01:47:42.839 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.039+0000 7faa737fe640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 0x7faa6c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.039+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faa7406bfd0 con 0x7faa80107fb0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.039+0000 7faa85b48640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 0x7faa6c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.040+0000 7faa85b48640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 0x7faa6c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0098c0 tx=0x7faa7c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.044+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa7404b170 con 0x7faa80107fb0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.221+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7faa80195080 con 0x7faa6c038fc0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.221+0000 7faa737fe640 1 -- 172.21.15.39:0/2801573048 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7faa80195080 con 0x7faa6c038fc0 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.223+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 msgr2=0x7faa6c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.223+0000 7faa885ad640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 0x7faa6c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0098c0 tx=0x7faa7c006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.223+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 msgr2=0x7faa80107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.223+0000 7faa885ad640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa74032ce0 tx=0x7faa74032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 shutdown_connections 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7faa6c038fc0 0x7faa6c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:42.840 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 --2- 172.21.15.39:0/2801573048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa80107fb0 0x7faa80107830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:42.841 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 >> 172.21.15.39:0/2801573048 conn(0x7faa80101b90 msgr2=0x7faa80102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:42.841 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 shutdown_connections 2024-09-12T01:47:42.841 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:42.224+0000 7faa885ad640 1 -- 172.21.15.39:0/2801573048 wait complete. 2024-09-12T01:47:42.841 INFO:teuthology.orchestra.run.smithi039.stdout:Generating ssh key... 2024-09-12T01:47:43.470 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-mon[31204]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:43.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: Generating public/private rsa key pair. 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: Your identification has been saved in /tmp/tmp227dao0s/key 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: Your public key has been saved in /tmp/tmp227dao0s/key.pub 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: The key fingerprint is: 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: SHA256:W3CHnW8O4DhXuTa24daUfwRdV7j7m8E816NEDHwh8VA ceph-d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: The key's randomart image is: 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: +---[RSA 3072]----+ 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | +oE .=| 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | .o+oo.o| 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | . +o*o...| 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | = ++o.o | 2024-09-12T01:47:43.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | S + Bo=..| 2024-09-12T01:47:43.912 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | = +.X+o.| 2024-09-12T01:47:43.912 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | . +.oB=| 2024-09-12T01:47:43.912 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | .. . O| 2024-09-12T01:47:43.912 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: | . o.| 2024-09-12T01:47:43.912 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: +----[SHA256]-----+ 2024-09-12T01:47:44.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.283+0000 7f86ac2e8640 1 Processor -- start 2024-09-12T01:47:44.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.283+0000 7f86ac2e8640 1 -- start start 2024-09-12T01:47:44.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86ac2e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:44.193 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86ac2e8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86a407c7f0 con 0x7f86a407de00 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86aa084640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86aa084640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36428/0 (socket says 172.21.15.39:36428) 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86aa084640 1 -- 172.21.15.39:0/1732029582 learned_addr learned my addr 172.21.15.39:0/1732029582 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.284+0000 7f86aa084640 1 -- 172.21.15.39:0/1732029582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a407c970 con 0x7f86a407de00 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.285+0000 7f86aa084640 1 --2- 172.21.15.39:0/1732029582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009820 tx=0x7f86a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43649b2376794e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.285+0000 7f86a9082640 1 -- 172.21.15.39:0/1732029582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86a0037070 con 0x7f86a407de00 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.285+0000 7f86a9082640 1 -- 172.21.15.39:0/1732029582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86a0032900 con 0x7f86a407de00 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.285+0000 7f86a9082640 1 -- 172.21.15.39:0/1732029582 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86a00308e0 con 0x7f86a407de00 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 -- 172.21.15.39:0/1732029582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 msgr2=0x7f86a407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/1732029582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009820 tx=0x7f86a002a300 comp rx=0 tx=0).stop 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 -- 172.21.15.39:0/1732029582 shutdown_connections 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/1732029582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a407c2b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:44.194 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 -- 172.21.15.39:0/1732029582 >> 172.21.15.39:0/1732029582 conn(0x7f86a4102dc0 msgr2=0x7f86a41051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 -- 172.21.15.39:0/1732029582 shutdown_connections 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.286+0000 7f86ac2e8640 1 -- 172.21.15.39:0/1732029582 wait complete. 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86ac2e8640 1 Processor -- start 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86ac2e8640 1 -- start start 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86ac2e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86ac2e8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86a410dc00 con 0x7f86a407de00 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86aa084640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86aa084640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36430/0 (socket says 172.21.15.39:36430) 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86aa084640 1 -- 172.21.15.39:0/3822444046 learned_addr learned my addr 172.21.15.39:0/3822444046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.287+0000 7f86aa084640 1 -- 172.21.15.39:0/3822444046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a419dfc0 con 0x7f86a407de00 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f86aa084640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f86a0030610 tx=0x7f86a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86a0037040 con 0x7f86a407de00 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86a0040070 con 0x7f86a407de00 2024-09-12T01:47:44.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a419e250 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86a003a390 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.288+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a41a0f40 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.289+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f86a003b650 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.289+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a407c330 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.289+0000 7f869b7fe640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 0x7f869003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.289+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f86a006c200 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.289+0000 7f86a9883640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 0x7f869003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.290+0000 7f86a9883640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 0x7f869003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f86940098c0 tx=0x7f8694006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.294+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86a00329b0 con 0x7f86a407de00 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.470+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f86a4062630 con 0x7f8690038fc0 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.609+0000 7f869b7fe640 1 -- 172.21.15.39:0/3822444046 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86a4062630 con 0x7f8690038fc0 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 msgr2=0x7f869003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:44.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 0x7f869003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f86940098c0 tx=0x7f8694006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 msgr2=0x7f86a419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f86a0030610 tx=0x7f86a0032670 comp rx=0 tx=0).stop 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 shutdown_connections 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f8690038fc0 0x7f869003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 --2- 172.21.15.39:0/3822444046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86a407de00 0x7f86a419da80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 >> 172.21.15.39:0/3822444046 conn(0x7f86a4102dc0 msgr2=0x7f86a4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 shutdown_connections 2024-09-12T01:47:44.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:43.611+0000 7f86ac2e8640 1 -- 172.21.15.39:0/3822444046 wait complete. 2024-09-12T01:47:44.530 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:44 smithi039 ceph-mon[31204]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:44.530 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:44 smithi039 ceph-mon[31204]: Generating ssh key... 2024-09-12T01:47:44.530 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:44 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:44.530 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:44 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:47:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7faba047e640 1 Processor -- start 2024-09-12T01:47:45.343 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7faba047e640 1 -- start start 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7faba047e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7faba047e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab98107f50 con 0x7fab98107580 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7fab9e21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7fab9e21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36446/0 (socket says 172.21.15.39:36446) 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.616+0000 7fab9e21a640 1 -- 172.21.15.39:0/2082464191 learned_addr learned my addr 172.21.15.39:0/2082464191 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.617+0000 7fab9e21a640 1 -- 172.21.15.39:0/2082464191 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab98108780 con 0x7fab98107580 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.617+0000 7fab9e21a640 1 --2- 172.21.15.39:0/2082464191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab94009820 tx=0x7fab9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654ca611814eb41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.617+0000 7fab9d218640 1 -- 172.21.15.39:0/2082464191 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab94037070 con 0x7fab98107580 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.617+0000 7fab9d218640 1 -- 172.21.15.39:0/2082464191 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab94032900 con 0x7fab98107580 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.617+0000 7fab9d218640 1 -- 172.21.15.39:0/2082464191 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab94030850 con 0x7fab98107580 2024-09-12T01:47:45.344 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 -- 172.21.15.39:0/2082464191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 msgr2=0x7fab98107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 --2- 172.21.15.39:0/2082464191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab94009820 tx=0x7fab9402a270 comp rx=0 tx=0).stop 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 -- 172.21.15.39:0/2082464191 shutdown_connections 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 --2- 172.21.15.39:0/2082464191 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab98107980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 -- 172.21.15.39:0/2082464191 >> 172.21.15.39:0/2082464191 conn(0x7fab98102d90 msgr2=0x7fab981051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 -- 172.21.15.39:0/2082464191 shutdown_connections 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.618+0000 7faba047e640 1 -- 172.21.15.39:0/2082464191 wait complete. 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7faba047e640 1 Processor -- start 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7faba047e640 1 -- start start 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7faba047e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7faba047e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab9810bb30 con 0x7fab98107580 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7fab9e21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:45.345 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7fab9e21a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36450/0 (socket says 172.21.15.39:36450) 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7fab9e21a640 1 -- 172.21.15.39:0/1478576147 learned_addr learned my addr 172.21.15.39:0/1478576147 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7fab9e21a640 1 -- 172.21.15.39:0/1478576147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9819bd90 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.619+0000 7fab9e21a640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab940097f0 tx=0x7fab94030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.620+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab94037040 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.620+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab94040070 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.620+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9819c020 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.620+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9403a390 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.620+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9819ed10 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.621+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fab9403b430 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.621+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab98107a00 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.621+0000 7fab8f7fe640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 0x7fab8403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.621+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fab9406c420 con 0x7fab98107580 2024-09-12T01:47:45.346 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.621+0000 7fab9da19640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 0x7fab8403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.622+0000 7fab9da19640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 0x7fab8403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab880098c0 tx=0x7fab88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.626+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab94032900 con 0x7fab98107580 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.805+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fab9802d830 con 0x7fab84038fc0 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.806+0000 7fab8f7fe640 1 -- 172.21.15.39:0/1478576147 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fab9802d830 con 0x7fab84038fc0 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 msgr2=0x7fab8403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 0x7fab8403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab880098c0 tx=0x7fab88006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 msgr2=0x7fab9819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab940097f0 tx=0x7fab94030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 shutdown_connections 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fab84038fc0 0x7fab8403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 --2- 172.21.15.39:0/1478576147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab98107580 0x7fab9819b850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 >> 172.21.15.39:0/1478576147 conn(0x7fab98102d90 msgr2=0x7fab98103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:45.347 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 shutdown_connections 2024-09-12T01:47:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:44.808+0000 7faba047e640 1 -- 172.21.15.39:0/1478576147 wait complete. 2024-09-12T01:47:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:47:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:47:45.348 INFO:teuthology.orchestra.run.smithi039.stdout:Adding host smithi039... 2024-09-12T01:47:45.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:45 smithi039 ceph-mon[31204]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:46.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:46 smithi039 ceph-mon[31204]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:47.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:47 smithi039 ceph-mon[31204]: Deploying cephadm binary to smithi039 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Added host 'smithi039' with addr '172.21.15.39' 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.769+0000 7f078d79a640 1 Processor -- start 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.769+0000 7f078d79a640 1 -- start start 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.769+0000 7f078d79a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.769+0000 7f078d79a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0788107f70 con 0x7f07881075a0 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.770+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.770+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36452/0 (socket says 172.21.15.39:36452) 2024-09-12T01:47:50.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.770+0000 7f0786ffd640 1 -- 172.21.15.39:0/2286761686 learned_addr learned my addr 172.21.15.39:0/2286761686 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.770+0000 7f0786ffd640 1 -- 172.21.15.39:0/2286761686 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07881087a0 con 0x7f07881075a0 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f0786ffd640 1 --2- 172.21.15.39:0/2286761686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0778009820 tx=0x7f077802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec33bb4cbfd00e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f07867fc640 1 -- 172.21.15.39:0/2286761686 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0778037070 con 0x7f07881075a0 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f07867fc640 1 -- 172.21.15.39:0/2286761686 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0778032900 con 0x7f07881075a0 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f07867fc640 1 -- 172.21.15.39:0/2286761686 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0778030850 con 0x7f07881075a0 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f078d79a640 1 -- 172.21.15.39:0/2286761686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 msgr2=0x7f07881079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.771+0000 7f078d79a640 1 --2- 172.21.15.39:0/2286761686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0778009820 tx=0x7f077802a270 comp rx=0 tx=0).stop 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- 172.21.15.39:0/2286761686 shutdown_connections 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 --2- 172.21.15.39:0/2286761686 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f07881079a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- 172.21.15.39:0/2286761686 >> 172.21.15.39:0/2286761686 conn(0x7f0788102d10 msgr2=0x7f0788105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:50.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- 172.21.15.39:0/2286761686 shutdown_connections 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- 172.21.15.39:0/2286761686 wait complete. 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 Processor -- start 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- start start 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.772+0000 7f078d79a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f078810bb50 con 0x7f07881075a0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0786ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36454/0 (socket says 172.21.15.39:36454) 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0786ffd640 1 -- 172.21.15.39:0/2146743785 learned_addr learned my addr 172.21.15.39:0/2146743785 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0786ffd640 1 -- 172.21.15.39:0/2146743785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078819e090 con 0x7f07881075a0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0786ffd640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07780097f0 tx=0x7f0778030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0778042070 con 0x7f07881075a0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0778032ca0 con 0x7f07881075a0 2024-09-12T01:47:50.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078819e320 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0778037040 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.773+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07881a1010 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.774+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0778045070 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.774+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078810bcd0 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.774+0000 7f0784ff9640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 0x7f077403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.774+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f077806c030 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.774+0000 7f077ffff640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 0x7f077403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.775+0000 7f077ffff640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 0x7f077403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07700098c0 tx=0x7f0770006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.779+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0778045360 con 0x7f07881075a0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:45.957+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}) -- 0x7f0788062630 con 0x7f0774038fc0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.874+0000 7f0784ff9640 1 -- 172.21.15.39:0/2146743785 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0788062630 con 0x7f0774038fc0 2024-09-12T01:47:50.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 msgr2=0x7f077403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 0x7f077403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f07700098c0 tx=0x7f0770006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 msgr2=0x7f078819db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07780097f0 tx=0x7f0778030ec0 comp rx=0 tx=0).stop 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 shutdown_connections 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0774038fc0 0x7f077403b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 --2- 172.21.15.39:0/2146743785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07881075a0 0x7f078819db50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 >> 172.21.15.39:0/2146743785 conn(0x7f0788102d10 msgr2=0x7f0788103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 shutdown_connections 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:49.877+0000 7f078d79a640 1 -- 172.21.15.39:0/2146743785 wait complete. 2024-09-12T01:47:50.481 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mon service... 2024-09-12T01:47:51.127 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:50 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:51.127 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:50 smithi039 ceph-mon[31204]: Added host smithi039 2024-09-12T01:47:51.127 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:50 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:51.903 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.916+0000 7f3f52f7e640 1 Processor -- start 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f52f7e640 1 -- start start 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f52f7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f52f7e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c106de0 con 0x7f3f4c106410 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f50d1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f50d1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36468/0 (socket says 172.21.15.39:36468) 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f50d1a640 1 -- 172.21.15.39:0/3688138130 learned_addr learned my addr 172.21.15.39:0/3688138130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.917+0000 7f3f50d1a640 1 -- 172.21.15.39:0/3688138130 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c107610 con 0x7f3f4c106410 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.918+0000 7f3f50d1a640 1 --2- 172.21.15.39:0/3688138130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009820 tx=0x7f3f4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9bb864be616968 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.918+0000 7f3f4b7fe640 1 -- 172.21.15.39:0/3688138130 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40037070 con 0x7f3f4c106410 2024-09-12T01:47:51.904 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.918+0000 7f3f4b7fe640 1 -- 172.21.15.39:0/3688138130 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f40032900 con 0x7f3f4c106410 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.918+0000 7f3f4b7fe640 1 -- 172.21.15.39:0/3688138130 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40030850 con 0x7f3f4c106410 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- 172.21.15.39:0/3688138130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 msgr2=0x7f3f4c106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/3688138130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009820 tx=0x7f3f4002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- 172.21.15.39:0/3688138130 shutdown_connections 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/3688138130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c106810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- 172.21.15.39:0/3688138130 >> 172.21.15.39:0/3688138130 conn(0x7f3f4c101b80 msgr2=0x7f3f4c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- 172.21.15.39:0/3688138130 shutdown_connections 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- 172.21.15.39:0/3688138130 wait complete. 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 Processor -- start 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.919+0000 7f3f52f7e640 1 -- start start 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f52f7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f52f7e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c10a9c0 con 0x7f3f4c106410 2024-09-12T01:47:51.905 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f50d1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f50d1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36476/0 (socket says 172.21.15.39:36476) 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f50d1a640 1 -- 172.21.15.39:0/4190113142 learned_addr learned my addr 172.21.15.39:0/4190113142 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f50d1a640 1 -- 172.21.15.39:0/4190113142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c19bdb0 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f50d1a640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097f0 tx=0x7f3f40030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40037040 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f40040070 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.920+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c19c040 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.921+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4003a390 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.921+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c19ed30 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.922+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3f4003a5e0 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.922+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c106890 con 0x7f3f4c106410 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.922+0000 7f3f49ffb640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 0x7f3f3c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:51.906 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.922+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3f4006c5a0 con 0x7f3f4c106410 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.922+0000 7f3f4bfff640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 0x7f3f3c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.923+0000 7f3f4bfff640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 0x7f3f3c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098c0 tx=0x7f3f38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:50.927+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f40043360 con 0x7f3f4c106410 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.126+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3f4c02d830 con 0x7f3f3c038fc0 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.132+0000 7f3f49ffb640 1 -- 172.21.15.39:0/4190113142 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3f4c02d830 con 0x7f3f3c038fc0 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.134+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 msgr2=0x7f3f3c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.134+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 0x7f3f3c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098c0 tx=0x7f3f38006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.134+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 msgr2=0x7f3f4c19b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.134+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f400097f0 tx=0x7f3f40030d80 comp rx=0 tx=0).stop 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 shutdown_connections 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f3f3c038fc0 0x7f3f3c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 --2- 172.21.15.39:0/4190113142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f4c106410 0x7f3f4c19b870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:51.907 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 >> 172.21.15.39:0/4190113142 conn(0x7f3f4c101b80 msgr2=0x7f3f4c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:51.908 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 shutdown_connections 2024-09-12T01:47:51.908 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:51.135+0000 7f3f52f7e640 1 -- 172.21.15.39:0/4190113142 wait complete. 2024-09-12T01:47:51.908 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mgr service... 2024-09-12T01:47:52.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:52 smithi039 ceph-mon[31204]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:52.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:52 smithi039 ceph-mon[31204]: Saving service mon spec with placement count:5 2024-09-12T01:47:52.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:52 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908caa2640 1 Processor -- start 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908caa2640 1 -- start start 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908caa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908caa2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f908807c7d0 con 0x7f908807dde0 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38428/0 (socket says 172.21.15.39:38428) 2024-09-12T01:47:53.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908659c640 1 -- 172.21.15.39:0/369417244 learned_addr learned my addr 172.21.15.39:0/369417244 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.344+0000 7f908659c640 1 -- 172.21.15.39:0/369417244 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908807c950 con 0x7f908807dde0 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.345+0000 7f908659c640 1 --2- 172.21.15.39:0/369417244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9078009820 tx=0x7f907802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0ac8930bc18fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.345+0000 7f9085d9b640 1 -- 172.21.15.39:0/369417244 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9078037070 con 0x7f908807dde0 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.345+0000 7f9085d9b640 1 -- 172.21.15.39:0/369417244 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9078032900 con 0x7f908807dde0 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.345+0000 7f9085d9b640 1 -- 172.21.15.39:0/369417244 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9078030850 con 0x7f908807dde0 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 -- 172.21.15.39:0/369417244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 msgr2=0x7f908807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 --2- 172.21.15.39:0/369417244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9078009820 tx=0x7f907802a270 comp rx=0 tx=0).stop 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 -- 172.21.15.39:0/369417244 shutdown_connections 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 --2- 172.21.15.39:0/369417244 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908807c290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:53.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 -- 172.21.15.39:0/369417244 >> 172.21.15.39:0/369417244 conn(0x7f9088102dc0 msgr2=0x7f90881051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 -- 172.21.15.39:0/369417244 shutdown_connections 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.346+0000 7f908caa2640 1 -- 172.21.15.39:0/369417244 wait complete. 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.347+0000 7f908caa2640 1 Processor -- start 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.347+0000 7f908caa2640 1 -- start start 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.347+0000 7f908caa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.347+0000 7f908caa2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f908810dc20 con 0x7f908807dde0 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:53.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38436/0 (socket says 172.21.15.39:38436) 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908659c640 1 -- 172.21.15.39:0/170845042 learned_addr learned my addr 172.21.15.39:0/170845042 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908659c640 1 -- 172.21.15.39:0/170845042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908819dfe0 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908659c640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9078032ce0 tx=0x7f9078032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9078042070 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908819e270 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90780308c0 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9078037040 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.348+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90881a0f60 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.349+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9078045070 con 0x7f908807dde0 2024-09-12T01:47:53.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.349+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908807c310 con 0x7f908807dde0 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.349+0000 7f907ffff640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 0x7f907403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.350+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f907806c270 con 0x7f908807dde0 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.350+0000 7f907dd9b640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 0x7f907403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.350+0000 7f907dd9b640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 0x7f907403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90700098c0 tx=0x7f9070006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.354+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f907803cd00 con 0x7f908807dde0 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.555+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9088062630 con 0x7f9074038f70 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.560+0000 7f907ffff640 1 -- 172.21.15.39:0/170845042 <== mgr.14118 v2:172.21.15.39:6800/4201782244 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9088062630 con 0x7f9074038f70 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 msgr2=0x7f907403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:53.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 0x7f907403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90700098c0 tx=0x7f9070006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 msgr2=0x7f908819daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9078032ce0 tx=0x7f9078032d10 comp rx=0 tx=0).stop 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 shutdown_connections 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f9074038f70 0x7f907403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 --2- 172.21.15.39:0/170845042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908807dde0 0x7f908819daa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 >> 172.21.15.39:0/170845042 conn(0x7f9088102dc0 msgr2=0x7f9088103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 shutdown_connections 2024-09-12T01:47:53.211 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:52.562+0000 7f908caa2640 1 -- 172.21.15.39:0/170845042 wait complete. 2024-09-12T01:47:53.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:53 smithi039 ceph-mon[31204]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:53.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:53 smithi039 ceph-mon[31204]: Saving service mgr spec with placement count:2 2024-09-12T01:47:53.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:53 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:55.263 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:55 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:55.263 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:55 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:55.263 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4115217857' entity='client.admin' 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.475+0000 7f6a68384640 1 Processor -- start 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.475+0000 7f6a68384640 1 -- start start 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.475+0000 7f6a68384640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.476+0000 7f6a68384640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6007bde0 con 0x7f6a60108000 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.476+0000 7f6a66120640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.476+0000 7f6a66120640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38438/0 (socket says 172.21.15.39:38438) 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.476+0000 7f6a66120640 1 -- 172.21.15.39:0/3172171529 learned_addr learned my addr 172.21.15.39:0/3172171529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:55.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.476+0000 7f6a66120640 1 -- 172.21.15.39:0/3172171529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6010a930 con 0x7f6a60108000 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.477+0000 7f6a66120640 1 --2- 172.21.15.39:0/3172171529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009820 tx=0x7f6a5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaa172b9f095572 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.477+0000 7f6a6511e640 1 -- 172.21.15.39:0/3172171529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c037070 con 0x7f6a60108000 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.477+0000 7f6a6511e640 1 -- 172.21.15.39:0/3172171529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c032920 con 0x7f6a60108000 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.477+0000 7f6a6511e640 1 -- 172.21.15.39:0/3172171529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c030810 con 0x7f6a60108000 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- 172.21.15.39:0/3172171529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 msgr2=0x7f6a6010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 --2- 172.21.15.39:0/3172171529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009820 tx=0x7f6a5c02a270 comp rx=0 tx=0).stop 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- 172.21.15.39:0/3172171529 shutdown_connections 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 --2- 172.21.15.39:0/3172171529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6010a3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- 172.21.15.39:0/3172171529 >> 172.21.15.39:0/3172171529 conn(0x7f6a60101b80 msgr2=0x7f6a60103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- 172.21.15.39:0/3172171529 shutdown_connections 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- 172.21.15.39:0/3172171529 wait complete. 2024-09-12T01:47:55.272 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 Processor -- start 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- start start 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.478+0000 7f6a68384640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6010b950 con 0x7f6a60108000 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a66120640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a66120640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38448/0 (socket says 172.21.15.39:38448) 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a66120640 1 -- 172.21.15.39:0/4115217857 learned_addr learned my addr 172.21.15.39:0/4115217857 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a66120640 1 -- 172.21.15.39:0/4115217857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6019bdb0 con 0x7f6a60108000 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a66120640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097f0 tx=0x7f6a5c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c037040 con 0x7f6a60108000 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6019c040 con 0x7f6a60108000 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c030cc0 con 0x7f6a60108000 2024-09-12T01:47:55.273 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c03a6b0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.479+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6019ed30 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.480+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6a5c03b3f0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.480+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60108460 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.480+0000 7f6a577fe640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 0x7f6a4c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.480+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6a5c06c4e0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.481+0000 7f6a6591f640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 0x7f6a4c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.481+0000 7f6a6591f640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 0x7f6a4c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098c0 tx=0x7f6a50006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.485+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a5c0371e0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.667+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f6a6002d7c0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.670+0000 7f6a577fe640 1 -- 172.21.15.39:0/4115217857 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f6a5c03baf0 con 0x7f6a60108000 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 msgr2=0x7f6a4c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:55.274 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 0x7f6a4c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098c0 tx=0x7f6a50006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 msgr2=0x7f6a6019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097f0 tx=0x7f6a5c0327b0 comp rx=0 tx=0).stop 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 shutdown_connections 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f6a4c038f70 0x7f6a4c03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 --2- 172.21.15.39:0/4115217857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a60108000 0x7f6a6019b870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 >> 172.21.15.39:0/4115217857 conn(0x7f6a60101b80 msgr2=0x7f6a60102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 shutdown_connections 2024-09-12T01:47:55.275 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:54.672+0000 7f6a68384640 1 -- 172.21.15.39:0/4115217857 wait complete. 2024-09-12T01:47:57.039 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:56 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/88381879' entity='client.admin' 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.723+0000 7f0692a1c640 1 Processor -- start 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.723+0000 7f0692a1c640 1 -- start start 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.723+0000 7f0692a1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.724+0000 7f0692a1c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f068c07bde0 con 0x7f068c108000 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.724+0000 7f068bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.724+0000 7f068bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38462/0 (socket says 172.21.15.39:38462) 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.724+0000 7f068bfff640 1 -- 172.21.15.39:0/1520536154 learned_addr learned my addr 172.21.15.39:0/1520536154 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.724+0000 7f068bfff640 1 -- 172.21.15.39:0/1520536154 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c10a930 con 0x7f068c108000 2024-09-12T01:47:57.047 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.725+0000 7f068bfff640 1 --2- 172.21.15.39:0/1520536154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f067c009820 tx=0x7f067c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7e2e3c8e245c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.725+0000 7f068affd640 1 -- 172.21.15.39:0/1520536154 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c037070 con 0x7f068c108000 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.725+0000 7f068affd640 1 -- 172.21.15.39:0/1520536154 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f067c032920 con 0x7f068c108000 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.725+0000 7f068affd640 1 -- 172.21.15.39:0/1520536154 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c030810 con 0x7f068c108000 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- 172.21.15.39:0/1520536154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 msgr2=0x7f068c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 --2- 172.21.15.39:0/1520536154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f067c009820 tx=0x7f067c02a270 comp rx=0 tx=0).stop 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- 172.21.15.39:0/1520536154 shutdown_connections 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 --2- 172.21.15.39:0/1520536154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c10a3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- 172.21.15.39:0/1520536154 >> 172.21.15.39:0/1520536154 conn(0x7f068c101b80 msgr2=0x7f068c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- 172.21.15.39:0/1520536154 shutdown_connections 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- 172.21.15.39:0/1520536154 wait complete. 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 Processor -- start 2024-09-12T01:47:57.048 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.726+0000 7f0692a1c640 1 -- start start 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f0692a1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f0692a1c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f068c10b950 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f068bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f068bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38478/0 (socket says 172.21.15.39:38478) 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f068bfff640 1 -- 172.21.15.39:0/88381879 learned_addr learned my addr 172.21.15.39:0/88381879 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f068bfff640 1 -- 172.21.15.39:0/88381879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c107dc0 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f068bfff640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097f0 tx=0x7f067c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c037040 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f067c030cc0 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f067c03a6b0 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c105fb0 con 0x7f068c108000 2024-09-12T01:47:57.049 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.727+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c1064f0 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.728+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f067c03a850 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.728+0000 7f06897fa640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 0x7f067403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.728+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c108460 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.729+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f067c06c5c0 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.729+0000 7f068b7fe640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 0x7f067403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.729+0000 7f068b7fe640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 0x7f067403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.733+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f067c040e70 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.929+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f068c194fe0 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.931+0000 7f06897fa640 1 -- 172.21.15.39:0/88381879 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f067c03b820 con 0x7f068c108000 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.933+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 msgr2=0x7f067403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.933+0000 7f0692a1c640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 0x7f067403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f06800098c0 tx=0x7f0680006db0 comp rx=0 tx=0).stop 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.933+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 msgr2=0x7f068c107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.933+0000 7f0692a1c640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097f0 tx=0x7f067c0327b0 comp rx=0 tx=0).stop 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 shutdown_connections 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f0674038fc0 0x7f067403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 --2- 172.21.15.39:0/88381879 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f068c108000 0x7f068c107880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 >> 172.21.15.39:0/88381879 conn(0x7f068c101b80 msgr2=0x7f068c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 shutdown_connections 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:55.934+0000 7f0692a1c640 1 -- 172.21.15.39:0/88381879 wait complete. 2024-09-12T01:47:57.051 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling the dashboard module... 2024-09-12T01:47:58.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-mon[31204]: from='mgr.14118 172.21.15.39:0/3102906396' entity='mgr.x' 2024-09-12T01:47:58.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/772311951' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:47:58.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setuser ceph since I am not root 2024-09-12T01:47:58.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ignoring --setgroup ceph since I am not root 2024-09-12T01:47:58.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.251+0000 7f8581d77040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:47:58.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.311+0000 7f8581d77040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:47:58.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.467+0000 7f8581d77040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:47:58.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.536+0000 7f8581d77040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:47:58.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.692+0000 7f8581d77040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.515+0000 7f5be07ab640 1 Processor -- start 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.515+0000 7f5be07ab640 1 -- start start 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.515+0000 7f5be07ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.515+0000 7f5be07ab640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8107f50 con 0x7f5bd8107580 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.515+0000 7f5bde547640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.516+0000 7f5bde547640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38492/0 (socket says 172.21.15.39:38492) 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.516+0000 7f5bde547640 1 -- 172.21.15.39:0/3729080501 learned_addr learned my addr 172.21.15.39:0/3729080501 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:58.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.516+0000 7f5bde547640 1 -- 172.21.15.39:0/3729080501 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd8108780 con 0x7f5bd8107580 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5bde547640 1 --2- 172.21.15.39:0/3729080501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009820 tx=0x7f5bd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9232fc505a16fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5bdd545640 1 -- 172.21.15.39:0/3729080501 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd0037070 con 0x7f5bd8107580 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5bdd545640 1 -- 172.21.15.39:0/3729080501 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd0032920 con 0x7f5bd8107580 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5bdd545640 1 -- 172.21.15.39:0/3729080501 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd0030810 con 0x7f5bd8107580 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 -- 172.21.15.39:0/3729080501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 msgr2=0x7f5bd8107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 --2- 172.21.15.39:0/3729080501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009820 tx=0x7f5bd002a270 comp rx=0 tx=0).stop 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 -- 172.21.15.39:0/3729080501 shutdown_connections 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 --2- 172.21.15.39:0/3729080501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd8107980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 -- 172.21.15.39:0/3729080501 >> 172.21.15.39:0/3729080501 conn(0x7f5bd8102d90 msgr2=0x7f5bd81051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.517+0000 7f5be07ab640 1 -- 172.21.15.39:0/3729080501 shutdown_connections 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5be07ab640 1 -- 172.21.15.39:0/3729080501 wait complete. 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5be07ab640 1 Processor -- start 2024-09-12T01:47:58.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5be07ab640 1 -- start start 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5be07ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5be07ab640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd810bb30 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5bde547640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5bde547640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38500/0 (socket says 172.21.15.39:38500) 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.518+0000 7f5bde547640 1 -- 172.21.15.39:0/772311951 learned_addr learned my addr 172.21.15.39:0/772311951 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5bde547640 1 -- 172.21.15.39:0/772311951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd819dff0 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5bde547640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0030560 tx=0x7f5bd0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd0037040 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd819e280 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd0040070 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd81a0f70 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.519+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd003a740 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.520+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5bd003a9b0 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.520+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc4005290 con 0x7f5bd8107580 2024-09-12T01:47:58.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.520+0000 7f5bd77fe640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 0x7f5bc003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.520+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5bd006c5a0 con 0x7f5bd8107580 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.520+0000 7f5bddd46640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 0x7f5bc003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.521+0000 7f5bddd46640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 0x7f5bc003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00ad30 tx=0x7f5bcc0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.525+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bd0041270 con 0x7f5bd8107580 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:57.752+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f5bc4005580 con 0x7f5bd8107580 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.098+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f5bd003ada0 con 0x7f5bd8107580 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.100+0000 7f5bd77fe640 1 -- 172.21.15.39:0/772311951 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f5bd0045980 con 0x7f5bd8107580 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 msgr2=0x7f5bc003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 0x7f5bc003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00ad30 tx=0x7f5bcc0093f0 comp rx=0 tx=0).stop 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 msgr2=0x7f5bd819dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0030560 tx=0x7f5bd0032670 comp rx=0 tx=0).stop 2024-09-12T01:47:58.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 shutdown_connections 2024-09-12T01:47:58.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f5bc0038f70 0x7f5bc003b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:58.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 --2- 172.21.15.39:0/772311951 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bd8107580 0x7f5bd819dab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:58.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.101+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 >> 172.21.15.39:0/772311951 conn(0x7f5bd8102d90 msgr2=0x7f5bd8103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:58.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.102+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 shutdown_connections 2024-09-12T01:47:58.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:58.102+0000 7f5be07ab640 1 -- 172.21.15.39:0/772311951 wait complete. 2024-09-12T01:47:59.074 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:58 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:58.843+0000 7f8581d77040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:47:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:59 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/772311951' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:47:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:47:59 smithi039 ceph-mon[31204]: mgrmap e9: x(active, since 19s) 2024-09-12T01:47:59.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:59 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:59.172+0000 7f8581d77040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:47:59.411 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:59 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:59.237+0000 7f8581d77040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:47:59.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:47:59 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:47:59.435+0000 7f8581d77040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:48:00.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:00.085 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.280+0000 7faddc1c6640 1 Processor -- start 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.280+0000 7faddc1c6640 1 -- start start 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.280+0000 7faddc1c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.280+0000 7faddc1c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4106de0 con 0x7fadd4106410 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.281+0000 7fadd9f62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.281+0000 7fadd9f62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38526/0 (socket says 172.21.15.39:38526) 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.281+0000 7fadd9f62640 1 -- 172.21.15.39:0/1910316712 learned_addr learned my addr 172.21.15.39:0/1910316712 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:00.086 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.281+0000 7fadd9f62640 1 -- 172.21.15.39:0/1910316712 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd4107610 con 0x7fadd4106410 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.282+0000 7fadd9f62640 1 --2- 172.21.15.39:0/1910316712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009820 tx=0x7fadd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8359d0006d687246 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.282+0000 7fadd8f60640 1 -- 172.21.15.39:0/1910316712 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd0037070 con 0x7fadd4106410 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.282+0000 7fadd8f60640 1 -- 172.21.15.39:0/1910316712 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0032920 con 0x7fadd4106410 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.282+0000 7fadd8f60640 1 -- 172.21.15.39:0/1910316712 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd0030810 con 0x7fadd4106410 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- 172.21.15.39:0/1910316712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 msgr2=0x7fadd4106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1910316712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009820 tx=0x7fadd002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- 172.21.15.39:0/1910316712 shutdown_connections 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1910316712 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd4106810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- 172.21.15.39:0/1910316712 >> 172.21.15.39:0/1910316712 conn(0x7fadd4101b80 msgr2=0x7fadd4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- 172.21.15.39:0/1910316712 shutdown_connections 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- 172.21.15.39:0/1910316712 wait complete. 2024-09-12T01:48:00.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 Processor -- start 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.283+0000 7faddc1c6640 1 -- start start 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7faddc1c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7faddc1c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fadd410a9c0 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadd9f62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadd9f62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38528/0 (socket says 172.21.15.39:38528) 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadd9f62640 1 -- 172.21.15.39:0/1084839664 learned_addr learned my addr 172.21.15.39:0/1084839664 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadd9f62640 1 -- 172.21.15.39:0/1084839664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd419dff0 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadd9f62640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fadd00097f0 tx=0x7fadd00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd0037040 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0030cc0 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd419e280 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd003a640 con 0x7fadd4106410 2024-09-12T01:48:00.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.284+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd41a0f70 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd410ab40 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fadd003b3f0 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7fadcaffd640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 0x7fadc003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fadd006c550 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7fadd9761640 1 -- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 msgr2=0x7fadc003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.286+0000 7fadd9761640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 0x7fadc003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.290+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadd0042e10 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.487+0000 7fadd9761640 1 -- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 msgr2=0x7fadc003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.487+0000 7fadd9761640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 0x7fadc003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.520+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fadd402d7c0 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.520+0000 7fadcaffd640 1 -- 172.21.15.39:0/1084839664 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fadd0043de0 con 0x7fadd4106410 2024-09-12T01:48:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 msgr2=0x7fadc003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 0x7fadc003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 msgr2=0x7fadd419dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fadd00097f0 tx=0x7fadd00327b0 comp rx=0 tx=0).stop 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 shutdown_connections 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7fadc0038fc0 0x7fadc003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 --2- 172.21.15.39:0/1084839664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fadd4106410 0x7fadd419dab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 >> 172.21.15.39:0/1084839664 conn(0x7fadd4101b80 msgr2=0x7fadd4102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 shutdown_connections 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:47:59.522+0000 7faddc1c6640 1 -- 172.21.15.39:0/1084839664 wait complete. 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-12T01:48:00.090 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 9... 2024-09-12T01:48:00.236 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1084839664' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:48:00.561 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:00.372+0000 7f8581d77040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:48:00.561 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:00.443+0000 7f8581d77040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:48:01.463 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.192+0000 7f8581d77040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:48:01.464 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.313+0000 7f8581d77040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:48:01.754 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.462+0000 7f8581d77040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:48:01.754 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.526+0000 7f8581d77040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:48:01.755 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.682+0000 7f8581d77040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:48:01.755 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.753+0000 7f8581d77040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:48:02.050 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.816+0000 7f8581d77040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:48:02.050 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:01.981+0000 7f8581d77040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:48:02.050 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:02.049+0000 7f8581d77040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:48:02.328 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:02.118+0000 7f8581d77040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:48:02.329 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:02.204+0000 7f8581d77040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:48:02.329 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:02.266+0000 7f8581d77040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:48:02.329 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:02.327+0000 7f8581d77040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:03.152+0000 7f8581d77040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: Active manager daemon x restarted 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: Activating manager daemon x 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: mgrmap e10: x(active, starting, since 0.00352595s) 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: Manager daemon x is now available 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:03.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:48:03.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.560+0000 7f6457fa6640 1 Processor -- start 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.560+0000 7f6457fa6640 1 -- start start 2024-09-12T01:48:05.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6457fa6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6457fa6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f645007be60 con 0x7f6450107fb0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6455d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6455d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38540/0 (socket says 172.21.15.39:38540) 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6455d42640 1 -- 172.21.15.39:0/1196255947 learned_addr learned my addr 172.21.15.39:0/1196255947 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.561+0000 7f6455d42640 1 -- 172.21.15.39:0/1196255947 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645010a8e0 con 0x7f6450107fb0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.562+0000 7f6455d42640 1 --2- 172.21.15.39:0/1196255947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f644c009820 tx=0x7f644c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96aa574337e72a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.562+0000 7f6454d40640 1 -- 172.21.15.39:0/1196255947 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c037070 con 0x7f6450107fb0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.562+0000 7f6454d40640 1 -- 172.21.15.39:0/1196255947 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644c032920 con 0x7f6450107fb0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.562+0000 7f6454d40640 1 -- 172.21.15.39:0/1196255947 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c030810 con 0x7f6450107fb0 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 -- 172.21.15.39:0/1196255947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 msgr2=0x7f645010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 --2- 172.21.15.39:0/1196255947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f644c009820 tx=0x7f644c02a270 comp rx=0 tx=0).stop 2024-09-12T01:48:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 -- 172.21.15.39:0/1196255947 shutdown_connections 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 --2- 172.21.15.39:0/1196255947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645010a3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 -- 172.21.15.39:0/1196255947 >> 172.21.15.39:0/1196255947 conn(0x7f6450101b90 msgr2=0x7f6450104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 -- 172.21.15.39:0/1196255947 shutdown_connections 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.563+0000 7f6457fa6640 1 -- 172.21.15.39:0/1196255947 wait complete. 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6457fa6640 1 Processor -- start 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6457fa6640 1 -- start start 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6457fa6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6457fa6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f645010b9c0 con 0x7f6450107fb0 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6455d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6455d42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38550/0 (socket says 172.21.15.39:38550) 2024-09-12T01:48:05.128 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6455d42640 1 -- 172.21.15.39:0/4281746587 learned_addr learned my addr 172.21.15.39:0/4281746587 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6455d42640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645019bd90 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.564+0000 7f6455d42640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f644c030380 tx=0x7f644c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.565+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c037040 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.565+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f644c040070 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.565+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645019c020 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.565+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f644c03a7b0 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.565+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645019ed10 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f644c03a9e0 con 0x7f6450107fb0 2024-09-12T01:48:05.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6446ffd640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f643c03bbf0 con 0x7f643c039020 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f644c06c7a0 con 0x7f6450107fb0 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6455541640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 msgr2=0x7f643c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.566+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.767+0000 7f6455541640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 msgr2=0x7f643c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:00.767+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:01.168+0000 7f6455541640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 msgr2=0x7f643c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:01.168+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:01.969+0000 7f6455541640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 msgr2=0x7f643c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4201782244 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:01.969+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:03.156+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f644c06b250 con 0x7f6450107fb0 2024-09-12T01:48:05.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:03.156+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 msgr2=0x7f643c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:03.156+0000 7f6446ffd640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.160+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f644c045460 con 0x7f6450107fb0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.160+0000 7f6446ffd640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 0x7f643c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.160+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f644c03de70 con 0x7f643c03cae0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.161+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 0x7f643c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.161+0000 7f6455541640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 0x7f643c03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6440003980 tx=0x7f64400092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.162+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f644c03de70 con 0x7f643c03cae0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.175+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6450108410 con 0x7f643c03cae0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6446ffd640 1 -- 172.21.15.39:0/4281746587 <== mgr.14150 v2:172.21.15.39:6800/571724551 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f6450108410 con 0x7f643c03cae0 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 msgr2=0x7f643c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 0x7f643c03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6440003980 tx=0x7f64400092b0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 msgr2=0x7f645019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:05.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f644c030380 tx=0x7f644c032670 comp rx=0 tx=0).stop 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 shutdown_connections 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f643c03cae0 0x7f643c03eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:6800/4201782244,v1:172.21.15.39:6801/4201782244] conn(0x7f643c039020 0x7f643c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 --2- 172.21.15.39:0/4281746587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6450107fb0 0x7f645019b850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.176+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 >> 172.21.15.39:0/4281746587 conn(0x7f6450101b90 msgr2=0x7f6450102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.177+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 shutdown_connections 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:04.177+0000 7f6457fa6640 1 -- 172.21.15.39:0/4281746587 wait complete. 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 9 is available 2024-09-12T01:48:05.132 INFO:teuthology.orchestra.run.smithi039.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:48:05.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-mon[31204]: mgrmap e11: x(active, since 1.00992s) 2024-09-12T01:48:05.382 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:05.348+0000 7f84e7840640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:48:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:48:05.382 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: Traceback (most recent call last): 2024-09-12T01:48:05.382 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:48:05.382 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._connections.run(self.expiration_interval) 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._run(expiration_interval) 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: s = self.context.wrap_socket( 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: return self.sslsocket_class._create( 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self.do_handshake() 2024-09-12T01:48:05.383 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:48:05.384 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: self._sslobj.do_handshake() 2024-09-12T01:48:05.384 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:48:05.384 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:48:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.595+0000 7f32b4c7c640 1 Processor -- start 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.595+0000 7f32b4c7c640 1 -- start start 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32b4c7c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32b4c7c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b007c8c0 con 0x7f32b007de90 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32ae59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:06.376 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32ae59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43292/0 (socket says 172.21.15.39:43292) 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32ae59c640 1 -- 172.21.15.39:0/3111810517 learned_addr learned my addr 172.21.15.39:0/3111810517 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.596+0000 7f32ae59c640 1 -- 172.21.15.39:0/3111810517 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b007ca40 con 0x7f32b007de90 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.597+0000 7f32ae59c640 1 --2- 172.21.15.39:0/3111810517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009820 tx=0x7f32a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a9eafdf46145be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.597+0000 7f32add9b640 1 -- 172.21.15.39:0/3111810517 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a0037070 con 0x7f32b007de90 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.597+0000 7f32add9b640 1 -- 172.21.15.39:0/3111810517 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32a0032920 con 0x7f32b007de90 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.597+0000 7f32add9b640 1 -- 172.21.15.39:0/3111810517 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a0030810 con 0x7f32b007de90 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 -- 172.21.15.39:0/3111810517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 msgr2=0x7f32b007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/3111810517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009820 tx=0x7f32a002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 -- 172.21.15.39:0/3111810517 shutdown_connections 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/3111810517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b007c2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 -- 172.21.15.39:0/3111810517 >> 172.21.15.39:0/3111810517 conn(0x7f32b0102d40 msgr2=0x7f32b0105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 -- 172.21.15.39:0/3111810517 shutdown_connections 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 -- 172.21.15.39:0/3111810517 wait complete. 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.598+0000 7f32b4c7c640 1 Processor -- start 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32b4c7c640 1 -- start start 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32b4c7c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32b4c7c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b010dc20 con 0x7f32b007de90 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32ae59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32ae59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43302/0 (socket says 172.21.15.39:43302) 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32ae59c640 1 -- 172.21.15.39:0/1710400460 learned_addr learned my addr 172.21.15.39:0/1710400460 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32ae59c640 1 -- 172.21.15.39:0/1710400460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b019e030 con 0x7f32b007de90 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.599+0000 7f32ae59c640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32a0030560 tx=0x7f32a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.600+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a0037040 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.600+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32a0040070 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.600+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b019e2c0 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.600+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a003a6d0 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.600+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b01a0fb0 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.601+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b007c370 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.601+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f32a003bb20 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.601+0000 7f32a77fe640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 0x7f329c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.601+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f32a006c680 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.601+0000 7f32a7fff640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 0x7f329c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.602+0000 7f32a7fff640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 0x7f329c03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f3298006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.606+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32a004a200 con 0x7f32b007de90 2024-09-12T01:48:06.379 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.796+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f32b0062630 con 0x7f329c038fc0 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.862+0000 7f32a77fe640 1 -- 172.21.15.39:0/1710400460 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f32b0062630 con 0x7f329c038fc0 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.864+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 msgr2=0x7f329c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.864+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 0x7f329c03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f3298006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.864+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 msgr2=0x7f32b019daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.864+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32a0030560 tx=0x7f32a0032670 comp rx=0 tx=0).stop 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.864+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 shutdown_connections 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.865+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f329c038fc0 0x7f329c03b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.865+0000 7f32b4c7c640 1 --2- 172.21.15.39:0/1710400460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b007de90 0x7f32b019daf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.865+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 >> 172.21.15.39:0/1710400460 conn(0x7f32b0102d40 msgr2=0x7f32b0103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.865+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 shutdown_connections 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:05.865+0000 7f32b4c7c640 1 -- 172.21.15.39:0/1710400460 wait complete. 2024-09-12T01:48:06.380 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial admin user... 2024-09-12T01:48:06.494 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:06 smithi039 ceph-mon[31204]: mgrmap e12: x(active, since 2s) 2024-09-12T01:48:06.495 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:06.495 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:06.495 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:08.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:08.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:08.896 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aywnTVsxO07TcK/4gmYR/.H88bgyStc1vukb4AHgUU51wRHPzBMy6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726105687, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:48:08.896 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.788+0000 7f7adf9b0640 1 Processor -- start 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.788+0000 7f7adf9b0640 1 -- start start 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7adf9b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7adf9b0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad8107f60 con 0x7f7ad8107590 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7add74c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7add74c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43316/0 (socket says 172.21.15.39:43316) 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7add74c640 1 -- 172.21.15.39:0/1067630428 learned_addr learned my addr 172.21.15.39:0/1067630428 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.789+0000 7f7add74c640 1 -- 172.21.15.39:0/1067630428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad8108790 con 0x7f7ad8107590 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.790+0000 7f7add74c640 1 --2- 172.21.15.39:0/1067630428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009820 tx=0x7f7ad002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac084087f36afcf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:08.897 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.790+0000 7f7ad7fff640 1 -- 172.21.15.39:0/1067630428 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad0037070 con 0x7f7ad8107590 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.790+0000 7f7ad7fff640 1 -- 172.21.15.39:0/1067630428 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ad0032920 con 0x7f7ad8107590 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.790+0000 7f7ad7fff640 1 -- 172.21.15.39:0/1067630428 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad0030810 con 0x7f7ad8107590 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- 172.21.15.39:0/1067630428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 msgr2=0x7f7ad8107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/1067630428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009820 tx=0x7f7ad002a270 comp rx=0 tx=0).stop 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- 172.21.15.39:0/1067630428 shutdown_connections 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/1067630428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad8107990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- 172.21.15.39:0/1067630428 >> 172.21.15.39:0/1067630428 conn(0x7f7ad8102d40 msgr2=0x7f7ad8105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:08.898 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- 172.21.15.39:0/1067630428 shutdown_connections 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- 172.21.15.39:0/1067630428 wait complete. 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 Processor -- start 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.791+0000 7f7adf9b0640 1 -- start start 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7adf9b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7adf9b0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad810bb40 con 0x7f7ad8107590 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7add74c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7add74c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43324/0 (socket says 172.21.15.39:43324) 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7add74c640 1 -- 172.21.15.39:0/4247954601 learned_addr learned my addr 172.21.15.39:0/4247954601 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7add74c640 1 -- 172.21.15.39:0/4247954601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad819be40 con 0x7f7ad8107590 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7add74c640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0030560 tx=0x7f7ad0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad0037040 con 0x7f7ad8107590 2024-09-12T01:48:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ad0040070 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad819c0d0 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ad003a6d0 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.792+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad819edc0 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.793+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f7ad003a870 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.793+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad810bcc0 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.793+0000 7f7ad67fc640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 0x7f7ac003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.793+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7ad006c760 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.794+0000 7f7adcf4b640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 0x7f7ac003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.794+0000 7f7adcf4b640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 0x7f7ac003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098c0 tx=0x7f7acc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.798+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ad0044c70 con 0x7f7ad8107590 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:06.994+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f7ad8107a10 con 0x7f7ac0039020 2024-09-12T01:48:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.244+0000 7f7ad67fc640 1 -- 172.21.15.39:0/4247954601 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f7ad8107a10 con 0x7f7ac0039020 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.246+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 msgr2=0x7f7ac003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.246+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 0x7f7ac003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098c0 tx=0x7f7acc006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.246+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 msgr2=0x7f7ad819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.246+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0030560 tx=0x7f7ad0032670 comp rx=0 tx=0).stop 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 shutdown_connections 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ac0039020 0x7f7ac003b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 --2- 172.21.15.39:0/4247954601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ad8107590 0x7f7ad819b900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 >> 172.21.15.39:0/4247954601 conn(0x7f7ad8102d40 msgr2=0x7f7ad8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 shutdown_connections 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:07.247+0000 7f7adf9b0640 1 -- 172.21.15.39:0/4247954601 wait complete. 2024-09-12T01:48:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:Fetching dashboard port number... 2024-09-12T01:48:10.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:48:10.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.359+0000 7f6905829640 1 Processor -- start 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.359+0000 7f6905829640 1 -- start start 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.359+0000 7f6905829640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.360+0000 7f6905829640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f690007bde0 con 0x7f6900108000 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.360+0000 7f68feffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.360+0000 7f68feffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43340/0 (socket says 172.21.15.39:43340) 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.360+0000 7f68feffd640 1 -- 172.21.15.39:0/3891365097 learned_addr learned my addr 172.21.15.39:0/3891365097 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.360+0000 7f68feffd640 1 -- 172.21.15.39:0/3891365097 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690010a930 con 0x7f6900108000 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.361+0000 7f68feffd640 1 --2- 172.21.15.39:0/3891365097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009820 tx=0x7f68f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3f3fbbe5e708a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.361+0000 7f68fdffb640 1 -- 172.21.15.39:0/3891365097 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f8037070 con 0x7f6900108000 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.361+0000 7f68fdffb640 1 -- 172.21.15.39:0/3891365097 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f8032920 con 0x7f6900108000 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.361+0000 7f68fdffb640 1 -- 172.21.15.39:0/3891365097 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f8030810 con 0x7f6900108000 2024-09-12T01:48:10.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 -- 172.21.15.39:0/3891365097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 msgr2=0x7f690010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 --2- 172.21.15.39:0/3891365097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009820 tx=0x7f68f802a270 comp rx=0 tx=0).stop 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 -- 172.21.15.39:0/3891365097 shutdown_connections 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 --2- 172.21.15.39:0/3891365097 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f690010a3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 -- 172.21.15.39:0/3891365097 >> 172.21.15.39:0/3891365097 conn(0x7f6900101b80 msgr2=0x7f6900103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 -- 172.21.15.39:0/3891365097 shutdown_connections 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 -- 172.21.15.39:0/3891365097 wait complete. 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.362+0000 7f6905829640 1 Processor -- start 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f6905829640 1 -- start start 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f6905829640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f6905829640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f690010b950 con 0x7f6900108000 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f68feffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f68feffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43348/0 (socket says 172.21.15.39:43348) 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f68feffd640 1 -- 172.21.15.39:0/1257422950 learned_addr learned my addr 172.21.15.39:0/1257422950 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f68feffd640 1 -- 172.21.15.39:0/1257422950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6900107dc0 con 0x7f6900108000 2024-09-12T01:48:10.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.363+0000 7f68feffd640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68f80097f0 tx=0x7f68f80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f8037040 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68f8030cc0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6900105fb0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f803a6b0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69001064f0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.364+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f68f803b3f0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.365+0000 7f6904827640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 0x7f68ec03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.365+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f68f806c6c0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.365+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6900108460 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.365+0000 7f68fe7fc640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 0x7f68ec03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.365+0000 7f68fe7fc640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 0x7f68ec03b520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098c0 tx=0x7f68e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.370+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68f803a8a0 con 0x7f6900108000 2024-09-12T01:48:10.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.545+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f6900194ee0 con 0x7f6900108000 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.546+0000 7f6904827640 1 -- 172.21.15.39:0/1257422950 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f68f8044c50 con 0x7f6900108000 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 msgr2=0x7f68ec03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 0x7f68ec03b520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098c0 tx=0x7f68e8006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 msgr2=0x7f6900107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68f80097f0 tx=0x7f68f80327b0 comp rx=0 tx=0).stop 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 shutdown_connections 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f68ec039060 0x7f68ec03b520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 --2- 172.21.15.39:0/1257422950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6900108000 0x7f6900107880 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 >> 172.21.15.39:0/1257422950 conn(0x7f6900101b80 msgr2=0x7f6900102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 shutdown_connections 2024-09-12T01:48:10.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:09.548+0000 7f6905829640 1 -- 172.21.15.39:0/1257422950 wait complete. 2024-09-12T01:48:10.153 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:48:10.153 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T01:48:10.161 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:48:10.161 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T01:48:10.161 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T01:48:10.161 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph Dashboard is now available at: 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout: URL: https://smithi039.front.sepia.ceph.com:8443/ 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout: User: admin 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout: Password: se2f3t8v8y 2024-09-12T01:48:10.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:10.164 INFO:teuthology.orchestra.run.smithi039.stdout:Saving cluster configuration to /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config directory 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: [12/Sep/2024:01:48:05] ENGINE Bus STARTING 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: [12/Sep/2024:01:48:05] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: [12/Sep/2024:01:48:05] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: [12/Sep/2024:01:48:05] ENGINE Bus STARTED 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: [12/Sep/2024:01:48:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:48:10.400 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-12T01:48:10.401 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: mgrmap e13: x(active, since 6s) 2024-09-12T01:48:10.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:10 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1257422950' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:48:11.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f38287ad640 1 Processor -- start 2024-09-12T01:48:11.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f38287ad640 1 -- start start 2024-09-12T01:48:11.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f38287ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:11.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f38287ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3820107f50 con 0x7f3820107580 2024-09-12T01:48:11.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f3826549640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f3826549640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43360/0 (socket says 172.21.15.39:43360) 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f3826549640 1 -- 172.21.15.39:0/2966305858 learned_addr learned my addr 172.21.15.39:0/2966305858 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.604+0000 7f3826549640 1 -- 172.21.15.39:0/2966305858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3820108780 con 0x7f3820107580 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.605+0000 7f3826549640 1 --2- 172.21.15.39:0/2966305858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f381c009820 tx=0x7f381c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d80eae27f783a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.605+0000 7f3825547640 1 -- 172.21.15.39:0/2966305858 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f3820107580 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.605+0000 7f3825547640 1 -- 172.21.15.39:0/2966305858 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c032920 con 0x7f3820107580 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.605+0000 7f3825547640 1 -- 172.21.15.39:0/2966305858 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381c030810 con 0x7f3820107580 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 -- 172.21.15.39:0/2966305858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 msgr2=0x7f3820107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 --2- 172.21.15.39:0/2966305858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f381c009820 tx=0x7f381c02a270 comp rx=0 tx=0).stop 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 -- 172.21.15.39:0/2966305858 shutdown_connections 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 --2- 172.21.15.39:0/2966305858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f3820107980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 -- 172.21.15.39:0/2966305858 >> 172.21.15.39:0/2966305858 conn(0x7f3820102d90 msgr2=0x7f38201051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:11.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 -- 172.21.15.39:0/2966305858 shutdown_connections 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.606+0000 7f38287ad640 1 -- 172.21.15.39:0/2966305858 wait complete. 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f38287ad640 1 Processor -- start 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f38287ad640 1 -- start start 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f38287ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f38287ad640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f382010bb30 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f3826549640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f3826549640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43366/0 (socket says 172.21.15.39:43366) 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f3826549640 1 -- 172.21.15.39:0/4205893854 learned_addr learned my addr 172.21.15.39:0/4205893854 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f3826549640 1 -- 172.21.15.39:0/4205893854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382019bd90 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.607+0000 7f3826549640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f381c030560 tx=0x7f381c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381c037040 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c040070 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382019c020 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381c03a740 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382019ed10 con 0x7f3820107580 2024-09-12T01:48:11.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.608+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f381c03a8e0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.609+0000 7f38177fe640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 0x7f380c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.609+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f381c06c7a0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.609+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382010bcb0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.609+0000 7f3825d48640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 0x7f380c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.609+0000 7f3825d48640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 0x7f380c03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38100098c0 tx=0x7f3810006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.614+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f381c039ba0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.884+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f3820075ef0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.888+0000 7f38177fe640 1 -- 172.21.15.39:0/4205893854 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f381c0313a0 con 0x7f3820107580 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 msgr2=0x7f380c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 0x7f380c03b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38100098c0 tx=0x7f3810006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 msgr2=0x7f382019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f381c030560 tx=0x7f381c032670 comp rx=0 tx=0).stop 2024-09-12T01:48:11.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 shutdown_connections 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f380c0390c0 0x7f380c03b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 --2- 172.21.15.39:0/4205893854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3820107580 0x7f382019b850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.890+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 >> 172.21.15.39:0/4205893854 conn(0x7f3820102d90 msgr2=0x7f3820103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.891+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 shutdown_connections 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T01:48:10.891+0000 7f38287ad640 1 -- 172.21.15.39:0/4205893854 wait complete. 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: ceph telemetry on 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout:For more information see: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:11.481 INFO:teuthology.orchestra.run.smithi039.stdout:Bootstrap complete. 2024-09-12T01:48:11.515 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:48:11.515 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:11.515 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:48:11.531 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:48:11.532 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:11.532 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:48:11.588 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:48:11.588 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:11.588 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T01:48:11.655 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:48:11.655 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:11.655 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:48:11.712 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:48:11.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:48:11.787 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:11.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:48:11.840 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:11.853 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:48:11.896 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgh1ChlDiRSGgLdM64vRZau2WGt6xV7ivHsvmfWENQnkvau+uDXX7w6OjGhhjj1cstn+ge3wU+J3qPr3V3Nu8IUmrkyCBedbPcu4FTE78PM1HHZChM2na+AG3ra5w31DFLtf4eY46BS8nFYLJkOMyHtCiOhBtyopVKCIvamEX3rUKxQ/WEjd/kX5PpnHjmkOsM/D94laRuGC4LElWpGF1sYEr6K/lsBkKOSUugCfINgHrKkwAHCKD48JyUxgJN/FstAIXfKZ6JkLK9V57mqpBFLB0LlB3+YDGo1jQScNmSAhGKwMf8HUucoro/geNAJ+4AL7/4UN+ChoD1L6bDKnw2p+/YFVMK5KxMKVEwfMfHqyBNrPN4xTVLjdjdXCzyF2eKGpg7ixoFD+5HRV5217baNqAIcx5V2ImYOYhHcuJ+iVL5HlHqhtsNnqbzPYOPc7MNk9Fy4sGnUYGVRf50ZWbyYRYLG/rHd266SI72zAFgkKRZcKFkFPibjGsDnQ5b0tk= ceph-d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:11.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:48:11.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:11 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4205893854' entity='client.admin' 2024-09-12T01:48:12.289 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 -- 172.21.15.39:0/1052789946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 msgr2=0x7f882c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 --2- 172.21.15.39:0/1052789946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8814009c20 tx=0x7f881402aa90 comp rx=0 tx=0).stop 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 -- 172.21.15.39:0/1052789946 shutdown_connections 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 --2- 172.21.15.39:0/1052789946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 -- 172.21.15.39:0/1052789946 >> 172.21.15.39:0/1052789946 conn(0x7f882c0fcdb0 msgr2=0x7f882c0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 -- 172.21.15.39:0/1052789946 shutdown_connections 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 -- 172.21.15.39:0/1052789946 wait complete. 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.807+0000 7f8833033640 1 Processor -- start 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8833033640 1 -- start start 2024-09-12T01:48:12.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8833033640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8833033640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f882c107710 con 0x7f882c101600 2024-09-12T01:48:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8830dcf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8830dcf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40456/0 (socket says 172.21.15.39:40456) 2024-09-12T01:48:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8830dcf640 1 -- 172.21.15.39:0/1707181665 learned_addr learned my addr 172.21.15.39:0/1707181665 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:12.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8830dcf640 1 -- 172.21.15.39:0/1707181665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c1972d0 con 0x7f882c101600 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.808+0000 7f8830dcf640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f881402f040 tx=0x7f881402e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.809+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8814047070 con 0x7f882c101600 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.809+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8814003e50 con 0x7f882c101600 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.809+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c197560 con 0x7f882c101600 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.809+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8814033050 con 0x7f882c101600 2024-09-12T01:48:12.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.809+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c19a210 con 0x7f882c101600 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f881404a070 con 0x7f882c101600 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c107e90 con 0x7f882c101600 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f8829ffb640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 0x7f881803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f881403e030 con 0x7f882c101600 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f882bfff640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 0x7f881803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:12.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.810+0000 7f882bfff640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 0x7f881803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f881c0098c0 tx=0x7f881c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:12.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.815+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88140373b0 con 0x7f882c101600 2024-09-12T01:48:12.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.992+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f882c02d940 con 0x7f882c101600 2024-09-12T01:48:12.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.994+0000 7f8829ffb640 1 -- 172.21.15.39:0/1707181665 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f88140510c0 con 0x7f882c101600 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 msgr2=0x7f881803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 0x7f881803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f881c0098c0 tx=0x7f881c006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 msgr2=0x7f882c196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f881402f040 tx=0x7f881402e3c0 comp rx=0 tx=0).stop 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 shutdown_connections 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8818039060 0x7f881803b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 --2- 172.21.15.39:0/1707181665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f882c101600 0x7f882c196d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 >> 172.21.15.39:0/1707181665 conn(0x7f882c0fcdb0 msgr2=0x7f882c0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 shutdown_connections 2024-09-12T01:48:12.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:12.997+0000 7f8833033640 1 -- 172.21.15.39:0/1707181665 wait complete. 2024-09-12T01:48:13.569 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:48:13.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:48:14.115 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:14.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:14 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1707181665' entity='client.admin' 2024-09-12T01:48:14.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.622+0000 7fbae8de2640 1 -- 172.21.15.39:0/721843353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 msgr2=0x7fbae4101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.622+0000 7fbae8de2640 1 --2- 172.21.15.39:0/721843353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4101a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009880 tx=0x7fbad402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 -- 172.21.15.39:0/721843353 shutdown_connections 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 --2- 172.21.15.39:0/721843353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4101a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 -- 172.21.15.39:0/721843353 >> 172.21.15.39:0/721843353 conn(0x7fbae40fcdb0 msgr2=0x7fbae40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 -- 172.21.15.39:0/721843353 shutdown_connections 2024-09-12T01:48:14.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 -- 172.21.15.39:0/721843353 wait complete. 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.623+0000 7fbae8de2640 1 Processor -- start 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae8de2640 1 -- start start 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae8de2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae8de2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4107710 con 0x7fbae4101600 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40460/0 (socket says 172.21.15.39:40460) 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae259c640 1 -- 172.21.15.39:0/2054310356 learned_addr learned my addr 172.21.15.39:0/2054310356 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:14.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae259c640 1 -- 172.21.15.39:0/2054310356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae41972e0 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae259c640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbad4004f60 tx=0x7fbad40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad403f070 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbad4004d40 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.624+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae4197570 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.625+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad4035030 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.625+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae419a220 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.625+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbad4042070 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.626+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae4107e90 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.626+0000 7fbad37fe640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 0x7fbacc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.626+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbad406cdf0 con 0x7fbae4101600 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.626+0000 7fbae1d9b640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 0x7fbacc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:14.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.626+0000 7fbae1d9b640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 0x7fbacc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098c0 tx=0x7fbad8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:14.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.630+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbad4039350 con 0x7fbae4101600 2024-09-12T01:48:14.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.809+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fbae402d8a0 con 0x7fbacc0390c0 2024-09-12T01:48:14.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.817+0000 7fbad37fe640 1 -- 172.21.15.39:0/2054310356 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbae402d8a0 con 0x7fbacc0390c0 2024-09-12T01:48:14.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.819+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 msgr2=0x7fbacc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:14.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.819+0000 7fbae8de2640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 0x7fbacc03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbad80098c0 tx=0x7fbad8006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.819+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 msgr2=0x7fbae4196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.819+0000 7fbae8de2640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbad4004f60 tx=0x7fbad40048f0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 shutdown_connections 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbacc0390c0 0x7fbacc03b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 --2- 172.21.15.39:0/2054310356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae4101600 0x7fbae4196da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 >> 172.21.15.39:0/2054310356 conn(0x7fbae40fcdb0 msgr2=0x7fbae40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 shutdown_connections 2024-09-12T01:48:14.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:14.820+0000 7fbae8de2640 1 -- 172.21.15.39:0/2054310356 wait complete. 2024-09-12T01:48:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:15 smithi039 ceph-mon[31204]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T01:48:15.597 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi044 2024-09-12T01:48:15.598 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:48:15.598 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:48:15.616 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:48:15.616 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:15.674 INFO:tasks.cephadm:Adding host smithi044 to orchestrator... 2024-09-12T01:48:15.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi044 2024-09-12T01:48:15.923 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.359+0000 7f5c05786640 1 -- 172.21.15.39:0/1233426847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 msgr2=0x7f5c00102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.359+0000 7f5c05786640 1 --2- 172.21.15.39:0/1233426847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00102bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009810 tx=0x7f5bf802a540 comp rx=0 tx=0).stop 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 -- 172.21.15.39:0/1233426847 shutdown_connections 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 --2- 172.21.15.39:0/1233426847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00102bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 -- 172.21.15.39:0/1233426847 >> 172.21.15.39:0/1233426847 conn(0x7f5c00077310 msgr2=0x7f5c000fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 -- 172.21.15.39:0/1233426847 shutdown_connections 2024-09-12T01:48:16.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 -- 172.21.15.39:0/1233426847 wait complete. 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 Processor -- start 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.360+0000 7f5c05786640 1 -- start start 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5c05786640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5c05786640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0010bc80 con 0x7f5c001027d0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bfeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bfeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40486/0 (socket says 172.21.15.39:40486) 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bfeffd640 1 -- 172.21.15.39:0/3859799320 learned_addr learned my addr 172.21.15.39:0/3859799320 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bfeffd640 1 -- 172.21.15.39:0/3859799320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c00102320 con 0x7f5c001027d0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bfeffd640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80045e0 tx=0x7f5bf8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf8030e70 con 0x7f5c001027d0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c00100970 con 0x7f5c001027d0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf80318e0 con 0x7f5c001027d0 2024-09-12T01:48:16.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf80049c0 con 0x7f5c001027d0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.361+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c00100e30 con 0x7f5c001027d0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.362+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5bf8039040 con 0x7f5c001027d0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.362+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c00069ef0 con 0x7f5c001027d0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.363+0000 7f5bf7fff640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 0x7f5bec03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.363+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5bf806d500 con 0x7f5c001027d0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.363+0000 7f5bfe7fc640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 0x7f5bec03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.363+0000 7f5bfe7fc640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 0x7f5bec03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098c0 tx=0x7f5be8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:16.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.367+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bf8040030 con 0x7f5c001027d0 2024-09-12T01:48:16.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:16.545+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}) -- 0x7f5c00101960 con 0x7f5bec039060 2024-09-12T01:48:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: Updating smithi039:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: Updating smithi039:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:48:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:17.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:17.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:18.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:17 smithi039 ceph-mon[31204]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:18 smithi039 ceph-mon[31204]: Deploying cephadm binary to smithi044 2024-09-12T01:48:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.436+0000 7f5bf7fff640 1 -- 172.21.15.39:0/3859799320 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5c00101960 con 0x7f5bec039060 2024-09-12T01:48:20.436 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi044' with addr '172.21.15.44' 2024-09-12T01:48:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.438+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 msgr2=0x7f5bec03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.438+0000 7f5c05786640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 0x7f5bec03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5be80098c0 tx=0x7f5be8006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.438+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 msgr2=0x7f5c00100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.438+0000 7f5c05786640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80045e0 tx=0x7f5bf8004610 comp rx=0 tx=0).stop 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 shutdown_connections 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5bec039060 0x7f5bec03b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 --2- 172.21.15.39:0/3859799320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c001027d0 0x7f5c00100430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 >> 172.21.15.39:0/3859799320 conn(0x7f5c00077310 msgr2=0x7f5c00105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 shutdown_connections 2024-09-12T01:48:20.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:20.439+0000 7f5c05786640 1 -- 172.21.15.39:0/3859799320 wait complete. 2024-09-12T01:48:21.058 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:48:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:21.693 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:21.693 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:21 smithi039 ceph-mon[31204]: Added host smithi044 2024-09-12T01:48:21.694 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:21.694 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:21.694 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 -- 172.21.15.39:0/1190115663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 msgr2=0x7f8a8c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 --2- 172.21.15.39:0/1190115663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c102b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009880 tx=0x7f8a7c02a670 comp rx=0 tx=0).stop 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 -- 172.21.15.39:0/1190115663 shutdown_connections 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 --2- 172.21.15.39:0/1190115663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c102b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 -- 172.21.15.39:0/1190115663 >> 172.21.15.39:0/1190115663 conn(0x7f8a8c0fc130 msgr2=0x7f8a8c0fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:21.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 -- 172.21.15.39:0/1190115663 shutdown_connections 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 -- 172.21.15.39:0/1190115663 wait complete. 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.779+0000 7f8a9317f640 1 Processor -- start 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a9317f640 1 -- start start 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a9317f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a9317f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c10bca0 con 0x7f8a8c102730 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a90f1b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a90f1b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40504/0 (socket says 172.21.15.39:40504) 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a90f1b640 1 -- 172.21.15.39:0/3176686538 learned_addr learned my addr 172.21.15.39:0/3176686538 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a90f1b640 1 -- 172.21.15.39:0/3176686538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c197790 con 0x7f8a8c102730 2024-09-12T01:48:21.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a90f1b640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009230 tx=0x7f8a7c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7c03f070 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a7c03bc80 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c197a20 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.780+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7c035030 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.781+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c197e80 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8a7c042070 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8c06a7b0 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a89ffb640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 0x7f8a7803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8a7c06cd40 con 0x7f8a8c102730 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a8bfff640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 0x7f8a7803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.782+0000 7f8a8bfff640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 0x7f8a7803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a740098c0 tx=0x7f8a74006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:21.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.787+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a7c0372d0 con 0x7f8a8c102730 2024-09-12T01:48:21.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.968+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a8c1985b0 con 0x7f8a78039060 2024-09-12T01:48:21.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.969+0000 7f8a89ffb640 1 -- 172.21.15.39:0/3176686538 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f8a8c1985b0 con 0x7f8a78039060 2024-09-12T01:48:21.969 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:21.969 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}] 2024-09-12T01:48:21.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 msgr2=0x7f8a7803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:21.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 0x7f8a7803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a740098c0 tx=0x7f8a74006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:21.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 msgr2=0x7f8a8c197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:21.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009230 tx=0x7f8a7c003d40 comp rx=0 tx=0).stop 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 shutdown_connections 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a78039060 0x7f8a7803b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 --2- 172.21.15.39:0/3176686538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a8c102730 0x7f8a8c197250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 >> 172.21.15.39:0/3176686538 conn(0x7f8a8c0fc130 msgr2=0x7f8a8c1054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 shutdown_connections 2024-09-12T01:48:21.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:21.971+0000 7f8a9317f640 1 -- 172.21.15.39:0/3176686538 wait complete. 2024-09-12T01:48:22.577 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-12T01:48:22.577 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:48:22.577 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:48:22.596 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:48:22.596 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:22.654 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-12T01:48:22.655 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi172 2024-09-12T01:48:22.903 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:22.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 -- 172.21.15.39:0/2139486348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 msgr2=0x7f3cc4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 --2- 172.21.15.39:0/2139486348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009880 tx=0x7f3cbc02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 -- 172.21.15.39:0/2139486348 shutdown_connections 2024-09-12T01:48:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 --2- 172.21.15.39:0/2139486348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 -- 172.21.15.39:0/2139486348 >> 172.21.15.39:0/2139486348 conn(0x7f3cc40fc1b0 msgr2=0x7f3cc40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 -- 172.21.15.39:0/2139486348 shutdown_connections 2024-09-12T01:48:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.341+0000 7f3cc927a640 1 -- 172.21.15.39:0/2139486348 wait complete. 2024-09-12T01:48:23.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc927a640 1 Processor -- start 2024-09-12T01:48:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc927a640 1 -- start start 2024-09-12T01:48:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc927a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc927a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc410ab90 con 0x7f3cc4106560 2024-09-12T01:48:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:23.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35196/0 (socket says 172.21.15.39:35196) 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.342+0000 7f3cc2ffd640 1 -- 172.21.15.39:0/3868056878 learned_addr learned my addr 172.21.15.39:0/3868056878 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cc2ffd640 1 -- 172.21.15.39:0/3868056878 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc406acd0 con 0x7f3cc4106560 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cc2ffd640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc03f070 con 0x7f3cc4106560 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc4196280 con 0x7f3cc4106560 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cbc03bc80 con 0x7f3cc4106560 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc035030 con 0x7f3cc4106560 2024-09-12T01:48:23.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.343+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc41966e0 con 0x7f3cc4106560 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.344+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3cbc042070 con 0x7f3cc4106560 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.344+0000 7f3cbbfff640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 0x7f3cb003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.344+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3cbc06c8e0 con 0x7f3cc4106560 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.344+0000 7f3cc27fc640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 0x7f3cb003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.344+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4101bd0 con 0x7f3cc4106560 2024-09-12T01:48:23.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.345+0000 7f3cc27fc640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 0x7f3cb003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098c0 tx=0x7f3cac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:23.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.349+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cbc0433b0 con 0x7f3cc4106560 2024-09-12T01:48:23.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:23.528+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7f3cc406a4c0 con 0x7f3cb00390c0 2024-09-12T01:48:24.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:23 smithi039 ceph-mon[31204]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:48:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:26.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T01:48:26.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: Updating smithi044:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:26.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: Deploying cephadm binary to smithi172 2024-09-12T01:48:26.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:26.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:26.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:26 smithi039 ceph-mon[31204]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:26 smithi039 ceph-mon[31204]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:26 smithi039 ceph-mon[31204]: Updating smithi044:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:48:27.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.542+0000 7f3cbbfff640 1 -- 172.21.15.39:0/3868056878 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3cc406a4c0 con 0x7f3cb00390c0 2024-09-12T01:48:27.542 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 msgr2=0x7f3cb003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 0x7f3cb003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098c0 tx=0x7f3cac006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 msgr2=0x7f3cc4195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc003d40 comp rx=0 tx=0).stop 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 shutdown_connections 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3cb00390c0 0x7f3cb003b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 --2- 172.21.15.39:0/3868056878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc4106560 0x7f3cc4195d40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 >> 172.21.15.39:0/3868056878 conn(0x7f3cc40fc1b0 msgr2=0x7f3cc40fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 shutdown_connections 2024-09-12T01:48:27.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:27.545+0000 7f3cc927a640 1 -- 172.21.15.39:0/3868056878 wait complete. 2024-09-12T01:48:28.184 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:48:28.437 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: Added host smithi172 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:28.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 -- 172.21.15.39:0/385595601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 msgr2=0x7f53d0107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 --2- 172.21.15.39:0/385595601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d0107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009880 tx=0x7f53c002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 -- 172.21.15.39:0/385595601 shutdown_connections 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 --2- 172.21.15.39:0/385595601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d0107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 -- 172.21.15.39:0/385595601 >> 172.21.15.39:0/385595601 conn(0x7f53d00fd290 msgr2=0x7f53d00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 -- 172.21.15.39:0/385595601 shutdown_connections 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 -- 172.21.15.39:0/385595601 wait complete. 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.880+0000 7f53d52f9640 1 Processor -- start 2024-09-12T01:48:28.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53d52f9640 1 -- start start 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53d52f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53d52f9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f53d010bc90 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53ceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53ceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35224/0 (socket says 172.21.15.39:35224) 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53ceffd640 1 -- 172.21.15.39:0/1663310398 learned_addr learned my addr 172.21.15.39:0/1663310398 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.881+0000 7f53ceffd640 1 -- 172.21.15.39:0/1663310398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d0197630 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.882+0000 7f53ceffd640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009230 tx=0x7f53c0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.883+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c003f070 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.883+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d01978c0 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.883+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53c003bc80 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.883+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c0035030 con 0x7f53d0107660 2024-09-12T01:48:28.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.883+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d019b9c0 con 0x7f53d0107660 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.884+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f53c0042070 con 0x7f53d0107660 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.884+0000 7f53c7fff640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 0x7f53bc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.884+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d0102cd0 con 0x7f53d0107660 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.885+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f53c006dc10 con 0x7f53d0107660 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.885+0000 7f53ce7fc640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 0x7f53bc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.885+0000 7f53ce7fc640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 0x7f53bc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53b80098c0 tx=0x7f53b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:28.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:28.889+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53c004c350 con 0x7f53d0107660 2024-09-12T01:48:29.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.069+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53d0107ac0 con 0x7f53bc039060 2024-09-12T01:48:29.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.070+0000 7f53c7fff640 1 -- 172.21.15.39:0/1663310398 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f53d0107ac0 con 0x7f53bc039060 2024-09-12T01:48:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:48:29.070 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-12T01:48:29.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 msgr2=0x7f53bc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 0x7f53bc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53b80098c0 tx=0x7f53b8006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 msgr2=0x7f53d01970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009230 tx=0x7f53c0003d40 comp rx=0 tx=0).stop 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 shutdown_connections 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f53bc039060 0x7f53bc03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 --2- 172.21.15.39:0/1663310398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53d0107660 0x7f53d01970f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.072+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 >> 172.21.15.39:0/1663310398 conn(0x7f53d00fd290 msgr2=0x7f53d00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.073+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 shutdown_connections 2024-09-12T01:48:29.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:29.073+0000 7f53d52f9640 1 -- 172.21.15.39:0/1663310398 wait complete. 2024-09-12T01:48:29.765 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:48:29.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:48:30.019 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:30.140 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:29 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 -- 172.21.15.39:0/3678431610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 msgr2=0x7fa2ec102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3678431610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009810 tx=0x7fa2dc02a540 comp rx=0 tx=0).stop 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 -- 172.21.15.39:0/3678431610 shutdown_connections 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3678431610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 -- 172.21.15.39:0/3678431610 >> 172.21.15.39:0/3678431610 conn(0x7fa2ec077310 msgr2=0x7fa2ec0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 -- 172.21.15.39:0/3678431610 shutdown_connections 2024-09-12T01:48:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.445+0000 7fa2f208e640 1 -- 172.21.15.39:0/3678431610 wait complete. 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.446+0000 7fa2f208e640 1 Processor -- start 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.446+0000 7fa2f208e640 1 -- start start 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.446+0000 7fa2f208e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.446+0000 7fa2f208e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec10bc80 con 0x7fa2ec102730 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.446+0000 7fa2eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2eb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35232/0 (socket says 172.21.15.39:35232) 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2eb7fe640 1 -- 172.21.15.39:0/3392227120 learned_addr learned my addr 172.21.15.39:0/3392227120 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2eb7fe640 1 -- 172.21.15.39:0/3392227120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec102280 con 0x7fa2ec102730 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2eb7fe640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0045e0 tx=0x7fa2dc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2dc030e70 con 0x7fa2ec102730 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2dc0318e0 con 0x7fa2ec102730 2024-09-12T01:48:30.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ec1008d0 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2dc0049c0 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.447+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ec100d90 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.448+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa2dc039040 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.448+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ec069f90 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.448+0000 7fa2e8ff9640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 0x7fa2d403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.448+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa2dc06d400 con 0x7fa2ec102730 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.448+0000 7fa2eaffd640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 0x7fa2d403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.449+0000 7fa2eaffd640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 0x7fa2d403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00098c0 tx=0x7fa2e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.453+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2dc040030 con 0x7fa2ec102730 2024-09-12T01:48:30.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.633+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa2ec1018c0 con 0x7fa2ec102730 2024-09-12T01:48:30.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.897+0000 7fa2e8ff9640 1 -- 172.21.15.39:0/3392227120 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa2dc043a00 con 0x7fa2ec102730 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 msgr2=0x7fa2d403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 0x7fa2d403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa2e00098c0 tx=0x7fa2e0006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 msgr2=0x7fa2ec100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0045e0 tx=0x7fa2dc004610 comp rx=0 tx=0).stop 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 shutdown_connections 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa2d4039060 0x7fa2d403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 --2- 172.21.15.39:0/3392227120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2ec102730 0x7fa2ec100390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 >> 172.21.15.39:0/3392227120 conn(0x7fa2ec077310 msgr2=0x7fa2ec1054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 shutdown_connections 2024-09-12T01:48:30.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:30.899+0000 7fa2f208e640 1 -- 172.21.15.39:0/3392227120 wait complete. 2024-09-12T01:48:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:30 smithi039 ceph-mon[31204]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:48:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:30 smithi039 ceph-mon[31204]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:30 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:48:31.550 INFO:tasks.cephadm:Adding mon.a on smithi039 2024-09-12T01:48:31.550 INFO:tasks.cephadm:Adding mon.b on smithi044 2024-09-12T01:48:31.550 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-09-12T01:48:31.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c' 2024-09-12T01:48:31.797 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:48:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:48:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:48:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:32.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:32.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:32.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:32.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:32.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:32.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 -- 172.21.15.172:0/782051599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 msgr2=0x7fab201008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 --2- 172.21.15.172:0/782051599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab201008e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab18009880 tx=0x7fab1802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 -- 172.21.15.172:0/782051599 shutdown_connections 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 --2- 172.21.15.172:0/782051599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab201008e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 -- 172.21.15.172:0/782051599 >> 172.21.15.172:0/782051599 conn(0x7fab200fbc90 msgr2=0x7fab200fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 -- 172.21.15.172:0/782051599 shutdown_connections 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.343+0000 7fab2878a640 1 -- 172.21.15.172:0/782051599 wait complete. 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab2878a640 1 Processor -- start 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab2878a640 1 -- start start 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab2878a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab2878a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fab201065f0 con 0x7fab201004e0 2024-09-12T01:48:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab26526640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab26526640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:49238/0 (socket says 172.21.15.172:49238) 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab26526640 1 -- 172.21.15.172:0/2365358962 learned_addr learned my addr 172.21.15.172:0/2365358962 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.344+0000 7fab26526640 1 -- 172.21.15.172:0/2365358962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab20199b40 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab26526640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab18009230 tx=0x7fab180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1803f070 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab18004d10 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab20199d10 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab18035030 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.345+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2019a0b0 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.346+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fab18042070 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.346+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab20106d70 con 0x7fab201004e0 2024-09-12T01:48:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.346+0000 7fab1f7fe640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 0x7fab0803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:32.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.346+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab1806cf30 con 0x7fab201004e0 2024-09-12T01:48:32.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.347+0000 7fab25d25640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 0x7fab0803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:32.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.347+0000 7fab25d25640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 0x7fab0803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab1400ad30 tx=0x7fab140093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:32.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.351+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab18042360 con 0x7fab201004e0 2024-09-12T01:48:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.538+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}) -- 0x7fab2002db40 con 0x7fab080390c0 2024-09-12T01:48:32.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.543+0000 7fab1f7fe640 1 -- 172.21.15.172:0/2365358962 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fab2002db40 con 0x7fab080390c0 2024-09-12T01:48:32.544 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 msgr2=0x7fab0803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 0x7fab0803b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab1400ad30 tx=0x7fab140093f0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 msgr2=0x7fab2006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab18009230 tx=0x7fab180048f0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 shutdown_connections 2024-09-12T01:48:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fab080390c0 0x7fab0803b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 --2- 172.21.15.172:0/2365358962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fab201004e0 0x7fab2006a950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:32.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 >> 172.21.15.172:0/2365358962 conn(0x7fab200fbc90 msgr2=0x7fab200fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:32.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 shutdown_connections 2024-09-12T01:48:32.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:32.546+0000 7fab2878a640 1 -- 172.21.15.172:0/2365358962 wait complete. 2024-09-12T01:48:33.090 DEBUG:teuthology.orchestra.run.smithi044:mon.b> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T01:48:33.093 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T01:48:33.095 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:48:33.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:48:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:33.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:34.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:33 smithi039 ceph-mon[31204]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:34.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:33 smithi039 ceph-mon[31204]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:48:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:33 smithi039 ceph-mon[31204]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:33 smithi039 ceph-mon[31204]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T01:48:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:33 smithi039 ceph-mon[31204]: Deploying daemon mon.c on smithi172 2024-09-12T01:48:34.221 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:35.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:34 smithi039 ceph-mon[31204]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/344078847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 msgr2=0x7f8b98102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/344078847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b98102b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009810 tx=0x7f8b9402a540 comp rx=0 tx=0).stop 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/344078847 shutdown_connections 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/344078847 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b98102b70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/344078847 >> 172.21.15.172:0/344078847 conn(0x7f8b98077310 msgr2=0x7f8b980fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/344078847 shutdown_connections 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.829+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/344078847 wait complete. 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9fd3b640 1 Processor -- start 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9fd3b640 1 -- start start 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9fd3b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9fd3b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9810bc80 con 0x7f8b98102790 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9dad7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9dad7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:42480/0 (socket says 172.21.15.172:42480) 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.830+0000 7f8b9dad7640 1 -- 172.21.15.172:0/2775247291 learned_addr learned my addr 172.21.15.172:0/2775247291 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b9dad7640 1 -- 172.21.15.172:0/2775247291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98197720 con 0x7f8b98102790 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b9dad7640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b940045e0 tx=0x7f8b94004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b94030e70 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b940318e0 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b981979b0 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b940049c0 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.831+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b98197e10 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.832+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8b94039040 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.832+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b98069f30 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.832+0000 7f8b8effd640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 0x7f8b8403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.832+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8b9406d430 con 0x7f8b98102790 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.833+0000 7f8b9d2d6640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 0x7f8b8403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.833+0000 7f8b9d2d6640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 0x7f8b8403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b880098c0 tx=0x7f8b88006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:35.837+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b94040030 con 0x7f8b98102790 2024-09-12T01:48:36.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.099+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8b98198540 con 0x7f8b98102790 2024-09-12T01:48:36.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.100+0000 7f8b8effd640 1 -- 172.21.15.172:0/2775247291 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8b9403bdf0 con 0x7f8b98102790 2024-09-12T01:48:36.101 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:48:36.101 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:47:03.680293Z","created":"2024-09-12T01:47:03.680293Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:48:36.101 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-12T01:48:36.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 msgr2=0x7f8b8403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 0x7f8b8403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8b880098c0 tx=0x7f8b88006db0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 msgr2=0x7f8b981971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b940045e0 tx=0x7f8b94004610 comp rx=0 tx=0).stop 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 shutdown_connections 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b84039060 0x7f8b8403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 --2- 172.21.15.172:0/2775247291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b98102790 0x7f8b981971e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 >> 172.21.15.172:0/2775247291 conn(0x7f8b98077310 msgr2=0x7f8b98103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 shutdown_connections 2024-09-12T01:48:36.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:36.104+0000 7f8b9fd3b640 1 -- 172.21.15.172:0/2775247291 wait complete. 2024-09-12T01:48:36.434 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:36 smithi172 systemd[1]: Starting Ceph mon.c for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:48:37.235 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:36 smithi172 podman[35054]: 2024-09-12 01:48:36.985124158 +0000 UTC m=+0.109957748 container create ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T01:48:37.235 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:36 smithi172 podman[35054]: 2024-09-12 01:48:36.891225465 +0000 UTC m=+0.016059013 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:48:37.235 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 podman[35054]: 2024-09-12 01:48:37.210861484 +0000 UTC m=+0.335695033 container init ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:48:37.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 podman[35054]: 2024-09-12 01:48:37.214048353 +0000 UTC m=+0.338881904 container start ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:48:37.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:48:37.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:48:37.236 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: pidfile_write: ignore empty --pid-file 2024-09-12T01:48:37.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:36 smithi039 ceph-mon[31204]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:37.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:36 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/2775247291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: load: jerasure load: lrc 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Git sha 0 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: DB SUMMARY 2024-09-12T01:48:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: DB Session ID: 7YPM9GCIFSSX93T9Z83F 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:48:37.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.env: 0x5595627dd940 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.info_log: 0x559564dbd6e0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.statistics: (nil) 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.use_fsync: 0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:48:37.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.db_log_dir: 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.wal_dir: 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:48:37.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.write_buffer_manager: 0x559564dccdc0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.unordered_write: 0 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:48:37.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.row_cache: None 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.wal_filter: None 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.wal_compression: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:48:37.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:48:37.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:48:37.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:48:37.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:48:37.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:48:37.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:48:37.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_open_files: -1 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Compression algorithms supported: 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kZSTD supported: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:48:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.merge_operator: 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_filter: None 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:48:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559564dbd320) 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_type: 0 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_index_type: 0 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_shortening: 1 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: checksum: 4 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: no_block_cache: 0 2024-09-12T01:48:37.515 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache: 0x559564db11f0 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_options: 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: capacity : 536870912 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_shard_bits : 4 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: strict_capacity_limit : 0 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_compressed: (nil) 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: persistent_cache: (nil) 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size: 4096 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size_deviation: 10 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_restart_interval: 16 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_block_restart_interval: 1 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: metadata_block_size: 4096 2024-09-12T01:48:37.516 INFO:journalctl@ceph.mon.c.smithi172.stdout: partition_filters: 0 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: use_delta_encoding: 1 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: filter_policy: bloomfilter 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: whole_key_filtering: 1 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: verify_compression: 0 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: format_version: 5 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_index_compression: 1 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_align: 0 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: prepopulate_block_cache: 0 2024-09-12T01:48:37.517 INFO:journalctl@ceph.mon.c.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression: NoCompression 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.num_levels: 7 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:48:37.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:37.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:48:37.520 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:48:37.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:48:37.522 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.ttl: 2592000 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:48:37.523 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e1c67598-2ebd-4ef1-bbec-9a6d5e63230c 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105717241014, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T01:48:37.524 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105717241417, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105717, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e1c67598-2ebd-4ef1-bbec-9a6d5e63230c", "db_session_id": "7YPM9GCIFSSX93T9Z83F", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105717241509, "job": 1, "event": "recovery_finished"} 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559564ddee00 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: DB pointer 0x559564eda000 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** DB Stats ** 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:37.525 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:37.526 INFO:journalctl@ceph.mon.c.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.527 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:48:37.528 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache BinnedLRUCache@0x559564db11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: starting mon.c rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:37.529 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(???) e0 preinit fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout: e1 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout: btime 2024-09-12T01:47:06:646574+0000 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:48:37.530 INFO:journalctl@ceph.mon.c.smithi172.stdout: legacy client fscid: -1 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout: No filesystems configured 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T01:48:37.531 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:37.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:48:37.533 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:37.534 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.535 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:37.536 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:37.537 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: Deploying daemon mon.c on smithi172 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/2775247291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 ceph-mon[35073]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T01:48:37.538 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 bash[35054]: ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 2024-09-12T01:48:37.539 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:37 smithi172 systemd[1]: Started Ceph mon.c for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:37.751 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:48:37.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:48:38.001 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: mon.a calling monitor election 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: mon.c calling monitor election 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: monmap epoch 2 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: last_changed 2024-09-12T01:48:37.268099+0000 2024-09-12T01:48:42.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: min_mon_release 19 (squid) 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: election_strategy: 1 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: fsmap 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: mgrmap e13: x(active, since 39s) 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: overall HEALTH_OK 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:42.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: mon.a calling monitor election 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: mon.c calling monitor election 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: monmap epoch 2 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: last_changed 2024-09-12T01:48:37.268099+0000 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: min_mon_release 19 (squid) 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: election_strategy: 1 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: fsmap 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: mgrmap e13: x(active, since 39s) 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: overall HEALTH_OK 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:42.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 -- 172.21.15.172:0/4095106235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8828102840 msgr2=0x7f8814005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:42.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 --2- 172.21.15.172:0/4095106235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8828102840 0x7f8814005580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8824012c60 tx=0x7f882402c620 comp rx=0 tx=0).stop 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 -- 172.21.15.172:0/4095106235 shutdown_connections 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 --2- 172.21.15.172:0/4095106235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8828102840 0x7f8814005580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 -- 172.21.15.172:0/4095106235 >> 172.21.15.172:0/4095106235 conn(0x7f88280fc280 msgr2=0x7f88280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 -- 172.21.15.172:0/4095106235 shutdown_connections 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.800+0000 7f882f725640 1 -- 172.21.15.172:0/4095106235 wait complete. 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.801+0000 7f882f725640 1 Processor -- start 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.801+0000 7f882f725640 1 -- start start 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882f725640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882f725640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 0x7f882819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882f725640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f88281097a0 con 0x7f88281977a0 2024-09-12T01:48:42.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882f725640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8828109620 con 0x7f8828102840 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45632/0 (socket says 172.21.15.172:45632) 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 -- 172.21.15.172:0/1307503615 learned_addr learned my addr 172.21.15.172:0/1307503615 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882ccc0640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 0x7f882819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 -- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 msgr2=0x7f8828197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 -- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 msgr2=0x7f8828197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:48:42.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882d4c1640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882ccc0640 1 -- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 msgr2=0x7f8828197260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882ccc0640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.802+0000 7f882ccc0640 1 -- 172.21.15.172:0/1307503615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8828197dc0 con 0x7f88281977a0 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f882ccc0640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 0x7f882819bb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f881800b3d0 tx=0x7f881800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8818011630 con 0x7f88281977a0 2024-09-12T01:48:42.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8818011cb0 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882819c070 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8818010df0 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.803+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882819c5b0 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.804+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8818018020 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.804+0000 7f881e7fc640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 0x7f880c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.804+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f881804bcc0 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.804+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882806a4f0 con 0x7f88281977a0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.805+0000 7f882d4c1640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 0x7f880c03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:42.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.805+0000 7f882d4c1640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 0x7f880c03b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8824035040 tx=0x7f8824033660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:42.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:42.810+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f881801f020 con 0x7f88281977a0 2024-09-12T01:48:43.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.045+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f882819c8f0 con 0x7f88281977a0 2024-09-12T01:48:43.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.045+0000 7f881e7fc640 1 -- 172.21.15.172:0/1307503615 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f8818017500 con 0x7f88281977a0 2024-09-12T01:48:43.046 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:48:43.046 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:48:37.268099Z","created":"2024-09-12T01:47:03.680293Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:48:43.046 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-12T01:48:43.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 msgr2=0x7f880c03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:43.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 0x7f880c03b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8824035040 tx=0x7f8824033660 comp rx=0 tx=0).stop 2024-09-12T01:48:43.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 msgr2=0x7f882819bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 0x7f882819bb30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f881800b3d0 tx=0x7f881800b890 comp rx=0 tx=0).stop 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 shutdown_connections 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88281977a0 0x7f882819bb30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f880c038e00 0x7f880c03b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 --2- 172.21.15.172:0/1307503615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828102840 0x7f8828197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 >> 172.21.15.172:0/1307503615 conn(0x7f88280fc280 msgr2=0x7f88280fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 shutdown_connections 2024-09-12T01:48:43.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:43.048+0000 7f882f725640 1 -- 172.21.15.172:0/1307503615 wait complete. 2024-09-12T01:48:43.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:43 smithi039 ceph-mon[31204]: Deploying daemon mon.b on smithi044 2024-09-12T01:48:43.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:43 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/1307503615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:43.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:43.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:43 smithi172 ceph-mon[35073]: Deploying daemon mon.b on smithi044 2024-09-12T01:48:43.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:43 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/1307503615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:43.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:44.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:44 smithi039 ceph-mon[31204]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:44.695 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:48:44.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:48:44.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:44 smithi172 ceph-mon[35073]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:44.944 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 -- 172.21.15.172:0/3873330958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 msgr2=0x7f55bc1009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 --2- 172.21.15.172:0/3873330958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc1009e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009880 tx=0x7f55ac02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 -- 172.21.15.172:0/3873330958 shutdown_connections 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 --2- 172.21.15.172:0/3873330958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc1009e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 -- 172.21.15.172:0/3873330958 >> 172.21.15.172:0/3873330958 conn(0x7f55bc0fc0c0 msgr2=0x7f55bc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 -- 172.21.15.172:0/3873330958 shutdown_connections 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.344+0000 7f55c11a2640 1 -- 172.21.15.172:0/3873330958 wait complete. 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 Processor -- start 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 -- start start 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10aa50 con 0x7f55bc100600 2024-09-12T01:48:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.345+0000 7f55c11a2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10a8d0 con 0x7f55bc196660 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33610/0 (socket says 172.21.15.172:33610) 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 -- 172.21.15.172:0/998935150 learned_addr learned my addr 172.21.15.172:0/998935150 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 -- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 msgr2=0x7f55bc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 -- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 msgr2=0x7f55bc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bb7fe640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bbfff640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bbfff640 1 -- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 msgr2=0x7f55bc19a9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bbfff640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bbfff640 1 -- 172.21.15.172:0/998935150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc196c80 con 0x7f55bc100600 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55bbfff640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc196120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55ac006010 tx=0x7f55ac032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f55ac035070 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55ac032e40 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc19af30 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.346+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f55ac03bb50 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.347+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc19b470 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.347+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f55ac042030 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.347+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc101ae0 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.348+0000 7f55b97fa640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 0x7f55a403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.348+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55ac040070 con 0x7f55bc100600 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.348+0000 7f55bb7fe640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 0x7f55a403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.348+0000 7f55bb7fe640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 0x7f55a403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009100 tx=0x7f55b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.353+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55ac04a260 con 0x7f55bc100600 2024-09-12T01:48:45.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.584+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f55bc19b720 con 0x7f55bc100600 2024-09-12T01:48:45.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.585+0000 7f55b97fa640 1 -- 172.21.15.172:0/998935150 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f55ac03b460 con 0x7f55bc100600 2024-09-12T01:48:45.585 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:48:45.585 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:48:37.268099Z","created":"2024-09-12T01:47:03.680293Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:48:45.586 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-12T01:48:45.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 msgr2=0x7f55a403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 0x7f55a403b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009100 tx=0x7f55b0008040 comp rx=0 tx=0).stop 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 msgr2=0x7f55bc196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc196120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55ac006010 tx=0x7f55ac032c50 comp rx=0 tx=0).stop 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 shutdown_connections 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55a4038e00 0x7f55a403b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc196660 0x7f55bc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 --2- 172.21.15.172:0/998935150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f55bc100600 0x7f55bc196120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 >> 172.21.15.172:0/998935150 conn(0x7f55bc0fc0c0 msgr2=0x7f55bc108100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 shutdown_connections 2024-09-12T01:48:45.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:45.587+0000 7f55c11a2640 1 -- 172.21.15.172:0/998935150 wait complete. 2024-09-12T01:48:45.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:45 smithi044 podman[35240]: 2024-09-12 01:48:45.733367589 +0000 UTC m=+0.015989404 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:48:46.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 podman[35240]: 2024-09-12 01:48:46.052868991 +0000 UTC m=+0.335490791 container init c3ad14bb4e9aee1e08924a417f38d777a121620a4e177f928f45ae81d14b6bcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T01:48:46.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 podman[35240]: 2024-09-12 01:48:46.056108176 +0000 UTC m=+0.338729976 container start c3ad14bb4e9aee1e08924a417f38d777a121620a4e177f928f45ae81d14b6bcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:48:46.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:48:46.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:48:46.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pidfile_write: ignore empty --pid-file 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: load: jerasure load: lrc 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Git sha 0 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: DB SUMMARY 2024-09-12T01:48:46.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: DB Session ID: NGTL811SX8IOSWFOKG0M 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:48:46.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.env: 0x5570bb400940 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.info_log: 0x5570bcd1b6e0 2024-09-12T01:48:46.427 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:48:46.430 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.statistics: (nil) 2024-09-12T01:48:46.430 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.use_fsync: 0 2024-09-12T01:48:46.430 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:48:46.431 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:48:46.431 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:48:46.431 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:48:46.431 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:48:46.431 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.db_log_dir: 2024-09-12T01:48:46.432 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.wal_dir: 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.write_buffer_manager: 0x5570bcd2adc0 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:48:46.433 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.unordered_write: 0 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.row_cache: None 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.wal_filter: None 2024-09-12T01:48:46.434 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.wal_compression: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:48:46.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:48:46.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_open_files: -1 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Compression algorithms supported: 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kZSTD supported: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:48:46.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.merge_operator: 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_filter: None 2024-09-12T01:48:46.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570bcd1b320) 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_type: 0 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_index_type: 0 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_shortening: 1 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: checksum: 4 2024-09-12T01:48:46.439 INFO:journalctl@ceph.mon.b.smithi044.stdout: no_block_cache: 0 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache: 0x5570bcd0f1f0 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_options: 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: capacity : 536870912 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_shard_bits : 4 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: strict_capacity_limit : 0 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_compressed: (nil) 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: persistent_cache: (nil) 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size: 4096 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size_deviation: 10 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_restart_interval: 16 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_block_restart_interval: 1 2024-09-12T01:48:46.440 INFO:journalctl@ceph.mon.b.smithi044.stdout: metadata_block_size: 4096 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: partition_filters: 0 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: use_delta_encoding: 1 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: filter_policy: bloomfilter 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: whole_key_filtering: 1 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: verify_compression: 0 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: format_version: 5 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_index_compression: 1 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_align: 0 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: max_auto_readahead_size: 262144 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: prepopulate_block_cache: 0 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:48:46.441 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression: NoCompression 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.num_levels: 7 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:48:46.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:48:46.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:48:46.444 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:48:46.445 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:48:46.446 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:48:46.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:48:46.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:48:46.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:48:46.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:48:46.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:48:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.ttl: 2592000 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:48:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T01:48:46.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 663ddaef-5411-469e-be1f-a544c84fb999 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105726083519, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105726083942, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105726, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "663ddaef-5411-469e-be1f-a544c84fb999", "db_session_id": "NGTL811SX8IOSWFOKG0M", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105726084034, "job": 1, "event": "recovery_finished"} 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T01:48:46.451 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:48:46.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5570bcd3ce00 2024-09-12T01:48:46.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: DB pointer 0x5570bce38000 2024-09-12T01:48:46.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:48:46.452 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:48:46.452 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** DB Stats ** 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:48:46.453 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.454 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:46.455 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache BinnedLRUCache@0x5570bcd0f1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: using public_addr v2:172.21.15.44:0/0 -> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: starting mon.b rank -1 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(???) e0 preinit fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:46.456 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).mds e1 new map 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: e1 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: btime 2024-09-12T01:47:06:646574+0000 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: legacy client fscid: -1 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout: No filesystems configured 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T01:48:46.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3392227120' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:46.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.459 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:46.460 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Updating smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T01:48:46.461 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Deploying daemon mon.c on smithi172 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/2775247291' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:46.462 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.a calling monitor election 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.c calling monitor election 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.463 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.464 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.464 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.464 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:46.464 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: monmap epoch 2 2024-09-12T01:48:46.464 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: last_changed 2024-09-12T01:48:37.268099+0000 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: min_mon_release 19 (squid) 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: election_strategy: 1 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:46.465 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: fsmap 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mgrmap e13: x(active, since 39s) 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: overall HEALTH_OK 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.466 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: Deploying daemon mon.b on smithi044 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/1307503615' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:46.467 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:46.468 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:46.468 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 ceph-mon[35259]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T01:48:46.468 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 bash[35240]: c3ad14bb4e9aee1e08924a417f38d777a121620a4e177f928f45ae81d14b6bcf 2024-09-12T01:48:46.468 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:46 smithi044 systemd[1]: Started Ceph mon.b for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:48:47.254 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:48:47.255 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:48:47.507 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.493+0000 7ff17232d640 1 -- 172.21.15.172:0/2557074481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff158005740 msgr2=0x7ff158007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.493+0000 7ff17232d640 1 --2- 172.21.15.172:0/2557074481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff158005740 0x7ff158007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff16c1016c0 tx=0x7ff15c02c3f0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.493+0000 7ff17232d640 1 -- 172.21.15.172:0/2557074481 shutdown_connections 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.493+0000 7ff17232d640 1 --2- 172.21.15.172:0/2557074481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff158005740 0x7ff158007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.493+0000 7ff17232d640 1 -- 172.21.15.172:0/2557074481 >> 172.21.15.172:0/2557074481 conn(0x7ff16c0fc280 msgr2=0x7ff16c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.494+0000 7ff17232d640 1 -- 172.21.15.172:0/2557074481 shutdown_connections 2024-09-12T01:48:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.494+0000 7ff17232d640 1 -- 172.21.15.172:0/2557074481 wait complete. 2024-09-12T01:48:51.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.494+0000 7ff17232d640 1 Processor -- start 2024-09-12T01:48:51.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.494+0000 7ff17232d640 1 -- start start 2024-09-12T01:48:51.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: mon.a calling monitor election 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: mon.c calling monitor election 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.496 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: monmap epoch 3 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: min_mon_release 19 (squid) 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: election_strategy: 1 2024-09-12T01:48:51.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: fsmap 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: mgrmap e13: x(active, since 47s) 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: overall HEALTH_OK 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:51.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 0x7ff16c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c1075c0 con 0x7ff16c199ee0 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c107440 con 0x7ff16c195610 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff17232d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c107740 con 0x7ff158005740 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33612/0 (socket says 172.21.15.172:33612) 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 -- 172.21.15.172:0/1104295921 learned_addr learned my addr 172.21.15.172:0/1104295921 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff163fff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 msgr2=0x7ff16c1950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 msgr2=0x7ff16c1950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 0x7ff16c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff16bfff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:51.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff163fff640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 msgr2=0x7ff16c1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff163fff640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 msgr2=0x7ff16c1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff163fff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff163fff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 msgr2=0x7ff16c1950d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 msgr2=0x7ff16c1999a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.495+0000 7ff1708ca640 1 -- 172.21.15.172:0/1104295921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16c1a1c50 con 0x7ff16c199ee0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff1708ca640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 0x7ff16c19a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff16400bd50 tx=0x7ff16400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164019070 con 0x7ff16c199ee0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff164014920 con 0x7ff16c199ee0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164012990 con 0x7ff16c199ee0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16c1a1e80 con 0x7ff16c199ee0 2024-09-12T01:48:51.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.496+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16c1a2360 con 0x7ff16c199ee0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.497+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff16401c070 con 0x7ff16c199ee0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.497+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16c108650 con 0x7ff16c199ee0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.497+0000 7ff169ffb640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 0x7ff14c03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.497+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff16404be80 con 0x7ff16c199ee0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.498+0000 7ff16bfff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 0x7ff14c03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.498+0000 7ff16bfff640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 0x7ff14c03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff15c005fd0 tx=0x7ff15c005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:51.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.503+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff164013e60 con 0x7ff16c199ee0 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: mon.a calling monitor election 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: mon.c calling monitor election 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:51.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: monmap epoch 3 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: min_mon_release 19 (squid) 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: election_strategy: 1 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:51.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: fsmap 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: mgrmap e13: x(active, since 47s) 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: overall HEALTH_OK 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:51.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.753+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff16c1a27b0 con 0x7ff16c199ee0 2024-09-12T01:48:51.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.753+0000 7ff169ffb640 1 -- 172.21.15.172:0/1104295921 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7ff16400e090 con 0x7ff16c199ee0 2024-09-12T01:48:51.754 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:48:51.755 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:48:46.108726Z","created":"2024-09-12T01:47:03.680293Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:48:51.755 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-09-12T01:48:51.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 msgr2=0x7ff14c03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 0x7ff14c03b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff15c005fd0 tx=0x7ff15c005f60 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 msgr2=0x7ff16c19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 0x7ff16c19a390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff16400bd50 tx=0x7ff16400be40 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 shutdown_connections 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff16c199ee0 0x7ff16c19a390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff16c195610 0x7ff16c1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff14c0394f0 0x7ff14c03b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 --2- 172.21.15.172:0/1104295921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff158005740 0x7ff16c1950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 >> 172.21.15.172:0/1104295921 conn(0x7ff16c0fc280 msgr2=0x7ff16c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 shutdown_connections 2024-09-12T01:48:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:51.756+0000 7ff17232d640 1 -- 172.21.15.172:0/1104295921 wait complete. 2024-09-12T01:48:52.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:52 smithi172 ceph-mon[35073]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:52.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:52.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:52 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/1104295921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:52.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:52.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:52 smithi039 ceph-mon[31204]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:52.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:52.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:52 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/1104295921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:52.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:52.881 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:48:52.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:48:53.145 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.a calling monitor election 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.c calling monitor election 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: monmap epoch 3 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: min_mon_release 19 (squid) 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: election_strategy: 1 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: fsmap 2024-09-12T01:48:53.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mgrmap e13: x(active, since 47s) 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: overall HEALTH_OK 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/1104295921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:48:53.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:54.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mon.b calling monitor election 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: Reconfiguring daemon mon.a on smithi039 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mon.b calling monitor election 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mon.c calling monitor election 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mon.a calling monitor election 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: monmap epoch 3 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: min_mon_release 19 (squid) 2024-09-12T01:48:54.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: election_strategy: 1 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: fsmap 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: mgrmap e13: x(active, since 49s) 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: overall HEALTH_OK 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:54.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:53 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:54.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.b calling monitor election 2024-09-12T01:48:54.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: Reconfiguring daemon mon.a on smithi039 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.b calling monitor election 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.c calling monitor election 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.a calling monitor election 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: monmap epoch 3 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: min_mon_release 19 (squid) 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: election_strategy: 1 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: fsmap 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: mgrmap e13: x(active, since 49s) 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: overall HEALTH_OK 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:54.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:54.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mon.b calling monitor election 2024-09-12T01:48:54.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: Reconfiguring daemon mon.a on smithi039 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mon.b calling monitor election 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mon.c calling monitor election 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mon.a calling monitor election 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: monmap epoch 3 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: last_changed 2024-09-12T01:48:46.108726+0000 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: created 2024-09-12T01:47:03.680293+0000 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: min_mon_release 19 (squid) 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: election_strategy: 1 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T01:48:54.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: fsmap 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: mgrmap e13: x(active, since 49s) 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: overall HEALTH_OK 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:54.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:53 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 -- 172.21.15.39:0/2077121862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 msgr2=0x7f88e0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 --2- 172.21.15.39:0/2077121862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009810 tx=0x7f88d002a540 comp rx=0 tx=0).stop 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 -- 172.21.15.39:0/2077121862 shutdown_connections 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 --2- 172.21.15.39:0/2077121862 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 -- 172.21.15.39:0/2077121862 >> 172.21.15.39:0/2077121862 conn(0x7f88e0077310 msgr2=0x7f88e00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 -- 172.21.15.39:0/2077121862 shutdown_connections 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.655+0000 7f88e5138640 1 -- 172.21.15.39:0/2077121862 wait complete. 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 Processor -- start 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 -- start start 2024-09-12T01:48:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88e0197850 0x7f88e019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 0x7f88e019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010ab70 con 0x7f88e0106540 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010a9f0 con 0x7f88e0197850 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88e5138640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88e010acf0 con 0x7f88e019c120 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.656+0000 7f88ded9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45298/0 (socket says 172.21.15.39:45298) 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 -- 172.21.15.39:0/2665511286 learned_addr learned my addr 172.21.15.39:0/2665511286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88df59e640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 0x7f88e019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88de59c640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88e0197850 0x7f88e019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 -- 172.21.15.39:0/2665511286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 msgr2=0x7f88e019c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 0x7f88e019c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 -- 172.21.15.39:0/2665511286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88e0197850 msgr2=0x7f88e019bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88e0197850 0x7f88e019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 -- 172.21.15.39:0/2665511286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e01a3e90 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88df59e640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 0x7f88e019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88ded9d640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88d0005040 tx=0x7f88d0005070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0040070 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d00056a0 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e01a4060 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0045460 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.657+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e01a45e0 con 0x7f88e0106540 2024-09-12T01:48:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.658+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f88d0039040 con 0x7f88e0106540 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.658+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e0106920 con 0x7f88e0106540 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.658+0000 7f88c7fff640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 0x7f88c803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.658+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f88d006d450 con 0x7f88e0106540 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.659+0000 7f88de59c640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 0x7f88c803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.659+0000 7f88de59c640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 0x7f88c803b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f88d4006fd0 tx=0x7f88d4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:54.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.663+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88d004dbd0 con 0x7f88e0106540 2024-09-12T01:48:54.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.847+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f88e01a4960 con 0x7f88e0106540 2024-09-12T01:48:54.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.847+0000 7f88c7fff640 1 -- 172.21.15.39:0/2665511286 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f88d003a3b0 con 0x7f88e0106540 2024-09-12T01:48:54.848 INFO:teuthology.orchestra.run.smithi039.stdout:# minimal ceph.conf for d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:54.849 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-09-12T01:48:54.849 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:48:54.849 INFO:teuthology.orchestra.run.smithi039.stdout: mon_host = [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-12T01:48:54.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 msgr2=0x7f88c803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:54.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 0x7f88c803b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f88d4006fd0 tx=0x7f88d4008040 comp rx=0 tx=0).stop 2024-09-12T01:48:54.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 msgr2=0x7f88e0197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88d0005040 tx=0x7f88d0005070 comp rx=0 tx=0).stop 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 shutdown_connections 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88c80394f0 0x7f88c803b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88e019c120 0x7f88e019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88e0197850 0x7f88e019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 --2- 172.21.15.39:0/2665511286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88e0106540 0x7f88e0197310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.849+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 >> 172.21.15.39:0/2665511286 conn(0x7f88e0077310 msgr2=0x7f88e0104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.850+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 shutdown_connections 2024-09-12T01:48:54.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:48:54.850+0000 7f88e5138640 1 -- 172.21.15.39:0/2665511286 wait complete. 2024-09-12T01:48:55.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:55.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:48:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: Reconfiguring daemon mon.b on smithi044 2024-09-12T01:48:55.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:54 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2665511286' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: Reconfiguring daemon mon.b on smithi044 2024-09-12T01:48:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:54 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2665511286' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: Reconfiguring daemon mon.b on smithi044 2024-09-12T01:48:55.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:54 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2665511286' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.512 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:48:55.513 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:55.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:48:55.544 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:55.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:55.613 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:48:55.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:48:55.641 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:48:55.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:55.706 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:48:55.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:48:55.738 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:48:55.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:48:55.807 INFO:tasks.cephadm:Adding mgr.x on smithi039 2024-09-12T01:48:55.807 INFO:tasks.cephadm:Adding mgr.y on smithi044 2024-09-12T01:48:55.807 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-09-12T01:48:55.807 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi039=x;smithi044=y;smithi172=z' 2024-09-12T01:48:56.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:55 smithi172 ceph-mon[35073]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:56.093 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:56.105 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:55 smithi044 ceph-mon[35259]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:56.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:55 smithi039 ceph-mon[31204]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 -- 172.21.15.172:0/2495427811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 msgr2=0x7efe24101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 --2- 172.21.15.172:0/2495427811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe14009880 tx=0x7efe1402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 -- 172.21.15.172:0/2495427811 shutdown_connections 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 --2- 172.21.15.172:0/2495427811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 -- 172.21.15.172:0/2495427811 >> 172.21.15.172:0/2495427811 conn(0x7efe240fce90 msgr2=0x7efe240ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 -- 172.21.15.172:0/2495427811 shutdown_connections 2024-09-12T01:48:56.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.563+0000 7efe29741640 1 -- 172.21.15.172:0/2495427811 wait complete. 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 Processor -- start 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 -- start start 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe240745e0 0x7efe24074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efe241077f0 con 0x7efe241016e0 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe24107670 con 0x7efe240745e0 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe29741640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe24107970 con 0x7efe24074fa0 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44846/0 (socket says 172.21.15.172:44846) 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe237fe640 1 -- 172.21.15.172:0/1313120866 learned_addr learned my addr 172.21.15.172:0/1313120866 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:48:56.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe22ffd640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.564+0000 7efe1a7fc640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe240745e0 0x7efe24074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 -- 172.21.15.172:0/1313120866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe240745e0 msgr2=0x7efe24074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe240745e0 0x7efe24074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 -- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 msgr2=0x7efe24075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 -- 172.21.15.172:0/1313120866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241a15b0 con 0x7efe24074fa0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe237fe640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ba50 tx=0x7efe1c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c019070 con 0x7efe24074fa0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe1c00cbe0 con 0x7efe24074fa0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241a18a0 con 0x7efe24074fa0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0076a0 con 0x7efe24074fa0 2024-09-12T01:48:56.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.565+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241a1e60 con 0x7efe24074fa0 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.566+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efe1c01c070 con 0x7efe24074fa0 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.566+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe241905b0 con 0x7efe24074fa0 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.566+0000 7efe20ff9640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 0x7efe1003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.566+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efe1c04ba60 con 0x7efe24074fa0 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.566+0000 7efe22ffd640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 0x7efe1003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:56.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.567+0000 7efe22ffd640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 0x7efe1003b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe14005ab0 tx=0x7efe140315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:56.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.571+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe1c0112a0 con 0x7efe24074fa0 2024-09-12T01:48:56.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.756+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}) -- 0x7efe240626c0 con 0x7efe100394f0 2024-09-12T01:48:56.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.766+0000 7efe20ff9640 1 -- 172.21.15.172:0/1313120866 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efe240626c0 con 0x7efe100394f0 2024-09-12T01:48:56.767 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 msgr2=0x7efe1003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 0x7efe1003b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe14005ab0 tx=0x7efe140315d0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 msgr2=0x7efe241a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ba50 tx=0x7efe1c00bf10 comp rx=0 tx=0).stop 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 shutdown_connections 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efe100394f0 0x7efe1003b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe24074fa0 0x7efe241a1020 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe240745e0 0x7efe24074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 --2- 172.21.15.172:0/1313120866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efe241016e0 0x7efe24075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:56.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.768+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 >> 172.21.15.172:0/1313120866 conn(0x7efe240fce90 msgr2=0x7efe240fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:56.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.769+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 shutdown_connections 2024-09-12T01:48:56.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:48:56.769+0000 7efe29741640 1 -- 172.21.15.172:0/1313120866 wait complete. 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: Reconfiguring daemon mon.c on smithi172 2024-09-12T01:48:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T01:48:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: Reconfiguring daemon mon.c on smithi172 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T01:48:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: Reconfiguring daemon mon.c on smithi172 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T01:48:57.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:58.226 DEBUG:teuthology.orchestra.run.smithi044:mgr.y> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T01:48:58.229 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T01:48:58.231 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:48:58.231 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:48:58.231 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:48:58.251 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:48:58.252 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 01:48:12.560562770 +0000 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 01:44:02.977715933 +0000 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 01:44:02.977715933 +0000 2024-09-12T01:48:58.311 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 01:44:02.977715933 +0000 2024-09-12T01:48:58.312 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:48:58.379 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T01:48:58.379 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T01:48:58.380 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000309016 s, 1.7 MB/s 2024-09-12T01:48:58.381 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:48:58.441 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-12T01:48:58.500 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:48:58.500 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 01:48:12.593562126 +0000 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 01:44:03.305709533 +0000 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 01:44:03.305709533 +0000 2024-09-12T01:48:58.501 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 01:44:03.305709533 +0000 2024-09-12T01:48:58.502 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:48:58.568 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T01:48:58.568 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T01:48:58.568 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000283668 s, 1.8 MB/s 2024-09-12T01:48:58.570 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:48:58.629 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-12T01:48:58.686 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:48:58.686 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:58.686 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 01:48:12.625561502 +0000 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 01:44:03.642702957 +0000 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 01:44:03.642702957 +0000 2024-09-12T01:48:58.687 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 01:44:03.642702957 +0000 2024-09-12T01:48:58.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:48:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T01:48:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T01:48:58.754 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000379479 s, 1.3 MB/s 2024-09-12T01:48:58.756 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:48:58.815 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 01:48:12.654560937 +0000 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 01:44:03.982696322 +0000 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 01:44:03.982696322 +0000 2024-09-12T01:48:58.873 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 01:44:03.982696322 +0000 2024-09-12T01:48:58.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:48:58.938 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T01:48:58.938 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T01:48:58.938 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000307187 s, 1.7 MB/s 2024-09-12T01:48:58.940 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:48:58.997 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T01:48:58.997 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:48:59.017 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:48:59.017 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:59.075 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 01:48:45.535915802 +0000 2024-09-12T01:48:59.076 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 01:44:26.697873090 +0000 2024-09-12T01:48:59.076 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 01:44:26.697873090 +0000 2024-09-12T01:48:59.076 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 01:44:26.697873090 +0000 2024-09-12T01:48:59.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:48:59.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:59.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:48:58 smithi172 ceph-mon[35073]: Deploying daemon mgr.z on smithi172 2024-09-12T01:48:59.140 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:59.140 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.140 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:48:58 smithi044 ceph-mon[35259]: Deploying daemon mgr.z on smithi172 2024-09-12T01:48:59.142 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T01:48:59.143 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T01:48:59.143 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000217879 s, 2.3 MB/s 2024-09-12T01:48:59.144 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:48:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:48:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:48:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:59.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:59.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:48:58 smithi039 ceph-mon[31204]: Deploying daemon mgr.z on smithi172 2024-09-12T01:48:59.202 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:59.259 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 01:48:45.535915802 +0000 2024-09-12T01:48:59.260 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 01:44:27.040867785 +0000 2024-09-12T01:48:59.260 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 01:44:27.040867785 +0000 2024-09-12T01:48:59.260 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 01:44:27.040867785 +0000 2024-09-12T01:48:59.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:48:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T01:48:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T01:48:59.325 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00020787 s, 2.5 MB/s 2024-09-12T01:48:59.326 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:48:59.385 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-12T01:48:59.440 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:48:59.440 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:59.440 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 01:48:45.536915786 +0000 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 01:44:27.378862559 +0000 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 01:44:27.378862559 +0000 2024-09-12T01:48:59.441 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 01:44:27.378862559 +0000 2024-09-12T01:48:59.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:48:59.505 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T01:48:59.505 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T01:48:59.505 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000207913 s, 2.5 MB/s 2024-09-12T01:48:59.506 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:48:59.563 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 01:48:45.536915786 +0000 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 01:44:27.705857502 +0000 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 01:44:27.705857502 +0000 2024-09-12T01:48:59.620 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 01:44:27.705857502 +0000 2024-09-12T01:48:59.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:48:59.684 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T01:48:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T01:48:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000197164 s, 2.6 MB/s 2024-09-12T01:48:59.686 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:48:59.743 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T01:48:59.743 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:48:59.753 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:48:59 smithi172 systemd[1]: Starting Ceph mgr.z for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:48:59.760 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:48:59.761 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 01:48:59.496989974 +0000 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 01:44:13.488158172 +0000 2024-09-12T01:48:59.817 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 01:44:13.488158172 +0000 2024-09-12T01:48:59.818 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 01:44:13.488158172 +0000 2024-09-12T01:48:59.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:48:59.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T01:48:59.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T01:48:59.897 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.013285 s, 38.5 kB/s 2024-09-12T01:48:59.898 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:48:59.955 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-12T01:49:00.012 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:49:00.012 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:49:00.012 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 01:48:59.496989974 +0000 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 01:44:13.808150430 +0000 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 01:44:13.808150430 +0000 2024-09-12T01:49:00.013 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 01:44:13.808150430 +0000 2024-09-12T01:49:00.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:49:00.074 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:48:59 smithi172 podman[36637]: 2024-09-12 01:48:59.674622728 +0000 UTC m=+0.015651092 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:00.074 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:48:59 smithi172 podman[36637]: 2024-09-12 01:48:59.772679181 +0000 UTC m=+0.113707546 container create 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:49:00.074 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:48:59 smithi172 podman[36637]: 2024-09-12 01:48:59.983524552 +0000 UTC m=+0.324552918 container init 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:49:00.075 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:48:59 smithi172 podman[36637]: 2024-09-12 01:48:59.986718638 +0000 UTC m=+0.327747003 container start 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:49:00.075 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mgr[36724]: -- 172.21.15.172:0/1781301463 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55856a9150e0 con 0x55856a8f3400 2024-09-12T01:49:00.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T01:49:00.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T01:49:00.077 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000170845 s, 3.0 MB/s 2024-09-12T01:49:00.079 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:49:00.137 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-12T01:49:00.192 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:49:00.192 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 01:48:59.497989950 +0000 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 01:44:14.136142494 +0000 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 01:44:14.136142494 +0000 2024-09-12T01:49:00.193 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 01:44:14.136142494 +0000 2024-09-12T01:49:00.193 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:49:00.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T01:49:00.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T01:49:00.257 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00020854 s, 2.5 MB/s 2024-09-12T01:49:00.258 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:49:00.315 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-12T01:49:00.334 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 bash[36637]: 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 2024-09-12T01:49:00.334 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 systemd[1]: Started Ceph mgr.z for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:00.334 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.114+0000 7f14e8f94040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:49:00.334 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.177+0000 7f14e8f94040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:00.334 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.333+0000 7f14e8f94040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:49:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:49:00.349 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:49:00.349 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:49:00.349 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:49:00.349 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:49:00.350 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 01:48:59.497989950 +0000 2024-09-12T01:49:00.350 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 01:44:14.457134727 +0000 2024-09-12T01:49:00.350 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 01:44:14.457134727 +0000 2024-09-12T01:49:00.350 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 01:44:14.457134727 +0000 2024-09-12T01:49:00.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:49:00.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T01:49:00.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T01:49:00.413 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000193659 s, 2.6 MB/s 2024-09-12T01:49:00.414 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:49:00.470 INFO:tasks.cephadm:Deploying osd.0 on smithi039 with /dev/vg_nvme/lv_4... 2024-09-12T01:49:00.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:49:00.694 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.402+0000 7f14e8f94040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:49:00.694 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.555+0000 7f14e8f94040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:00.694 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:00.693+0000 7f14e8f94040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:49:00.733 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:00.908 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:00.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:01.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:01.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:01.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:01.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:01.503 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:01.013+0000 7f14e8f94040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:49:01.504 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:01.074+0000 7f14e8f94040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:49:01.504 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:01.258+0000 7f14e8f94040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:49:02.086 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:01 smithi039 ceph-mon[31204]: Deploying daemon mgr.y on smithi044 2024-09-12T01:49:02.150 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:01 smithi172 ceph-mon[35073]: Deploying daemon mgr.y on smithi044 2024-09-12T01:49:02.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:01 smithi044 ceph-mon[35259]: Deploying daemon mgr.y on smithi044 2024-09-12T01:49:02.174 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:01 smithi044 systemd[1]: Starting Ceph mgr.y for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:02.451 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 podman[36609]: 2024-09-12 01:49:02.093626062 +0000 UTC m=+0.015800957 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:02.564 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 podman[36609]: 2024-09-12 01:49:02.19775036 +0000 UTC m=+0.119925242 container create 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:02.564 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 podman[36609]: 2024-09-12 01:49:02.425165014 +0000 UTC m=+0.347339897 container init 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T01:49:02.564 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 podman[36609]: 2024-09-12 01:49:02.427749534 +0000 UTC m=+0.349924417 container start 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T01:49:02.565 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:02.150+0000 7f14e8f94040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:49:02.565 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:02.218+0000 7f14e8f94040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:49:02.771 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mgr[36628]: -- 172.21.15.44:0/2661743860 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56358a75f0e0 con 0x56358a73d000 2024-09-12T01:49:02.771 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 bash[36609]: 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 2024-09-12T01:49:02.771 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 systemd[1]: Started Ceph mgr.y for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:02.771 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:02.552+0000 7f56700f4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:49:02.772 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:02.614+0000 7f56700f4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:02.772 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:02.770+0000 7f56700f4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:02.968+0000 7f14e8f94040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.098+0000 7f14e8f94040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.099 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:03.167 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:02.841+0000 7f56700f4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:49:03.167 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:03.008+0000 7f56700f4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:03.167 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:03.166+0000 7f56700f4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:49:03.167 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:03.168 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.168 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.168 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.168 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:03.168 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:03.268 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:49:03.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2024-09-12T01:49:03.368 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.246+0000 7f14e8f94040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:03.368 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.311+0000 7f14e8f94040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:49:03.546 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:03.753 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.467+0000 7f14e8f94040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:49:03.753 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.537+0000 7f14e8f94040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:49:03.753 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.598+0000 7f14e8f94040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:49:03.771 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:03.508+0000 7f56700f4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:49:03.772 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:03.572+0000 7f56700f4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:49:03.772 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:03.771+0000 7f56700f4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:49:04.044 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.765+0000 7f14e8f94040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:49:04.044 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.831+0000 7f14e8f94040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:49:04.044 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.901+0000 7f14e8f94040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:49:04.044 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:03.983+0000 7f14e8f94040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:04.044 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:04.043+0000 7f14e8f94040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:49:04.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 -- 172.21.15.39:0/3809014525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 msgr2=0x7f0f60102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:04.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 --2- 172.21.15.39:0/3809014525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f60102150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009900 tx=0x7f0f5002a410 comp rx=0 tx=0).stop 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 -- 172.21.15.39:0/3809014525 shutdown_connections 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 --2- 172.21.15.39:0/3809014525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60102690 0x7f0f60108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 --2- 172.21.15.39:0/3809014525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f60102150 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 --2- 172.21.15.39:0/3809014525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60100ad0 0x7f0f60100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 -- 172.21.15.39:0/3809014525 >> 172.21.15.39:0/3809014525 conn(0x7f0f600fc280 msgr2=0x7f0f600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 -- 172.21.15.39:0/3809014525 shutdown_connections 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.071+0000 7f0f6806c640 1 -- 172.21.15.39:0/3809014525 wait complete. 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 Processor -- start 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 -- start start 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60102690 0x7f0f6019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:04.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6010c730 con 0x7f0f60101cd0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6010c5b0 con 0x7f0f60100ad0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f6806c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6010c8b0 con 0x7f0f60102690 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65e08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65e08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49848/0 (socket says 172.21.15.39:49848) 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44972/0 (socket says 172.21.15.39:44972) 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65e08640 1 -- 172.21.15.39:0/207292098 learned_addr learned my addr 172.21.15.39:0/207292098 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f66609640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60102690 0x7f0f6019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 -- 172.21.15.39:0/207292098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60102690 msgr2=0x7f0f6019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60102690 0x7f0f6019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 -- 172.21.15.39:0/207292098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 msgr2=0x7f0f6006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65607640 1 -- 172.21.15.39:0/207292098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6019fb70 con 0x7f0f60101cd0 2024-09-12T01:49:04.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.072+0000 7f0f65e08640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f65607640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f50031440 tx=0x7f0f500043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5003f070 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5003b460 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6019fda0 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50035070 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.073+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601a0270 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.074+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0f5003a620 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.074+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 0x7f0f4c03b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.074+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f5006ca40 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.074+0000 7f0f65e08640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 0x7f0f4c03b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.074+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f60107f20 con 0x7f0f60101cd0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.075+0000 7f0f65e08640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 0x7f0f4c03b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0104e0 tx=0x7f0f5c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:04.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.079+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f50041310 con 0x7f0f60101cd0 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.266 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:04 smithi039 ceph-mon[31204]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T01:49:04.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:04.290+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0f60062630 con 0x7f0f4c039290 2024-09-12T01:49:04.503 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:04.104+0000 7f14e8f94040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:49:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:04.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:04.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-mon[35073]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T01:49:04.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:04.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-mon[35259]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T01:49:05.173 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:04.693+0000 7f56700f4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:49:05.173 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:04 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:04.763+0000 7f56700f4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:49:05.214 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 01:49:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z[36699]: 2024-09-12T01:49:04.899+0000 7f14e8f94040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:49:05.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:05.219+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f0f5006cd10 con 0x7f0f60101cd0 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: Standby manager daemon z started 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:49:05.391 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:05.392 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:49:05.392 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:05 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:05.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:05.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:05.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:05.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:05.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: Standby manager daemon z started 2024-09-12T01:49:05.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:49:05.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:05.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:49:05.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:05 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:05.513 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: Standby manager daemon z started 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:49:05.514 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.172:0/2883999952' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:05.782 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:05.513+0000 7f56700f4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:49:05.782 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:05.633+0000 7f56700f4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:49:06.070 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:05.781+0000 7f56700f4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:49:06.070 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:05.844+0000 7f56700f4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:49:06.071 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:05.999+0000 7f56700f4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:49:06.071 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.069+0000 7f56700f4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:49:06.365 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.132+0000 7f56700f4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:49:06.365 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.297+0000 7f56700f4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.364+0000 7f56700f4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:06.366 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:06.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:06.589 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:06.590 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:06.590 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:06.642 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.433+0000 7f56700f4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:49:06.642 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.519+0000 7f56700f4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:49:06.643 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.581+0000 7f56700f4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:49:06.643 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:06.641+0000 7f56700f4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:49:07.923 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 01:49:07 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y[36624]: 2024-09-12T01:49:07.466+0000 7f56700f4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:49:08.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:08.229+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0f5003a910 con 0x7f0f60101cd0 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: Standby manager daemon y started 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]: dispatch 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]': finished 2024-09-12T01:49:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:49:08.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:08.505 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:08 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1154313263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: Standby manager daemon y started 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]': finished 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:08 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1154313263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: Standby manager daemon y started 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:49:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='mgr.? 172.21.15.44:0/3853445276' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:49:08.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]: dispatch 2024-09-12T01:49:08.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3528153864' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d18ca71-ba65-4f79-b839-a26243a98b0d"}]': finished 2024-09-12T01:49:08.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:49:08.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:08.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:08 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1154313263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:09.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:09 smithi172 ceph-mon[35073]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-12T01:49:09.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:49:09.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:09 smithi039 ceph-mon[31204]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-12T01:49:09.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:49:09.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:09 smithi044 ceph-mon[35259]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-12T01:49:09.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:49:10.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:10 smithi172 ceph-mon[35073]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:10.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:10 smithi039 ceph-mon[31204]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:10.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:10 smithi044 ceph-mon[35259]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:12.489 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:12 smithi044 ceph-mon[35259]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:12.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:12 smithi172 ceph-mon[35073]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:12.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:12 smithi039 ceph-mon[31204]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:14.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:14 smithi172 ceph-mon[35073]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:14.511 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:14 smithi039 ceph-mon[31204]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:14.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:14 smithi044 ceph-mon[35259]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:16 smithi039 ceph-mon[31204]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:49:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:16 smithi172 ceph-mon[35073]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:49:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:16 smithi044 ceph-mon[35259]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:16.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:49:16.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:17.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:17 smithi039 ceph-mon[31204]: Deploying daemon osd.0 on smithi039 2024-09-12T01:49:17.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:17 smithi044 ceph-mon[35259]: Deploying daemon osd.0 on smithi039 2024-09-12T01:49:17.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:17 smithi172 ceph-mon[35073]: Deploying daemon osd.0 on smithi039 2024-09-12T01:49:18.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:18 smithi039 ceph-mon[31204]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:18.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:18 smithi044 ceph-mon[35259]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:18.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:18 smithi172 ceph-mon[35073]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:20.664 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:20 smithi039 ceph-mon[31204]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:20.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:20 smithi044 ceph-mon[35259]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:20.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:20 smithi172 ceph-mon[35073]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:22.396 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:22 smithi039 ceph-mon[31204]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:22 smithi044 ceph-mon[35259]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:22.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:22 smithi172 ceph-mon[35073]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:23.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:23.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:23.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:23.544 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:23.544 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:23.545 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:24 smithi039 ceph-mon[31204]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:24 smithi044 ceph-mon[35259]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:24 smithi172 ceph-mon[35073]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:26.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:26.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:26.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:26.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:26.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:26.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:26.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:26.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:27.141 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:26 smithi039 ceph-mon[31204]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:26 smithi044 ceph-mon[35259]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:27.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.183+0000 7f0f56ffd640 1 -- 172.21.15.39:0/207292098 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f60062630 con 0x7f0f4c039290 2024-09-12T01:49:27.184 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 0 on host 'smithi039' 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.185+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 msgr2=0x7f0f4c03b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 0x7f0f4c03b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0104e0 tx=0x7f0f5c00b410 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 msgr2=0x7f0f6019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f50031440 tx=0x7f0f500043b0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 shutdown_connections 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f4c039290 0x7f0f4c03b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f60102690 0x7f0f6019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f60101cd0 0x7f0f6019cc40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 --2- 172.21.15.39:0/207292098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f60100ad0 0x7f0f6006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 >> 172.21.15.39:0/207292098 conn(0x7f0f600fc280 msgr2=0x7f0f601050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:27.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 shutdown_connections 2024-09-12T01:49:27.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:49:27.186+0000 7f0f6806c640 1 -- 172.21.15.39:0/207292098 wait complete. 2024-09-12T01:49:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:26 smithi172 ceph-mon[35073]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:27.827 DEBUG:teuthology.orchestra.run.smithi039:osd.0> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:49:27.829 INFO:tasks.cephadm:Deploying osd.1 on smithi044 with /dev/vg_nvme/lv_4... 2024-09-12T01:49:27.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:49:28.090 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:49:28.131 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:28.131 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:28.131 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:28.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:28.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:28.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:29.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:28 smithi039 ceph-mon[31204]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:29.161 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:49:29 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T01:49:29.063+0000 7fbecaa46640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:49:29.215 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:28 smithi044 ceph-mon[35259]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:28 smithi172 ceph-mon[35073]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:30.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:29 smithi044 ceph-mon[35259]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:49:30.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:29 smithi044 ceph-mon[35259]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:30.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:29 smithi172 ceph-mon[35073]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:49:30.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:29 smithi172 ceph-mon[35073]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:30.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:29 smithi039 ceph-mon[31204]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:49:30.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:29 smithi039 ceph-mon[31204]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:30.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:49:30.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-09-12T01:49:30.793 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi039 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:31.092 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-12T01:49:31.093 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.093 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:31.093 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:31.093 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T01:49:30.946+0000 7fbec69c9640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:49:31.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T01:49:30.950+0000 7fbec27f1640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi039 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:31.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:31.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi039 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi039 to 17088M 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:31.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/3979536245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb8102660 msgr2=0x7f4cb8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/3979536245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb8102660 0x7f4cb8104a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009900 tx=0x7f4ca802a410 comp rx=0 tx=0).stop 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/3979536245 shutdown_connections 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/3979536245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb81078c0 0x7f4cb8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/3979536245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 0x7f4cb8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/3979536245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb8102660 0x7f4cb8104a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/3979536245 >> 172.21.15.44:0/3979536245 conn(0x7f4cb80fc280 msgr2=0x7f4cb80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/3979536245 shutdown_connections 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.306+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/3979536245 wait complete. 2024-09-12T01:49:31.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 Processor -- start 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 -- start start 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb8102660 0x7f4cb8101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 0x7f4cb8100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810d8e0 con 0x7f4cb8102660 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810d760 con 0x7f4cb81078c0 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cbd5fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810da60 con 0x7f4cb8104f90 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54266/0 (socket says 172.21.15.44:54266) 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 -- 172.21.15.44:0/1223652950 learned_addr learned my addr 172.21.15.44:0/1223652950 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb6ffd640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb8102660 0x7f4cb8101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb67fc640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 0x7f4cb8100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 -- 172.21.15.44:0/1223652950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 msgr2=0x7f4cb8100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 0x7f4cb8100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 -- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb8102660 msgr2=0x7f4cb8101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb8102660 0x7f4cb8101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.307+0000 7f4cb77fe640 1 -- 172.21.15.44:0/1223652950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb8101410 con 0x7f4cb81078c0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4cb77fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000b970 tx=0x7f4cb000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0019070 con 0x7f4cb81078c0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb81a2120 con 0x7f4cb81078c0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb000cb40 con 0x7f4cb81078c0 2024-09-12T01:49:31.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0007650 con 0x7f4cb81078c0 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.308+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a26b0 con 0x7f4cb81078c0 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.309+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb8105370 con 0x7f4cb81078c0 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.310+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4cb001c070 con 0x7f4cb81078c0 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.311+0000 7f4c9ffff640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 0x7f4ca00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.311+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f4cb00ccf30 con 0x7f4cb81078c0 2024-09-12T01:49:31.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.311+0000 7f4cb6ffd640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 0x7f4ca00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.312+0000 7f4cb6ffd640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 0x7f4ca00a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80314e0 tx=0x7f4ca8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:31.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.319+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cb00fc1b0 con 0x7f4cb81078c0 2024-09-12T01:49:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:31.503+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4cb8062630 con 0x7f4ca00a2af0 2024-09-12T01:49:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:49:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:49:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:31 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:32.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:49:32.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:32.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:31 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:32.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:31 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:33.238 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:32 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:49:33.238 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:32 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:49:33.238 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:32 smithi044 ceph-mon[35259]: osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] boot 2024-09-12T01:49:33.238 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:32 smithi044 ceph-mon[35259]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:49:33.238 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:32 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:49:33.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:32 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:49:33.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:32 smithi172 ceph-mon[35073]: osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] boot 2024-09-12T01:49:33.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:32 smithi172 ceph-mon[35073]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:49:33.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:33.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:32 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:49:33.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:32 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:49:33.312 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:32 smithi039 ceph-mon[31204]: osd.0 [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] boot 2024-09-12T01:49:33.313 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:32 smithi039 ceph-mon[31204]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:49:33.313 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:34.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/1036076475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]': finished 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:49:34.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/1036076475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]': finished 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:49:34.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:49:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/1036076475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]: dispatch 2024-09-12T01:49:34.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14cf552e-8b4c-4d78-af25-1e5e24854694"}]': finished 2024-09-12T01:49:34.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:49:34.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:34 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/2966381195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:35.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:34 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/2966381195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:35.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:34 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/2966381195' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:49:36.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:35 smithi172 ceph-mon[35073]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:36.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:35 smithi039 ceph-mon[31204]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:35 smithi044 ceph-mon[35259]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:38.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:38 smithi172 ceph-mon[35073]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:38.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:38 smithi044 ceph-mon[35259]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:38.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:38 smithi039 ceph-mon[31204]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:40.312 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:40 smithi044 ceph-mon[35259]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:40.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:40 smithi172 ceph-mon[35073]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:40.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:40 smithi039 ceph-mon[31204]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:42.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:42 smithi044 ceph-mon[35259]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:42.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:42 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:49:42.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:42 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:42.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:42 smithi172 ceph-mon[35073]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:42.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:49:42.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:42.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:42 smithi039 ceph-mon[31204]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:49:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:43.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:43 smithi172 ceph-mon[35073]: Deploying daemon osd.1 on smithi044 2024-09-12T01:49:43.512 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:43 smithi044 ceph-mon[35259]: Deploying daemon osd.1 on smithi044 2024-09-12T01:49:43.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:43 smithi039 ceph-mon[31204]: Deploying daemon osd.1 on smithi044 2024-09-12T01:49:44.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:44 smithi044 ceph-mon[35259]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:44.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:44 smithi172 ceph-mon[35073]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:44.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:44 smithi039 ceph-mon[31204]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:46.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:46 smithi172 ceph-mon[35073]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:46.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:46 smithi039 ceph-mon[31204]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:46.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:46 smithi044 ceph-mon[35259]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:48.379 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:48 smithi044 ceph-mon[35259]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:48.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:48 smithi172 ceph-mon[35073]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:48.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:48 smithi039 ceph-mon[31204]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:49.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:49.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:49.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:49.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:49.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:49.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:49.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:49.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:49.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:50.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:50 smithi039 ceph-mon[31204]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:50.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:50 smithi044 ceph-mon[35259]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:51.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:50 smithi172 ceph-mon[35073]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:52.323 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:52 smithi044 ceph-mon[35259]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.369+0000 7f4c9ffff640 1 -- 172.21.15.44:0/1223652950 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4cb8062630 con 0x7f4ca00a2af0 2024-09-12T01:49:52.370 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 1 on host 'smithi044' 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 msgr2=0x7f4ca00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 0x7f4ca00a4fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80314e0 tx=0x7f4ca8000bc0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 msgr2=0x7f4cb8100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000b970 tx=0x7f4cb000be30 comp rx=0 tx=0).stop 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 shutdown_connections 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb81078c0 0x7f4cb8100b50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2af0 0x7f4ca00a4fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8104f90 0x7f4cb8100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 --2- 172.21.15.44:0/1223652950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb8102660 0x7f4cb8101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 >> 172.21.15.44:0/1223652950 conn(0x7f4cb80fc280 msgr2=0x7f4cb8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 shutdown_connections 2024-09-12T01:49:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:49:52.371+0000 7f4cbd5fe640 1 -- 172.21.15.44:0/1223652950 wait complete. 2024-09-12T01:49:52.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:52 smithi039 ceph-mon[31204]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:52.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:52.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:52 smithi172 ceph-mon[35073]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:52.983 DEBUG:teuthology.orchestra.run.smithi044:osd.1> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T01:49:52.985 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-12T01:49:52.985 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:49:53.247 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:49:53.338 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:53.338 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:53.338 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:53.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:53 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:53.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:53 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:53.368 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:53 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:53.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:53 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:53.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:53 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:53.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:53 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:54.307 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:54 smithi044 ceph-mon[35259]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:54.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:54 smithi172 ceph-mon[35073]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:54.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:54 smithi039 ceph-mon[31204]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:54.586 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:49:54 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T01:49:54.309+0000 7f05b0bd3640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:49:55.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:55 smithi172 ceph-mon[35073]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:55 smithi172 ceph-mon[35073]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:55 smithi039 ceph-mon[31204]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:55 smithi039 ceph-mon[31204]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:55 smithi044 ceph-mon[35259]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:55 smithi044 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:55.464 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:49:55.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-12T01:49:55.744 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:49:56.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.233+0000 7f16d15a4640 1 -- 172.21.15.172:0/2667217185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc102660 msgr2=0x7f16cc104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.233+0000 7f16d15a4640 1 --2- 172.21.15.172:0/2667217185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc102660 0x7f16cc104a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009900 tx=0x7f16bc02a410 comp rx=0 tx=0).stop 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 -- 172.21.15.172:0/2667217185 shutdown_connections 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 --2- 172.21.15.172:0/2667217185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 0x7f16cc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 --2- 172.21.15.172:0/2667217185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc104f90 0x7f16cc107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 --2- 172.21.15.172:0/2667217185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc102660 0x7f16cc104a50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 -- 172.21.15.172:0/2667217185 >> 172.21.15.172:0/2667217185 conn(0x7f16cc0fc280 msgr2=0x7f16cc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 -- 172.21.15.172:0/2667217185 shutdown_connections 2024-09-12T01:49:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 -- 172.21.15.172:0/2667217185 wait complete. 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.234+0000 7f16d15a4640 1 Processor -- start 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 -- start start 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 0x7f16cc197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 0x7f16cc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc10d900 con 0x7f16cc102660 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc10d780 con 0x7f16cc1078c0 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16d15a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc10da80 con 0x7f16cc104f90 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54398/0 (socket says 172.21.15.172:54398) 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 -- 172.21.15.172:0/315287738 learned_addr learned my addr 172.21.15.172:0/315287738 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:49:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16cb7fe640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 0x7f16cc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16caffd640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 0x7f16cc197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 -- 172.21.15.172:0/315287738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 msgr2=0x7f16cc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 0x7f16cc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 -- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 msgr2=0x7f16cc197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 0x7f16cc197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16ca7fc640 1 -- 172.21.15.172:0/315287738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc19fbb0 con 0x7f16cc104f90 2024-09-12T01:49:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.235+0000 7f16caffd640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 0x7f16cc197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16ca7fc640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16c000b450 tx=0x7f16c000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0015020 con 0x7f16cc104f90 2024-09-12T01:49:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c0011d70 con 0x7f16cc104f90 2024-09-12T01:49:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000f340 con 0x7f16cc104f90 2024-09-12T01:49:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc19fea0 con 0x7f16cc104f90 2024-09-12T01:49:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.236+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc1a03d0 con 0x7f16cc104f90 2024-09-12T01:49:56.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.237+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc0fdd70 con 0x7f16cc104f90 2024-09-12T01:49:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.238+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f16c0018020 con 0x7f16cc104f90 2024-09-12T01:49:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.239+0000 7f16b3fff640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 0x7f16b40a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.239+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f16c00cd0e0 con 0x7f16cc104f90 2024-09-12T01:49:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.239+0000 7f16caffd640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 0x7f16b40a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.240+0000 7f16caffd640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 0x7f16b40a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.243+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16c001f020 con 0x7f16cc104f90 2024-09-12T01:49:56.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi044 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi044 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:49:56.424+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f16cc062630 con 0x7f16b40a2b20 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi044 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.425 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:56.426 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T01:49:56.426 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.426 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:56.426 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:56.426 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:49:56.923 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T01:49:56.497+0000 7f05acb56640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:49:56.923 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:49:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T01:49:56.500+0000 7f05a4976640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:49:57.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:49:57.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='osd.1 ' entity='osd.1' 2024-09-12T01:49:57.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='osd.1 ' entity='osd.1' 2024-09-12T01:49:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:57.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='osd.1 ' entity='osd.1' 2024-09-12T01:49:57.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] boot 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:49:58.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:58.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:49:58.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:49:58.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:58.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] boot 2024-09-12T01:49:58.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:49:58.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:58.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:49:58.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:49:58.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:49:58.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: osd.1 [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] boot 2024-09-12T01:49:58.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:49:58.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:59.247 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:59 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/239588748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:59 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:59 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]': finished 2024-09-12T01:49:59.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:59 smithi172 ceph-mon[35073]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:49:59.248 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:49:59 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:49:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:59 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/239588748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:59 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:59 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]': finished 2024-09-12T01:49:59.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:59 smithi039 ceph-mon[31204]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:49:59.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:49:59 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:49:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:59 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/239588748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:59 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]: dispatch 2024-09-12T01:49:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:59 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "357cc6a5-5b47-4c23-8e6b-0d75cdbda81c"}]': finished 2024-09-12T01:49:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:59 smithi044 ceph-mon[35259]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:49:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:49:59 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:00.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:00 smithi039 ceph-mon[31204]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:00.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/3740649849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:00.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:00 smithi039 ceph-mon[31204]: overall HEALTH_OK 2024-09-12T01:50:00.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:00 smithi044 ceph-mon[35259]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:00.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:00 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/3740649849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:00.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:00 smithi044 ceph-mon[35259]: overall HEALTH_OK 2024-09-12T01:50:00.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:00 smithi172 ceph-mon[35073]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:00.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:00 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/3740649849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:00.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:00 smithi172 ceph-mon[35073]: overall HEALTH_OK 2024-09-12T01:50:02.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:02 smithi172 ceph-mon[35073]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:02.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:02 smithi039 ceph-mon[31204]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:02.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:02 smithi044 ceph-mon[35259]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:04.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:04 smithi172 ceph-mon[35073]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:04.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:04 smithi039 ceph-mon[31204]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:04.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:04 smithi044 ceph-mon[35259]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:06.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:06 smithi172 ceph-mon[35073]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:06.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:06 smithi039 ceph-mon[31204]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:06.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:06 smithi044 ceph-mon[35259]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:07.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:07 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:50:07.519 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:07 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:07.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:50:07.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:07.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:07 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:50:07.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:07 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:08.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:08 smithi172 ceph-mon[35073]: Deploying daemon osd.2 on smithi172 2024-09-12T01:50:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:08 smithi172 ceph-mon[35073]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:08 smithi039 ceph-mon[31204]: Deploying daemon osd.2 on smithi172 2024-09-12T01:50:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:08 smithi039 ceph-mon[31204]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:08 smithi044 ceph-mon[35259]: Deploying daemon osd.2 on smithi172 2024-09-12T01:50:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:08 smithi044 ceph-mon[35259]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:10.285 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:10 smithi172 ceph-mon[35073]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:10.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:10 smithi039 ceph-mon[31204]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:10.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:10 smithi044 ceph-mon[35259]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:12.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:12 smithi172 ceph-mon[35073]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:12.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:12 smithi039 ceph-mon[31204]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:12.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:12 smithi044 ceph-mon[35259]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:13.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:13.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:13.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:13.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:13.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:13.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:13.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:14.530 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:14 smithi172 ceph-mon[35073]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:14.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:14 smithi039 ceph-mon[31204]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:14.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:14 smithi044 ceph-mon[35259]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:16 smithi039 ceph-mon[31204]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:16 smithi044 ceph-mon[35259]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:16 smithi172 ceph-mon[35073]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:17.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.267+0000 7f16b3fff640 1 -- 172.21.15.172:0/315287738 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16cc062630 con 0x7f16b40a2b20 2024-09-12T01:50:17.268 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 msgr2=0x7f16b40a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 0x7f16b40a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc0095f0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 msgr2=0x7f16cc1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f16c000b450 tx=0x7f16c000b910 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 shutdown_connections 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc1078c0 0x7f16cc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16b40a2b20 0x7f16b40a4fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc104f90 0x7f16cc1984c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 --2- 172.21.15.172:0/315287738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc102660 0x7f16cc197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 >> 172.21.15.172:0/315287738 conn(0x7f16cc0fc280 msgr2=0x7f16cc1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 shutdown_connections 2024-09-12T01:50:17.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:50:17.269+0000 7f16d15a4640 1 -- 172.21.15.172:0/315287738 wait complete. 2024-09-12T01:50:17.853 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T01:50:17.855 INFO:tasks.cephadm:Deploying osd.3 on smithi039 with /dev/vg_nvme/lv_3... 2024-09-12T01:50:17.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:50:18.124 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:18.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:18 smithi172 ceph-mon[35073]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:18.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:18.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:18.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:18.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:18 smithi039 ceph-mon[31204]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:18.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:18.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:18.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:18.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:18 smithi044 ceph-mon[35259]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:18.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:18.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:18.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:19.504 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T01:50:19.376+0000 7f5aae32e640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:50:20.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:20 smithi039 ceph-mon[31204]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:20.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:20 smithi039 ceph-mon[31204]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.384 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:20 smithi039 ceph-mon[31204]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.459 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:20 smithi172 ceph-mon[35073]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:20.459 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:20 smithi172 ceph-mon[35073]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.459 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:20 smithi172 ceph-mon[35073]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:20 smithi044 ceph-mon[35259]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:20.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:20 smithi044 ceph-mon[35259]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:20 smithi044 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:20.925 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:50:20.951 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2024-09-12T01:50:21.206 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.535 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi172 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:21.536 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:50:21.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:50:21.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi172 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:21.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 -- 172.21.15.39:0/3531402657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 msgr2=0x7f66ac109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/3531402657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac109000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009cd0 tx=0x7f66a402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 -- 172.21.15.39:0/3531402657 shutdown_connections 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/3531402657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac109000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/3531402657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac100da0 0x7f66ac101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/3531402657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac1020f0 0x7f66ac1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 -- 172.21.15.39:0/3531402657 >> 172.21.15.39:0/3531402657 conn(0x7f66ac0fba40 msgr2=0x7f66ac0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 -- 172.21.15.39:0/3531402657 shutdown_connections 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 -- 172.21.15.39:0/3531402657 wait complete. 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.727+0000 7f66b2f2e640 1 Processor -- start 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 -- start start 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 0x7f66ac1007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 0x7f66ac19f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10c7b0 con 0x7f66ac101760 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10c630 con 0x7f66ac1020f0 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10c930 con 0x7f66ac100da0 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49092/0 (socket says 172.21.15.39:49092) 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 -- 172.21.15.39:0/4003783341 learned_addr learned my addr 172.21.15.39:0/4003783341 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b14cb640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 0x7f66ac19f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b0cca640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 0x7f66ac1007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 -- 172.21.15.39:0/4003783341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 msgr2=0x7f66ac1007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 0x7f66ac1007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 -- 172.21.15.39:0/4003783341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 msgr2=0x7f66ac19f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 0x7f66ac19f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 -- 172.21.15.39:0/4003783341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac19fbc0 con 0x7f66ac101760 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b0cca640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 0x7f66ac1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b14cb640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 0x7f66ac19f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a3fff640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d950 tx=0x7f669c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c017070 con 0x7f66ac101760 2024-09-12T01:50:21.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac19fe50 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f669c009c30 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.728+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c00f6b0 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.729+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac1a0350 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.730+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac107f80 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.731+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f669c0109d0 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.731+0000 7f66a1ffb640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 0x7f66940a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.731+0000 7f66b0cca640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 0x7f66940a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.731+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f669c0cd5b0 con 0x7f66ac101760 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.732+0000 7f66b0cca640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 0x7f66940a4fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66a80058c0 tx=0x7f66a8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:21.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.736+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f669c009de0 con 0x7f66ac101760 2024-09-12T01:50:21.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T01:50:21.258+0000 7f5aaa2b1640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:50:21.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T01:50:21.262+0000 7f5aa60d9640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi172 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T01:50:21.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:21.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:21.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:21.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:21.920+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f66ac062630 con 0x7f66940a2af0 2024-09-12T01:50:22.627 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:22.627 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:50:22.627 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:22.628 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:50:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:50:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:22.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:22.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:22.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:22.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:23.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:50:23.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:50:23.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:23.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] boot 2024-09-12T01:50:23.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T01:50:23.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:23.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:50:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:50:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] boot 2024-09-12T01:50:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T01:50:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:24.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: osd.2 [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] boot 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:24.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]: dispatch 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]': finished 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:50:24.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]: dispatch 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]': finished 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:50:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:50:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]: dispatch 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3787348125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ee5c8-c842-4b5b-b4c4-42693348b505"}]': finished 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:50:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:25.371 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:24 smithi039 sudo[46947]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:25.371 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:24 smithi039 sudo[46947]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:25.371 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:24 smithi039 sudo[46947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:25.371 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:24 smithi039 sudo[46947]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:25.660 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:25 smithi039 sudo[46996]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:25.660 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:25 smithi039 sudo[46996]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:25.661 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:25 smithi039 sudo[46996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:25.661 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 01:50:25 smithi039 sudo[46996]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:25.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:25.690+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f669c097bd0 con 0x7f66ac101760 2024-09-12T01:50:25.924 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43858]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:25.925 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43858]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:25.925 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:25.925 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43858]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:25.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:25 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/665922521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:25.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:25 smithi044 ceph-mon[35259]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:50:25.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:25.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:26.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:25 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/665922521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:26.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:25 smithi172 ceph-mon[35073]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:50:26.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:26.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:26.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:25 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/665922521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:26.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:25 smithi039 ceph-mon[31204]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:50:26.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:26.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:26.423 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43861]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:26.423 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43861]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:26.423 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:26.423 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 01:50:25 smithi044 sudo[43861]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:26.459 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43658]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:26.460 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43658]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:26.460 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:26.460 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43658]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:26.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:26.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:26.754 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:26.754 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 01:50:26 smithi172 sudo[43661]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:27.381 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:26 smithi039 sudo[47375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:27.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:26 smithi039 sudo[47375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:27.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:26 smithi039 sudo[47375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:27.382 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:26 smithi039 sudo[47375]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 ceph-mon[35073]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 ceph-mon[35073]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:27.646 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:27.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:27.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:27.647 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43664]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:27.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 sudo[47561]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:27.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 sudo[47561]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 sudo[47561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 sudo[47561]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 ceph-mon[31204]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 ceph-mon[31204]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:27 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:27.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:27 smithi044 ceph-mon[35259]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:27.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:27 smithi044 ceph-mon[35259]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:50:27.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:27.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:27 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:28.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:27 smithi172 sudo[43667]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:28.409 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43864]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:50:28.409 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43864]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:28.410 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:28.410 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43864]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:28.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43867]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:50:28.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43867]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 sudo[43867]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:28.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:28.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:28.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:50:28.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:50:28.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:50:29.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:29 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:29.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:29 smithi172 ceph-mon[35073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:29.782 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:29 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:29.782 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:29 smithi039 ceph-mon[31204]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:29.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:29 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:50:29.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:29 smithi044 ceph-mon[35259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:50:30.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:30 smithi039 ceph-mon[31204]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:30.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:30 smithi172 ceph-mon[35073]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:30.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:30 smithi044 ceph-mon[35259]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:32.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:32 smithi039 ceph-mon[31204]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:32.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:32 smithi172 ceph-mon[35073]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:32.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:32 smithi044 ceph-mon[35259]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:33.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:50:33.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:33.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:33 smithi172 ceph-mon[35073]: Deploying daemon osd.3 on smithi039 2024-09-12T01:50:33.827 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:50:33.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:33.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:33 smithi039 ceph-mon[31204]: Deploying daemon osd.3 on smithi039 2024-09-12T01:50:33.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:50:33.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:33.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:33 smithi044 ceph-mon[35259]: Deploying daemon osd.3 on smithi039 2024-09-12T01:50:34.664 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:34 smithi039 ceph-mon[31204]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T01:50:34.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:34 smithi172 ceph-mon[35073]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T01:50:34.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:34 smithi044 ceph-mon[35259]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-12T01:50:36.644 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:36 smithi039 ceph-mon[31204]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:50:36.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:36 smithi172 ceph-mon[35073]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:50:36.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:36 smithi044 ceph-mon[35259]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:50:38.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:38 smithi039 ceph-mon[31204]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:50:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:38 smithi172 ceph-mon[35073]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:50:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:38 smithi044 ceph-mon[35259]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:50:39.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:39.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:39.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:39.782 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:39.782 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:39.782 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:40.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:40 smithi172 ceph-mon[35073]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:50:40.829 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:40 smithi039 ceph-mon[31204]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:50:40.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:40 smithi044 ceph-mon[35259]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:50:42.725 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:42 smithi044 ceph-mon[35259]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:42.725 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:42 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:42.725 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:42 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:42.749 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:42 smithi039 ceph-mon[31204]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:42.750 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:42.750 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:42.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:42 smithi172 ceph-mon[35073]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:42.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:42.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.461+0000 7f66a1ffb640 1 -- 172.21.15.39:0/4003783341 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f66ac062630 con 0x7f66940a2af0 2024-09-12T01:50:43.462 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 3 on host 'smithi039' 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 msgr2=0x7f66940a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 0x7f66940a4fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66a80058c0 tx=0x7f66a8005850 comp rx=0 tx=0).stop 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 msgr2=0x7f66ac19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d950 tx=0x7f669c00de10 comp rx=0 tx=0).stop 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 shutdown_connections 2024-09-12T01:50:43.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66ac1020f0 0x7f66ac19f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66ac101760 0x7f66ac19cc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66940a2af0 0x7f66940a4fb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 --2- 172.21.15.39:0/4003783341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac100da0 0x7f66ac1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 >> 172.21.15.39:0/4003783341 conn(0x7f66ac0fba40 msgr2=0x7f66ac105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 shutdown_connections 2024-09-12T01:50:43.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:50:43.464+0000 7f66b2f2e640 1 -- 172.21.15.39:0/4003783341 wait complete. 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:43 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:43 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:43.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:43.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:43.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:43.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:43 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:44.224 DEBUG:teuthology.orchestra.run.smithi039:osd.3> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T01:50:44.227 INFO:tasks.cephadm:Deploying osd.4 on smithi044 with /dev/vg_nvme/lv_3... 2024-09-12T01:50:44.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:50:44.487 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:50:44.770 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:44 smithi039 ceph-mon[31204]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:44.867 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:44 smithi044 ceph-mon[35259]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:45.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:44 smithi172 ceph-mon[35073]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:50:45.160 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 01:50:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T01:50:44.926+0000 7f54fa3f8640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:50:45.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:45 smithi039 ceph-mon[31204]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:45.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:45 smithi044 ceph-mon[35259]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:46.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:45 smithi172 ceph-mon[35073]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:46.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-mon[31204]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:46.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-mon[31204]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:50:46.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-mon[31204]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:50:46.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-mon[31204]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:50:46.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:46.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:46 smithi044 ceph-mon[35259]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:46.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:46 smithi044 ceph-mon[35259]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:50:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:46 smithi044 ceph-mon[35259]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:50:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:46 smithi044 ceph-mon[35259]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:50:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:46.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:50:47.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:46 smithi172 ceph-mon[35073]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:47.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:46 smithi172 ceph-mon[35073]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:50:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:46 smithi172 ceph-mon[35073]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:50:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:46 smithi172 ceph-mon[35073]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:50:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-09-12T01:50:47.146 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T01:50:46.951+0000 7f54f637b640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:50:47.147 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 01:50:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T01:50:46.958+0000 7f54ee19b640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:50:47.284 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:50:47.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] boot 2024-09-12T01:50:47.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T01:50:47.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 -- 172.21.15.44:0/3686525844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100de0 msgr2=0x7f4c6c101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/3686525844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100de0 0x7f4c6c101260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009900 tx=0x7f4c5402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 -- 172.21.15.44:0/3686525844 shutdown_connections 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/3686525844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c1017a0 0x7f4c6c109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/3686525844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100de0 0x7f4c6c101260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/3686525844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 -- 172.21.15.44:0/3686525844 >> 172.21.15.44:0/3686525844 conn(0x7f4c6c0fba40 msgr2=0x7f4c6c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 -- 172.21.15.44:0/3686525844 shutdown_connections 2024-09-12T01:50:47.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.766+0000 7f4c72aa9640 1 -- 172.21.15.44:0/3686525844 wait complete. 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 Processor -- start 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 -- start start 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c100de0 0x7f4c6c10b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1017a0 0x7f4c6c109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10d8d0 con 0x7f4c6c1017a0 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10d750 con 0x7f4c6c1020a0 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c72aa9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10da50 con 0x7f4c6c100de0 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c71046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c71046640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41544/0 (socket says 172.21.15.44:41544) 2024-09-12T01:50:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c71046640 1 -- 172.21.15.44:0/1866422787 learned_addr learned my addr 172.21.15.44:0/1866422787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c6bfff640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1017a0 0x7f4c6c109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.767+0000 7f4c70845640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c100de0 0x7f4c6c10b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 -- 172.21.15.44:0/1866422787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c100de0 msgr2=0x7f4c6c10b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c100de0 0x7f4c6c10b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 -- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1017a0 msgr2=0x7f4c6c109ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1017a0 0x7f4c6c109ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 -- 172.21.15.44:0/1866422787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c10a8c0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c71046640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c970 tx=0x7f4c6400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64007bb0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c64007d50 con 0x7f4c6c1020a0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c1a20c0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64018800 con 0x7f4c6c1020a0 2024-09-12T01:50:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.768+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c1a25d0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.769+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6c107ff0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.770+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4c6400fa50 con 0x7f4c6c1020a0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.771+0000 7f4c69ffb640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 0x7f4c580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.771+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3702+0+0 (secure 0 0 0) 0x7f4c640cdea0 con 0x7f4c6c1020a0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.771+0000 7f4c70845640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 0x7f4c580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.772+0000 7f4c70845640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 0x7f4c580a50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06a510 tx=0x7f4c5c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.775+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c64014030 con 0x7f4c6c1020a0 2024-09-12T01:50:47.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:47.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:47.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:47.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] boot 2024-09-12T01:50:47.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T01:50:47.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:47.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:50:47.959+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4c6c062630 con 0x7f4c580a2c00 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341]' entity='osd.3' 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:48.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: osd.3 [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] boot 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T01:50:48.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:50:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:50:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi039 2024-09-12T01:50:48.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T01:50:48.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:48.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:48.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:48.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:48 smithi044 ceph-mon[35259]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:50:48.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi039 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:48.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:48 smithi039 ceph-mon[31204]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:50:49.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi039 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:49.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:48 smithi172 ceph-mon[35073]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T01:50:49.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:49 smithi039 ceph-mon[31204]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:49.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:49 smithi044 ceph-mon[35259]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:50.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:49 smithi172 ceph-mon[35073]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:50.873 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/3166287615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]': finished 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:50:50.874 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:50.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/3166287615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]': finished 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:50:50.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/3166287615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]: dispatch 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4f59844-9cd8-46ff-a56c-d9a5558939c5"}]': finished 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T01:50:51.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:51.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:51 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/1083822744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:51.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:51 smithi039 ceph-mon[31204]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:50:51.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:51.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:51 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/1083822744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:51.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:51 smithi044 ceph-mon[35259]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:50:51.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:51 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:52.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:51 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/1083822744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:50:52.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:51 smithi172 ceph-mon[35073]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:50:52.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:50:52.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:52 smithi039 ceph-mon[31204]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:52.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:52 smithi044 ceph-mon[35259]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:53.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:52 smithi172 ceph-mon[35073]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:50:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:54 smithi044 ceph-mon[35259]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-12T01:50:54.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:54 smithi039 ceph-mon[31204]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-12T01:50:55.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:54 smithi172 ceph-mon[35073]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-12T01:50:56.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:56 smithi039 ceph-mon[31204]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:50:56.911 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:56 smithi044 ceph-mon[35259]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:50:57.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:56 smithi172 ceph-mon[35073]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:50:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:58 smithi039 ceph-mon[31204]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:50:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:50:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:58.922 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:58 smithi044 ceph-mon[35259]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:50:58.922 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:50:58.922 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:59.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:58 smithi172 ceph-mon[35073]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:50:59.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:50:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:59.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:50:59 smithi044 ceph-mon[35259]: Deploying daemon osd.4 on smithi044 2024-09-12T01:50:59.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:50:59 smithi039 ceph-mon[31204]: Deploying daemon osd.4 on smithi044 2024-09-12T01:51:00.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:50:59 smithi172 ceph-mon[35073]: Deploying daemon osd.4 on smithi044 2024-09-12T01:51:00.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:00 smithi039 ceph-mon[31204]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:51:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:00 smithi044 ceph-mon[35259]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:51:01.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:00 smithi172 ceph-mon[35073]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:51:02.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:02 smithi039 ceph-mon[31204]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:51:02.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:02 smithi044 ceph-mon[35259]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:51:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:02 smithi172 ceph-mon[35073]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:51:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:04 smithi039 ceph-mon[31204]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:51:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:04 smithi044 ceph-mon[35259]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:51:05.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:04 smithi172 ceph-mon[35073]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:51:05.902 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:06.052 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:06.053 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:06.053 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:06.054 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:06.054 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:06.054 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:06.054 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:06.054 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:07.096 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:06 smithi044 ceph-mon[35259]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:07.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:06 smithi039 ceph-mon[31204]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:07.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:06 smithi172 ceph-mon[35073]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:08.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:08 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.554 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:08.554 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.554 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.554 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.555 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.555 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:08 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:08 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:08.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.932+0000 7f4c69ffb640 1 -- 172.21.15.44:0/1866422787 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4c6c062630 con 0x7f4c580a2c00 2024-09-12T01:51:08.933 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 4 on host 'smithi044' 2024-09-12T01:51:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 msgr2=0x7f4c580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 0x7f4c580a50c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06a510 tx=0x7f4c5c009870 comp rx=0 tx=0).stop 2024-09-12T01:51:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 msgr2=0x7f4c6c10a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c970 tx=0x7f4c6400ce30 comp rx=0 tx=0).stop 2024-09-12T01:51:08.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 shutdown_connections 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1020a0 0x7f4c6c10a000 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c6c1017a0 0x7f4c6c109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4c580a2c00 0x7f4c580a50c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 --2- 172.21.15.44:0/1866422787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c6c100de0 0x7f4c6c10b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.934+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 >> 172.21.15.44:0/1866422787 conn(0x7f4c6c0fba40 msgr2=0x7f4c6c1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.935+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 shutdown_connections 2024-09-12T01:51:08.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:51:08.935+0000 7f4c72aa9640 1 -- 172.21.15.44:0/1866422787 wait complete. 2024-09-12T01:51:09.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.543 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.543 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.543 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.569 DEBUG:teuthology.orchestra.run.smithi044:osd.4> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T01:51:09.571 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-12T01:51:09.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:51:09.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:09.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:09.829 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:51:11.103 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:10 smithi044 ceph-mon[35259]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:11.113 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:10 smithi172 ceph-mon[35073]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:11.362 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 01:51:11 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T01:51:11.101+0000 7f4dd398c640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:51:11.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:10 smithi039 ceph-mon[31204]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:12.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:11 smithi044 ceph-mon[35259]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:11 smithi044 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.203 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:11 smithi172 ceph-mon[35073]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.203 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:11 smithi172 ceph-mon[35073]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:51:12.231 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-12T01:51:12.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:11 smithi039 ceph-mon[31204]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:11 smithi039 ceph-mon[31204]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:12.481 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:51:12.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 -- 172.21.15.172:0/2428663676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 msgr2=0x7f1e64104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 --2- 172.21.15.172:0/2428663676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64104a50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009900 tx=0x7f1e5402a410 comp rx=0 tx=0).stop 2024-09-12T01:51:12.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 -- 172.21.15.172:0/2428663676 shutdown_connections 2024-09-12T01:51:12.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 --2- 172.21.15.172:0/2428663676 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e641078c0 0x7f1e64109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 --2- 172.21.15.172:0/2428663676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e64104f90 0x7f1e64107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 --2- 172.21.15.172:0/2428663676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64104a50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 -- 172.21.15.172:0/2428663676 >> 172.21.15.172:0/2428663676 conn(0x7f1e640fc280 msgr2=0x7f1e640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 -- 172.21.15.172:0/2428663676 shutdown_connections 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.942+0000 7f1e69b39640 1 -- 172.21.15.172:0/2428663676 wait complete. 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 Processor -- start 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 -- start start 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e64104f90 0x7f1e64100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e641078c0 0x7f1e64100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410d890 con 0x7f1e64104f90 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410d710 con 0x7f1e641078c0 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.943+0000 7f1e69b39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410da10 con 0x7f1e64102660 2024-09-12T01:51:12.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:57290/0 (socket says 172.21.15.172:57290) 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 -- 172.21.15.172:0/1876303399 learned_addr learned my addr 172.21.15.172:0/1876303399 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e63fff640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e641078c0 0x7f1e64100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e62ffd640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e64104f90 0x7f1e64100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 -- 172.21.15.172:0/1876303399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e641078c0 msgr2=0x7f1e64100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e641078c0 0x7f1e64100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 -- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e64104f90 msgr2=0x7f1e64100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e64104f90 0x7f1e64100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 -- 172.21.15.172:0/1876303399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e64101410 con 0x7f1e64102660 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e637fe640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009230 tx=0x7f1e54004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5403f030 con 0x7f1e64102660 2024-09-12T01:51:12.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e641a1ff0 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e54003ce0 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54035070 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.944+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641a2390 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.945+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e64105370 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.947+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e54042030 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.947+0000 7f1e60ff9640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 0x7f1e4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.947+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3805+0+0 (secure 0 0 0) 0x7f1e540ee920 con 0x7f1e64102660 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.948+0000 7f1e62ffd640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 0x7f1e4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.948+0000 7f1e62ffd640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 0x7f1e4c0a5040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e64101d40 tx=0x7f1e5800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:12.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:12.954+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e540bc3d0 con 0x7f1e64102660 2024-09-12T01:51:13.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:13.136+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1e640626f0 con 0x7f1e4c0a2b80 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:13.137 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi044 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:13.138 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.377 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:13.377 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:51:13.377 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi044 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:13.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi044 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:13.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:13.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:13.673 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T01:51:13.376+0000 7f4dcf90f640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:51:13.673 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T01:51:13.381+0000 7f4dc772f640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:14.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='osd.4 ' entity='osd.4' 2024-09-12T01:51:14.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:13 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='osd.4 ' entity='osd.4' 2024-09-12T01:51:14.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:13 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:51:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:51:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='osd.4 ' entity='osd.4' 2024-09-12T01:51:14.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:13 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:15.203 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:14 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:51:15.203 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:14 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:51:15.204 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:14 smithi172 ceph-mon[35073]: osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] boot 2024-09-12T01:51:15.204 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:14 smithi172 ceph-mon[35073]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T01:51:15.204 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:15.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:14 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:51:15.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:14 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:51:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:14 smithi039 ceph-mon[31204]: osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] boot 2024-09-12T01:51:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:14 smithi039 ceph-mon[31204]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T01:51:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:14 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:51:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:14 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:51:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:14 smithi044 ceph-mon[35259]: osd.4 [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] boot 2024-09-12T01:51:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:14 smithi044 ceph-mon[35259]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T01:51:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:16.107 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:16.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/757381537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]': finished 2024-09-12T01:51:16.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T01:51:16.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/757381537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]': finished 2024-09-12T01:51:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T01:51:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/757381537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]: dispatch 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6acde19-c23f-487a-97a0-63622abd31c4"}]': finished 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T01:51:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:16 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/3069171471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:17.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:16 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/3069171471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:17.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:16 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/3069171471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:18.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:18 smithi039 ceph-mon[31204]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:18.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:18 smithi044 ceph-mon[35259]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:18.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:18 smithi172 ceph-mon[35073]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:20.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:20 smithi172 ceph-mon[35073]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:20 smithi039 ceph-mon[31204]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:20.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:20 smithi044 ceph-mon[35259]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:22.311 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:22 smithi172 ceph-mon[35073]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:22.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:22 smithi039 ceph-mon[31204]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:22.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:22 smithi044 ceph-mon[35259]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:24.497 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:24 smithi172 ceph-mon[35073]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:24.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:51:24.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:24.498 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:24 smithi172 ceph-mon[35073]: Deploying daemon osd.5 on smithi172 2024-09-12T01:51:24.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:24 smithi039 ceph-mon[31204]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:24.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:51:24.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:24.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:24 smithi039 ceph-mon[31204]: Deploying daemon osd.5 on smithi172 2024-09-12T01:51:24.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:24 smithi044 ceph-mon[35259]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:24.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:51:24.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:24.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:24 smithi044 ceph-mon[35259]: Deploying daemon osd.5 on smithi172 2024-09-12T01:51:26.624 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:26 smithi172 ceph-mon[35073]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:26.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:26 smithi039 ceph-mon[31204]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:26 smithi044 ceph-mon[35259]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:28.590 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:28 smithi172 ceph-mon[35073]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:28.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:28 smithi039 ceph-mon[31204]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:28.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:28 smithi044 ceph-mon[35259]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:30.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:30 smithi172 ceph-mon[35073]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:30.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:30.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:30.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:30 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:30.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:30 smithi039 ceph-mon[31204]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:30.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:30.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:30.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:30 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:30.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:30 smithi044 ceph-mon[35259]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:30.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:30.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:30.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:30 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:32.552 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:32 smithi172 ceph-mon[35073]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:32.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:32 smithi039 ceph-mon[31204]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:32.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:32 smithi044 ceph-mon[35259]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:34.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:34.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:34.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.108+0000 7f1e60ff9640 1 -- 172.21.15.172:0/1876303399 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e640626f0 con 0x7f1e4c0a2b80 2024-09-12T01:51:34.109 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 msgr2=0x7f1e4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 0x7f1e4c0a5040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e64101d40 tx=0x7f1e5800a250 comp rx=0 tx=0).stop 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 msgr2=0x7f1e64101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009230 tx=0x7f1e54004430 comp rx=0 tx=0).stop 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 shutdown_connections 2024-09-12T01:51:34.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e641078c0 0x7f1e64100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e64104f90 0x7f1e64100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e4c0a2b80 0x7f1e4c0a5040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.110+0000 7f1e69b39640 1 --2- 172.21.15.172:0/1876303399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64102660 0x7f1e64101fc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.111+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 >> 172.21.15.172:0/1876303399 conn(0x7f1e640fc280 msgr2=0x7f1e64102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.111+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 shutdown_connections 2024-09-12T01:51:34.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:51:34.111+0000 7f1e69b39640 1 -- 172.21.15.172:0/1876303399 wait complete. 2024-09-12T01:51:34.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:34.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:34.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:34.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:34.796 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T01:51:34.799 INFO:tasks.cephadm:Deploying osd.6 on smithi039 with /dev/vg_nvme/lv_2... 2024-09-12T01:51:34.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:51:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:35.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:34 smithi172 ceph-mon[35073]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:35.084 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:34 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:35.085 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:34 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:35.085 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:34 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:35.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:34 smithi039 ceph-mon[31204]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:35.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:34 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:35.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:34 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:35.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:34 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:34 smithi044 ceph-mon[35259]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:34 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:34 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:34 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:36.210 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 01:51:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T01:51:36.143+0000 7f4bf3204640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:51:36.873 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:36 smithi039 ceph-mon[31204]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:36.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:36 smithi039 ceph-mon[31204]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:36.874 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:36 smithi039 ceph-mon[31204]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:36 smithi044 ceph-mon[35259]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:36 smithi044 ceph-mon[35259]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:36 smithi044 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:36 smithi172 ceph-mon[35073]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:36 smithi172 ceph-mon[35073]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:36 smithi172 ceph-mon[35073]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:38.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T01:51:37.809+0000 7f4bef187640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:51:38.004 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T01:51:37.814+0000 7f4beafaf640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.048 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:51:38.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:51:38.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:51:38.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2024-09-12T01:51:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:51:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T01:51:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:38.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:38.341 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:38.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 -- 172.21.15.39:0/479840429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 msgr2=0x7fbf80109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/479840429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf80109d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009ca0 tx=0x7fbf7802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 -- 172.21.15.39:0/479840429 shutdown_connections 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/479840429 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf80109d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/479840429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf80104ff0 0x7fbf801073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/479840429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf801026c0 0x7fbf80104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 -- 172.21.15.39:0/479840429 >> 172.21.15.39:0/479840429 conn(0x7fbf800fc280 msgr2=0x7fbf800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 -- 172.21.15.39:0/479840429 shutdown_connections 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.825+0000 7fbf85ea9640 1 -- 172.21.15.39:0/479840429 wait complete. 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 Processor -- start 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 -- start start 2024-09-12T01:51:38.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf801026c0 0x7fbf8019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf80104ff0 0x7fbf8019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8010d8b0 con 0x7fbf80107920 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8010d730 con 0x7fbf80104ff0 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf85ea9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8010da30 con 0x7fbf801026c0 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf7ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf7ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50984/0 (socket says 172.21.15.39:50984) 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf7ffff640 1 -- 172.21.15.39:0/2531284835 learned_addr learned my addr 172.21.15.39:0/2531284835 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf7effd640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf80104ff0 0x7fbf8019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.826+0000 7fbf7f7fe640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf801026c0 0x7fbf8019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 -- 172.21.15.39:0/2531284835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf801026c0 msgr2=0x7fbf8019a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf801026c0 0x7fbf8019a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 -- 172.21.15.39:0/2531284835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf80104ff0 msgr2=0x7fbf8019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf80104ff0 0x7fbf8019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 -- 172.21.15.39:0/2531284835 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf801a1d10 con 0x7fbf80107920 2024-09-12T01:51:38.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7ffff640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf780319f0 tx=0x7fbf7802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78003c70 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf78003e10 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf801a1fa0 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7802fd30 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.827+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf801a24a0 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.828+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf80109410 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.829+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbf78004040 con 0x7fbf80107920 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.830+0000 7fbf7cff9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 0x7fbf680a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.830+0000 7fbf7f7fe640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 0x7fbf680a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:38.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.830+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4566+0+0 (secure 0 0 0) 0x7fbf780ef5c0 con 0x7fbf80107920 2024-09-12T01:51:38.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.831+0000 7fbf7f7fe640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 0x7fbf680a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf70005d00 tx=0x7fbf7000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:38.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:38.835+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf780bd3c0 con 0x7fbf80107920 2024-09-12T01:51:39.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:51:39.020+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbf80062630 con 0x7fbf680a2c30 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi172 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:39.021 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi172 2024-09-12T01:51:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T01:51:39.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:51:39.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:51:39.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:39.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi172 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:39.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:40.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] boot 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:40.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:39 smithi039 ceph-mon[31204]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:51:40.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] boot 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:39 smithi044 ceph-mon[35259]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:51:40.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: osd.5 [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] boot 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:40.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:39 smithi172 ceph-mon[35073]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T01:51:40.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:40 smithi039 ceph-mon[31204]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:40.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:40 smithi039 ceph-mon[31204]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:40.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:40 smithi039 ceph-mon[31204]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:51:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:40 smithi044 ceph-mon[35259]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:40 smithi044 ceph-mon[35259]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:40 smithi044 ceph-mon[35259]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:51:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:40 smithi172 ceph-mon[35073]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:40 smithi172 ceph-mon[35073]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:41.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:40 smithi172 ceph-mon[35073]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]: dispatch 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]': finished 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:51:42.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:42 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]: dispatch 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]': finished 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:51:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:42 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:51:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:51:42.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]: dispatch 2024-09-12T01:51:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4105896885' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2fc9230-8812-41b0-a3f4-6a5723e0a68f"}]': finished 2024-09-12T01:51:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T01:51:42.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:42 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:51:43.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:43 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3763522070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:43.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:43 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3763522070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:43 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3763522070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:51:44.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:44 smithi039 ceph-mon[31204]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:51:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:44 smithi044 ceph-mon[35259]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:51:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:44 smithi172 ceph-mon[35073]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:51:46.656 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:46 smithi039 ceph-mon[31204]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T01:51:46.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:46 smithi044 ceph-mon[35259]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T01:51:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:46 smithi172 ceph-mon[35073]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T01:51:48.542 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:48 smithi039 ceph-mon[31204]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T01:51:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:48 smithi044 ceph-mon[35259]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T01:51:48.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:48 smithi172 ceph-mon[35073]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T01:51:50.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:50 smithi039 ceph-mon[31204]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:51:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:50 smithi044 ceph-mon[35259]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:51:50.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:50 smithi172 ceph-mon[35073]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:51:51.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:51:51.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:51 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:51.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:51 smithi039 ceph-mon[31204]: Deploying daemon osd.6 on smithi039 2024-09-12T01:51:51.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:51 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:51:51.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:51 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:51.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:51 smithi044 ceph-mon[35259]: Deploying daemon osd.6 on smithi039 2024-09-12T01:51:51.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:51:51.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:51 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:51.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:51 smithi172 ceph-mon[35073]: Deploying daemon osd.6 on smithi039 2024-09-12T01:51:52.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:52 smithi039 ceph-mon[31204]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:51:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:52 smithi044 ceph-mon[35259]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:51:52.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:52 smithi172 ceph-mon[35073]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:51:54.667 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:54 smithi039 ceph-mon[31204]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:51:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:54 smithi044 ceph-mon[35259]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:51:54.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:54 smithi172 ceph-mon[35073]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T01:51:56.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:56 smithi039 ceph-mon[31204]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:56.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:56 smithi044 ceph-mon[35259]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:56.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:56 smithi172 ceph-mon[35073]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:57.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:57.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:57.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:57.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:51:58.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:51:58 smithi039 ceph-mon[31204]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:51:58 smithi172 ceph-mon[35073]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:51:58.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:51:58 smithi044 ceph-mon[35259]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:00 smithi172 ceph-mon[35073]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:00.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:00.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:00.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:00 smithi039 ceph-mon[31204]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:00.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:00.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:00 smithi044 ceph-mon[35259]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.430+0000 7fbf7cff9640 1 -- 172.21.15.39:0/2531284835 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf80062630 con 0x7fbf680a2c30 2024-09-12T01:52:01.431 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 6 on host 'smithi039' 2024-09-12T01:52:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 msgr2=0x7fbf680a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 0x7fbf680a50f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf70005d00 tx=0x7fbf7000b410 comp rx=0 tx=0).stop 2024-09-12T01:52:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 msgr2=0x7fbf801a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf780319f0 tx=0x7fbf7802f450 comp rx=0 tx=0).stop 2024-09-12T01:52:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 shutdown_connections 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf80107920 0x7fbf801a16a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf80104ff0 0x7fbf8019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf680a2c30 0x7fbf680a50f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 --2- 172.21.15.39:0/2531284835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf801026c0 0x7fbf8019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 >> 172.21.15.39:0/2531284835 conn(0x7fbf800fc280 msgr2=0x7fbf80101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.433+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 shutdown_connections 2024-09-12T01:52:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:01.434+0000 7fbf85ea9640 1 -- 172.21.15.39:0/2531284835 wait complete. 2024-09-12T01:52:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:01.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:01.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:01.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:01.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:01.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:02.119 DEBUG:teuthology.orchestra.run.smithi039:osd.6> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T01:52:02.121 INFO:tasks.cephadm:Deploying osd.7 on smithi044 with /dev/vg_nvme/lv_2... 2024-09-12T01:52:02.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:52:02.383 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:52:02.784 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:02 smithi044 ceph-mon[35259]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:02.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:02 smithi039 ceph-mon[31204]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:02 smithi172 ceph-mon[35073]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:03.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:03 smithi039 ceph-mon[31204]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:52:03.661 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 01:52:03 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T01:52:03.339+0000 7fcded564640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:52:03.863 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:03 smithi044 ceph-mon[35259]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:52:04.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:03 smithi172 ceph-mon[35073]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:52:04.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:04 smithi044 ceph-mon[35259]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:04.702 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:04 smithi044 ceph-mon[35259]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:52:04.702 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:04 smithi044 ceph-mon[35259]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:52:04.702 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:04 smithi044 ceph-mon[35259]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:52:04.702 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-mon[31204]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-mon[31204]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:52:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-mon[31204]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:52:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-mon[31204]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:52:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:04.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T01:52:04.591+0000 7fcde94e7640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:52:04.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 01:52:04 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T01:52:04.599+0000 7fcde530f640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:52:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:04 smithi172 ceph-mon[35073]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:05.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:04 smithi172 ceph-mon[35073]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:52:05.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:04 smithi172 ceph-mon[35073]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T01:52:05.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:04 smithi172 ceph-mon[35073]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:52:05.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.333 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:52:05.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-09-12T01:52:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.875 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.876 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:05 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:52:05.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:52:05.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:05.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:05 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:52:06.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:52:06.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:06.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:05 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 -- 172.21.15.44:0/119520626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 msgr2=0x7fa5b010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/119520626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b010a050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009be0 tx=0x7fa5a802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 -- 172.21.15.44:0/119520626 shutdown_connections 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/119520626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b010a050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/119520626 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/119520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 0x7fa5b0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 -- 172.21.15.44:0/119520626 >> 172.21.15.44:0/119520626 conn(0x7fa5b00fd390 msgr2=0x7fa5b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 -- 172.21.15.44:0/119520626 shutdown_connections 2024-09-12T01:52:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.084+0000 7fa5b7bca640 1 -- 172.21.15.44:0/119520626 wait complete. 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 Processor -- start 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 -- start start 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 0x7fa5b0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b010d830 con 0x7fa5b0102e00 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b010d6b0 con 0x7fa5b01037c0 2024-09-12T01:52:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b7bca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b010d9b0 con 0x7fa5b0101c00 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50702/0 (socket says 172.21.15.44:50702) 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 -- 172.21.15.44:0/1254238114 learned_addr learned my addr 172.21.15.44:0/1254238114 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b5165640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b5966640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 0x7fa5b0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 -- 172.21.15.44:0/1254238114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 msgr2=0x7fa5b0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 0x7fa5b0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 -- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 msgr2=0x7fa5b00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b6167640 1 -- 172.21.15.44:0/1254238114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b00753e0 con 0x7fa5b01037c0 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.085+0000 7fa5b5165640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5b6167640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009370 tx=0x7fa5a80305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:06.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8041020 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5a8037040 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b01a1fe0 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8036070 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.086+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b01a2490 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.087+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b0109050 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.088+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa5a8044020 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.089+0000 7fa5a6ffd640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 0x7fa59c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.089+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4965+0+0 (secure 0 0 0) 0x7fa5a80ef360 con 0x7fa5b01037c0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.089+0000 7fa5b5966640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 0x7fa59c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.089+0000 7fa5b5966640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 0x7fa59c0a50c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0058c0 tx=0x7fa5ac00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.092+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5a804b020 con 0x7fa5b01037c0 2024-09-12T01:52:06.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:06.275+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa5b0062630 con 0x7fa59c0a2c00 2024-09-12T01:52:06.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:52:06.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi039 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] boot 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:06.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:06 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi039 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T01:52:06.920 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] boot 2024-09-12T01:52:06.921 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T01:52:06.921 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:06.921 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:06.921 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:06.921 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:06 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:52:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi039 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: osd.6 [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] boot 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:07.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:06 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:07.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:07 smithi044 ceph-mon[35259]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:07.677 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:07 smithi044 ceph-mon[35259]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:52:07.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:07 smithi039 ceph-mon[31204]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:07.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:07 smithi039 ceph-mon[31204]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:52:08.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:07 smithi172 ceph-mon[35073]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:08.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:07 smithi172 ceph-mon[35073]: osdmap e42: 7 total, 7 up, 7 in 2024-09-12T01:52:08.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:08 smithi044 ceph-mon[35259]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:08.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:08 smithi039 ceph-mon[31204]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:08 smithi172 ceph-mon[35073]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:09.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/1214967537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:09.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]': finished 2024-09-12T01:52:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T01:52:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:09 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/2286882442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/1214967537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]': finished 2024-09-12T01:52:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T01:52:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:09.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:09 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/2286882442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/1214967537' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]: dispatch 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7e20a32-eae3-49a7-9c4e-e3d581b5aef6"}]': finished 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:09 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/2286882442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:11.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:10 smithi039 ceph-mon[31204]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:11.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:10 smithi044 ceph-mon[35259]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:10 smithi172 ceph-mon[35073]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:13.056 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:12 smithi172 ceph-mon[35073]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:13.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:12 smithi039 ceph-mon[31204]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:12 smithi044 ceph-mon[35259]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:14 smithi044 ceph-mon[35259]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:14 smithi039 ceph-mon[31204]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:14 smithi172 ceph-mon[35073]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:16 smithi039 ceph-mon[31204]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:16 smithi044 ceph-mon[35259]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:16 smithi172 ceph-mon[35073]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:18 smithi039 ceph-mon[31204]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:52:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:18 smithi039 ceph-mon[31204]: Deploying daemon osd.7 on smithi044 2024-09-12T01:52:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:18 smithi044 ceph-mon[35259]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:52:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:18 smithi044 ceph-mon[35259]: Deploying daemon osd.7 on smithi044 2024-09-12T01:52:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:18 smithi172 ceph-mon[35073]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:52:19.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:19.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:18 smithi172 ceph-mon[35073]: Deploying daemon osd.7 on smithi044 2024-09-12T01:52:21.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:20 smithi044 ceph-mon[35259]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:21.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:20 smithi039 ceph-mon[31204]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:20 smithi172 ceph-mon[35073]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:22.918 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:22 smithi044 ceph-mon[35259]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:23.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:22 smithi039 ceph-mon[31204]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:23.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:22 smithi172 ceph-mon[35073]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:25.032 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:24 smithi044 ceph-mon[35259]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:25.032 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:25.032 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:25.032 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:24 smithi039 ceph-mon[31204]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:25.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:25.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:24 smithi172 ceph-mon[35073]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:25.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:25.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:26 smithi039 ceph-mon[31204]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:26 smithi044 ceph-mon[35259]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:26 smithi172 ceph-mon[35073]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.098 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:28 smithi044 ceph-mon[35259]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:28.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.143+0000 7fa5a6ffd640 1 -- 172.21.15.44:0/1254238114 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa5b0062630 con 0x7fa59c0a2c00 2024-09-12T01:52:28.144 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 7 on host 'smithi044' 2024-09-12T01:52:28.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 msgr2=0x7fa59c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:28.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 0x7fa59c0a50c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0058c0 tx=0x7fa5ac00a4c0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 msgr2=0x7fa5b0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:28.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009370 tx=0x7fa5a80305d0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 shutdown_connections 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5b01037c0 0x7fa5b0074b20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa5b0102e00 0x7fa5b00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa59c0a2c00 0x7fa59c0a50c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 --2- 172.21.15.44:0/1254238114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b0101c00 0x7fa5b0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 >> 172.21.15.44:0/1254238114 conn(0x7fa5b00fd390 msgr2=0x7fa5b0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 shutdown_connections 2024-09-12T01:52:28.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:52:28.146+0000 7fa5b7bca640 1 -- 172.21.15.44:0/1254238114 wait complete. 2024-09-12T01:52:28.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:28.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:28.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:28 smithi039 ceph-mon[31204]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:28.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:28.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:28.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:28.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:28 smithi172 ceph-mon[35073]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:28.837 DEBUG:teuthology.orchestra.run.smithi044:osd.7> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T01:52:28.840 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-12T01:52:28.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:52:29.097 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:52:29.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:29 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:29.136 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:29 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:29.136 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:29 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:29.219 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:29 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:29.219 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:29 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:29.219 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:29 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:29.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:29 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:29.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:29 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:29.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:29 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:30.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:30 smithi172 ceph-mon[35073]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:30.320 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:30 smithi044 ceph-mon[35259]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:30.320 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 01:52:30 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T01:52:30.048+0000 7fa07ed40640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:52:30.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:30 smithi039 ceph-mon[31204]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:31.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:31 smithi172 ceph-mon[35073]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.283 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:31 smithi172 ceph-mon[35073]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:31 smithi039 ceph-mon[31204]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:31 smithi039 ceph-mon[31204]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:31 smithi044 ceph-mon[35259]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:31 smithi044 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:52:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:52:31.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-12T01:52:32.114 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:52:32.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T01:52:32.067+0000 7fa07acc3640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:52:32.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T01:52:32.076+0000 7fa076aeb640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:52:32.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi044 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T01:52:32.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:32.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:32.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.237 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:52:32.237 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:52:32.237 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:32.237 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.237 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi044 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:32.238 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi044 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:32.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 -- 172.21.15.172:0/1774205785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678102690 msgr2=0x7fb678108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 --2- 172.21.15.172:0/1774205785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678102690 0x7fb678108f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb670009ca0 tx=0x7fb67002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 -- 172.21.15.172:0/1774205785 shutdown_connections 2024-09-12T01:52:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 --2- 172.21.15.172:0/1774205785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678102690 0x7fb678108f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 --2- 172.21.15.172:0/1774205785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678101cd0 0x7fb678102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 --2- 172.21.15.172:0/1774205785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678100ad0 0x7fb678100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 -- 172.21.15.172:0/1774205785 >> 172.21.15.172:0/1774205785 conn(0x7fb6780fc280 msgr2=0x7fb6780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:32.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 -- 172.21.15.172:0/1774205785 shutdown_connections 2024-09-12T01:52:32.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.582+0000 7fb67d62a640 1 -- 172.21.15.172:0/1774205785 wait complete. 2024-09-12T01:52:32.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.583+0000 7fb67d62a640 1 Processor -- start 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.583+0000 7fb67d62a640 1 -- start start 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.583+0000 7fb67d62a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 0x7fb6781972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 0x7fb67819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810c730 con 0x7fb678102690 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810c5b0 con 0x7fb678101cd0 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810c8b0 con 0x7fb678100ad0 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:32.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41888/0 (socket says 172.21.15.172:41888) 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 -- 172.21.15.172:0/3228866877 learned_addr learned my addr 172.21.15.172:0/3228866877 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb66ffff640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 0x7fb6781972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb6777fe640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 0x7fb67819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 -- 172.21.15.172:0/3228866877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 msgr2=0x7fb6781972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 0x7fb6781972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 -- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 msgr2=0x7fb67819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 0x7fb67819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 -- 172.21.15.172:0/3228866877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67819e9c0 con 0x7fb678100ad0 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb66ffff640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 0x7fb6781972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb6777fe640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 0x7fb67819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb676ffd640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb668009860 tx=0x7fb668009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:32.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668004020 con 0x7fb678100ad0 2024-09-12T01:52:32.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb668007c80 con 0x7fb678100ad0 2024-09-12T01:52:32.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668003b90 con 0x7fb678100ad0 2024-09-12T01:52:32.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb678069fd0 con 0x7fb678100ad0 2024-09-12T01:52:32.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.584+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67806a560 con 0x7fb678100ad0 2024-09-12T01:52:32.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.585+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb678100ed0 con 0x7fb678100ad0 2024-09-12T01:52:32.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.586+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb668003d30 con 0x7fb678100ad0 2024-09-12T01:52:32.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.587+0000 7fb674ff9640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 0x7fb6640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:32.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.587+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7fb6680cf880 con 0x7fb678100ad0 2024-09-12T01:52:32.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.587+0000 7fb66ffff640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 0x7fb6640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:32.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.588+0000 7fb66ffff640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 0x7fb6640a50c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb6600058c0 tx=0x7fb660005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:32.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.591+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb66809d460 con 0x7fb678100ad0 2024-09-12T01:52:32.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:32.768+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb67806a7c0 con 0x7fb6640a2c00 2024-09-12T01:52:33.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:52:33.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:52:33.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:52:33.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:52:33.410 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:33 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:52:33.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:33.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:33 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:52:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:52:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:52:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: osdmap e45: 8 total, 7 up, 8 in 2024-09-12T01:52:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:33.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:33.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:33.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:33.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:33 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:34.139 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:34 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:34 smithi172 ceph-mon[35073]: osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] boot 2024-09-12T01:52:34.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:34 smithi172 ceph-mon[35073]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T01:52:34.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:34 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.140 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:34 smithi172 ceph-mon[35073]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:34.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:34 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:34 smithi039 ceph-mon[31204]: osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] boot 2024-09-12T01:52:34.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:34 smithi039 ceph-mon[31204]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T01:52:34.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:34 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:34 smithi039 ceph-mon[31204]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:34 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:34 smithi044 ceph-mon[35259]: osd.7 [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] boot 2024-09-12T01:52:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:34 smithi044 ceph-mon[35259]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T01:52:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:34 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:52:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:34 smithi044 ceph-mon[35259]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:52:35.357 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:35 smithi172 ceph-mon[35073]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:52:35.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:35 smithi039 ceph-mon[31204]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:52:35.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:35 smithi044 ceph-mon[35259]: osdmap e47: 8 total, 8 up, 8 in 2024-09-12T01:52:36.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:52:36.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/1897454489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]': finished 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:36.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:36 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/2610993891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/1897454489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]': finished 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:52:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:36.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:36.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:36 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/2610993891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:36.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: osdmap e48: 8 total, 8 up, 8 in 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/1897454489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]: dispatch 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9110f1b-fd90-436e-a1c3-234f94c1bffb"}]': finished 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:36.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:36 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/2610993891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:52:37.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:37 smithi039 ceph-mon[31204]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:52:37.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:37 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:37.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:37 smithi044 ceph-mon[35259]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:52:37.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:37 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:37.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:37 smithi172 ceph-mon[35073]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T01:52:37.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:37 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:38 smithi039 ceph-mon[31204]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:52:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:38 smithi039 ceph-mon[31204]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:38.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:38 smithi044 ceph-mon[35259]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:52:38.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:38.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:38 smithi044 ceph-mon[35259]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:38.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:38 smithi172 ceph-mon[35073]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:52:38.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:38.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:38 smithi172 ceph-mon[35073]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:40.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:40 smithi172 ceph-mon[35073]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:40.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:40 smithi039 ceph-mon[31204]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:40.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:40 smithi044 ceph-mon[35259]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:42.617 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:42 smithi172 ceph-mon[35073]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:42.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:42 smithi039 ceph-mon[31204]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:42 smithi044 ceph-mon[35259]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:44.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:44 smithi172 ceph-mon[35073]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:44.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:52:44.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:44.581 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:44 smithi172 ceph-mon[35073]: Deploying daemon osd.8 on smithi172 2024-09-12T01:52:44.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:44 smithi039 ceph-mon[31204]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:44.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:52:44.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:44.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:44 smithi039 ceph-mon[31204]: Deploying daemon osd.8 on smithi172 2024-09-12T01:52:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:44 smithi044 ceph-mon[35259]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:52:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:44 smithi044 ceph-mon[35259]: Deploying daemon osd.8 on smithi172 2024-09-12T01:52:46.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:46 smithi039 ceph-mon[31204]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:46.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:46 smithi172 ceph-mon[35073]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:46.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:46 smithi044 ceph-mon[35259]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:48.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:48 smithi172 ceph-mon[35073]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:48.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:48 smithi039 ceph-mon[31204]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:48 smithi044 ceph-mon[35259]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:50.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:50 smithi039 ceph-mon[31204]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:50.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:50.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:50.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:50 smithi044 ceph-mon[35259]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:50.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:50 smithi172 ceph-mon[35073]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:50.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:50.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:50.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:52 smithi039 ceph-mon[31204]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:52 smithi044 ceph-mon[35259]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:52.680 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:52 smithi172 ceph-mon[35073]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:53.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.028+0000 7fb674ff9640 1 -- 172.21.15.172:0/3228866877 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb67806a7c0 con 0x7fb6640a2c00 2024-09-12T01:52:53.029 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-09-12T01:52:53.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 msgr2=0x7fb6640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 0x7fb6640a50c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb6600058c0 tx=0x7fb660005850 comp rx=0 tx=0).stop 2024-09-12T01:52:53.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 msgr2=0x7fb678196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb668009860 tx=0x7fb668009d20 comp rx=0 tx=0).stop 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 shutdown_connections 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb678102690 0x7fb67819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb678101cd0 0x7fb6781972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb6640a2c00 0x7fb6640a50c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 --2- 172.21.15.172:0/3228866877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb678100ad0 0x7fb678196da0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 >> 172.21.15.172:0/3228866877 conn(0x7fb6780fc280 msgr2=0x7fb678105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 shutdown_connections 2024-09-12T01:52:53.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:52:53.031+0000 7fb67d62a640 1 -- 172.21.15.172:0/3228866877 wait complete. 2024-09-12T01:52:53.671 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T01:52:53.673 INFO:tasks.cephadm:Deploying osd.9 on smithi039 with /dev/vg_nvme/lv_1... 2024-09-12T01:52:53.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:52:53.949 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:54.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:54 smithi044 ceph-mon[35259]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:54 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:54 smithi039 ceph-mon[31204]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:54.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:54 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-mon[35073]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:54.323 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:54.324 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:55.193 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:55 smithi172 ceph-mon[35073]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:55.193 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:55 smithi172 ceph-mon[35073]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:55.193 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 01:52:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T01:52:54.841+0000 7fe1989d1640 -1 osd.8 0 log_to_monitors true 2024-09-12T01:52:55.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:55 smithi039 ceph-mon[31204]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:55.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:55 smithi039 ceph-mon[31204]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:55 smithi044 ceph-mon[35259]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:55 smithi044 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:52:56.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:52:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:52:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:56 smithi039 ceph-mon[31204]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:52:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:52:56.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:56 smithi044 ceph-mon[35259]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:56.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:52:56.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: from='osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:52:56.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:56.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:52:56.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-mon[35073]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:52:56.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T01:52:56.050+0000 7fe194954640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T01:52:56.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 01:52:56 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T01:52:56.063+0000 7fe19077c640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:52:56.946 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:52:56.976 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2024-09-12T01:52:57.243 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] boot 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi172 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:57.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:57.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:57 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:52:57.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:52:57.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.374 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] boot 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi172 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:57.375 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:57 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:52:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:52:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: osd.8 [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] boot 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: osdmap e54: 9 total, 9 up, 9 in 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi172 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:57.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:57.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:57 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- 172.21.15.39:0/3358713125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 msgr2=0x7f8b50108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 --2- 172.21.15.39:0/3358713125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b50108f60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009ca0 tx=0x7f8b4802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- 172.21.15.39:0/3358713125 shutdown_connections 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 --2- 172.21.15.39:0/3358713125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b50108f60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 --2- 172.21.15.39:0/3358713125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50101d10 0x7f8b50102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 --2- 172.21.15.39:0/3358713125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50100b10 0x7f8b50100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- 172.21.15.39:0/3358713125 >> 172.21.15.39:0/3358713125 conn(0x7f8b500fc2a0 msgr2=0x7f8b500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- 172.21.15.39:0/3358713125 shutdown_connections 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- 172.21.15.39:0/3358713125 wait complete. 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 Processor -- start 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.791+0000 7f8b5720e640 1 -- start start 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50100b10 0x7f8b5006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50101d10 0x7f8b5019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5010c790 con 0x7f8b501026d0 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5010c610 con 0x7f8b50100b10 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5010c910 con 0x7f8b50101d10 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41490/0 (socket says 172.21.15.39:41490) 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 -- 172.21.15.39:0/1952165819 learned_addr learned my addr 172.21.15.39:0/1952165819 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b54faa640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50100b10 0x7f8b5006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b4ffff640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50101d10 0x7f8b5019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 -- 172.21.15.39:0/1952165819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50101d10 msgr2=0x7f8b5019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50101d10 0x7f8b5019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 -- 172.21.15.39:0/1952165819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50100b10 msgr2=0x7f8b5006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50100b10 0x7f8b5006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 -- 172.21.15.39:0/1952165819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5019fb40 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b557ab640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005e30 tx=0x7f8b48031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48003c30 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b48003dd0 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.792+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5019fd70 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.793+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4802fde0 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.793+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b501a02d0 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.794+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b50107ee0 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.795+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8b48004050 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.795+0000 7f8b4dffb640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 0x7f8b400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.796+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5858+0+0 (secure 0 0 0) 0x7f8b480ef950 con 0x7f8b501026d0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.796+0000 7f8b54faa640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 0x7f8b400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.796+0000 7f8b54faa640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 0x7f8b400a50c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005fd0 tx=0x7f8b4400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.800+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b480bd240 con 0x7f8b501026d0 2024-09-12T01:52:57.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:52:57.983+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8b50062630 con 0x7f8b400a2c00 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:58.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:58.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:58.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:58.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:52:58.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:52:58.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:58.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:58.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:58.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:52:58.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: osdmap e55: 9 total, 9 up, 9 in 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:52:58.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:59 smithi039 ceph-mon[31204]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:59.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:52:59 smithi039 ceph-mon[31204]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:52:59.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:59 smithi044 ceph-mon[35259]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:59.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:52:59 smithi044 ceph-mon[35259]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:52:59.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:59 smithi172 ceph-mon[35073]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:59.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:52:59 smithi172 ceph-mon[35073]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:53:00.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:00 smithi039 ceph-mon[31204]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:00.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:00 smithi039 ceph-mon[31204]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:53:00.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:00 smithi044 ceph-mon[35259]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:00.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:00 smithi044 ceph-mon[35259]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:53:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:00 smithi172 ceph-mon[35073]: pgmap v194: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:53:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:00 smithi172 ceph-mon[35073]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T01:53:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:53:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]: dispatch 2024-09-12T01:53:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]': finished 2024-09-12T01:53:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:53:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:01.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2584128467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]: dispatch 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]': finished 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2584128467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:01.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T01:53:01.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]: dispatch 2024-09-12T01:53:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1886574269' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2b585a6-7a63-46fa-a8cc-7da114411b5e"}]': finished 2024-09-12T01:53:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:53:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:01.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2584128467' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:02 smithi172 ceph-mon[35073]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-12T01:53:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:02 smithi039 ceph-mon[31204]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-12T01:53:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:02 smithi044 ceph-mon[35259]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-12T01:53:03.660 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:53:03 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:53:03.175+0000 7f851b275640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-12T01:53:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:04 smithi172 ceph-mon[35073]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-12T01:53:05.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:04 smithi039 ceph-mon[31204]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-12T01:53:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:04 smithi044 ceph-mon[35259]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-12T01:53:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:06 smithi172 ceph-mon[35073]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:07.034 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:06 smithi039 ceph-mon[31204]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:07.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:06 smithi044 ceph-mon[35259]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:08.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:08 smithi039 ceph-mon[31204]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:08 smithi172 ceph-mon[35073]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:09.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:08 smithi044 ceph-mon[35259]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:53:10.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:09 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:10.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:53:10.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:09 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:10.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:53:10.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:09 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:10 smithi172 ceph-mon[35073]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:10 smithi172 ceph-mon[35073]: Deploying daemon osd.9 on smithi039 2024-09-12T01:53:11.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:10 smithi039 ceph-mon[31204]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:11.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:10 smithi039 ceph-mon[31204]: Deploying daemon osd.9 on smithi039 2024-09-12T01:53:11.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:10 smithi044 ceph-mon[35259]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:11.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:10 smithi044 ceph-mon[35259]: Deploying daemon osd.9 on smithi039 2024-09-12T01:53:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:12 smithi039 ceph-mon[31204]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:12 smithi172 ceph-mon[35073]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:12 smithi044 ceph-mon[35259]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:14 smithi039 ceph-mon[31204]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:14 smithi044 ceph-mon[35259]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:15.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:14 smithi172 ceph-mon[35073]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:16 smithi039 ceph-mon[31204]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:16.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:16.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:16.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:17.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:16 smithi172 ceph-mon[35073]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:17.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:17.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:16 smithi044 ceph-mon[35259]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:18.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:18 smithi039 ceph-mon[31204]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:18 smithi044 ceph-mon[35259]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:18 smithi172 ceph-mon[35073]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:19.282 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 9 on host 'smithi039' 2024-09-12T01:53:19.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.280+0000 7f8b4dffb640 1 -- 172.21.15.39:0/1952165819 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8b50062630 con 0x7f8b400a2c00 2024-09-12T01:53:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.282+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 msgr2=0x7f8b400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.282+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 0x7f8b400a50c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005fd0 tx=0x7f8b4400b390 comp rx=0 tx=0).stop 2024-09-12T01:53:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.282+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 msgr2=0x7f8b5019f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:19.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.282+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005e30 tx=0x7f8b48031ee0 comp rx=0 tx=0).stop 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 shutdown_connections 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8b501026d0 0x7f8b5019f230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8b400a2c00 0x7f8b400a50c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b50101d10 0x7f8b5019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 --2- 172.21.15.39:0/1952165819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b50100b10 0x7f8b5006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:19.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 >> 172.21.15.39:0/1952165819 conn(0x7f8b500fc2a0 msgr2=0x7f8b501050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 shutdown_connections 2024-09-12T01:53:19.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:53:19.283+0000 7f8b5720e640 1 -- 172.21.15.39:0/1952165819 wait complete. 2024-09-12T01:53:20.003 DEBUG:teuthology.orchestra.run.smithi039:osd.9> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T01:53:20.005 INFO:tasks.cephadm:Deploying osd.10 on smithi044 with /dev/vg_nvme/lv_1... 2024-09-12T01:53:20.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:53:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:53:20.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:20 smithi044 ceph-mon[35259]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:20.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:20 smithi039 ceph-mon[31204]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:20 smithi172 ceph-mon[35073]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:20.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:20.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:22.161 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 01:53:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T01:53:21.897+0000 7f7e26219640 -1 osd.9 0 log_to_monitors true 2024-09-12T01:53:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:22 smithi044 ceph-mon[35259]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:22 smithi044 ceph-mon[35259]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:53:22.545 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:22 smithi039 ceph-mon[31204]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:22.545 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:22 smithi039 ceph-mon[31204]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:53:22.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:22 smithi172 ceph-mon[35073]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:22.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:22 smithi172 ceph-mon[35073]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:53:23.264 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T01:53:23.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-09-12T01:53:23.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-mon[31204]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:53:23.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-mon[31204]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:53:23.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-mon[31204]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:53:23.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:53:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:23 smithi044 ceph-mon[35259]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:53:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:23 smithi044 ceph-mon[35259]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:53:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:23 smithi044 ceph-mon[35259]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:53:23.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:23.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:23 smithi172 ceph-mon[35073]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:53:23.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:23 smithi172 ceph-mon[35073]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:53:23.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:23 smithi172 ceph-mon[35073]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T01:53:23.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:23.784 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T01:53:23.666+0000 7f7e2219c640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T01:53:23.784 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 01:53:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T01:53:23.677+0000 7f7e19fbc640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:53:24.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 -- 172.21.15.44:0/563892986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb714101c00 msgr2=0x7fb714102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 --2- 172.21.15.44:0/563892986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb714101c00 0x7fb714102000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb708009900 tx=0x7fb70802a410 comp rx=0 tx=0).stop 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 -- 172.21.15.44:0/563892986 shutdown_connections 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 --2- 172.21.15.44:0/563892986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7141037c0 0x7fb71410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 --2- 172.21.15.44:0/563892986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714102e00 0x7fb714103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 --2- 172.21.15.44:0/563892986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb714101c00 0x7fb714102000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 -- 172.21.15.44:0/563892986 >> 172.21.15.44:0/563892986 conn(0x7fb7140fd390 msgr2=0x7fb7140ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 -- 172.21.15.44:0/563892986 shutdown_connections 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.058+0000 7fb71b092640 1 -- 172.21.15.44:0/563892986 wait complete. 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 Processor -- start 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 -- start start 2024-09-12T01:53:24.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714101c00 0x7fb714197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb714102e00 0x7fb714198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410d880 con 0x7fb714102e00 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410d700 con 0x7fb7141037c0 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71b092640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410da00 con 0x7fb714101c00 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb718e2e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714101c00 0x7fb714197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41308/0 (socket says 172.21.15.44:41308) 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 -- 172.21.15.44:0/3847377708 learned_addr learned my addr 172.21.15.44:0/3847377708 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb713fff640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb714102e00 0x7fb714198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 -- 172.21.15.44:0/3847377708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714101c00 msgr2=0x7fb714197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714101c00 0x7fb714197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 -- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb714102e00 msgr2=0x7fb714198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb714102e00 0x7fb714198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.059+0000 7fb71962f640 1 -- 172.21.15.44:0/3847377708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71419fb30 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb71962f640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00cce0 tx=0x7fb70c00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00f450 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb70c00fad0 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71419fe20 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c018c10 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.060+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7141a0280 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.061+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb714108fd0 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.062+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb70c00f5f0 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.063+0000 7fb711ffb640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 0x7fb7040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.063+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7fb70c0ced30 con 0x7fb7141037c0 2024-09-12T01:53:24.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.063+0000 7fb718e2e640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 0x7fb7040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.063+0000 7fb718e2e640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 0x7fb7040a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb708005ab0 tx=0x7fb708000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:24.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.067+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb70c014030 con 0x7fb7141037c0 2024-09-12T01:53:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:24.253+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb714062630 con 0x7fb7040a2bb0 2024-09-12T01:53:24.658 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:24.658 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:53:24.658 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:53:24.658 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.658 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi039 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.659 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.660 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:24.661 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:24.661 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:24 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi039 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:24.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:24 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551]' entity='osd.9' 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi039 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:24.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:24 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] boot 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:53:25.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:25 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:25.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:53:25.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:53:25.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:25.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:25.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] boot 2024-09-12T01:53:25.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:53:25.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:25 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:25.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: osd.9 [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] boot 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: osdmap e62: 10 total, 10 up, 10 in 2024-09-12T01:53:25.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:25 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:53:26.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:26 smithi044 ceph-mon[35259]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:26.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:26 smithi044 ceph-mon[35259]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:53:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:26 smithi172 ceph-mon[35073]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:26 smithi172 ceph-mon[35073]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:53:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:26 smithi039 ceph-mon[31204]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:53:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:26 smithi039 ceph-mon[31204]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:53:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/4283264431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]': finished 2024-09-12T01:53:28.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:53:28.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:28.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:27 smithi172 ceph-mon[35073]: from='client.? 172.21.15.44:0/174100730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:28.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/4283264431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]': finished 2024-09-12T01:53:28.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:53:28.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:28.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:27 smithi039 ceph-mon[31204]: from='client.? 172.21.15.44:0/174100730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/4283264431' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]: dispatch 2024-09-12T01:53:28.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bf3e359-92ab-4cea-8324-7be533216576"}]': finished 2024-09-12T01:53:28.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: osdmap e64: 11 total, 10 up, 11 in 2024-09-12T01:53:28.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:28.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:27 smithi044 ceph-mon[35259]: from='client.? 172.21.15.44:0/174100730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:29.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:28 smithi039 ceph-mon[31204]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:28 smithi044 ceph-mon[35259]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:28 smithi172 ceph-mon[35073]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:30 smithi039 ceph-mon[31204]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:31.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:30 smithi044 ceph-mon[35259]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:30 smithi172 ceph-mon[35073]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:33.144 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:32 smithi044 ceph-mon[35259]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:32 smithi039 ceph-mon[31204]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:32 smithi172 ceph-mon[35073]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:35.147 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:34 smithi044 ceph-mon[35259]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:35.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:34 smithi039 ceph-mon[31204]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:34 smithi172 ceph-mon[35073]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:36.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:35 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:53:36.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:35 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:36.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:35 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:53:36.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:35 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:36.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:35 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:53:36.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:35 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:37.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:36 smithi039 ceph-mon[31204]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:37.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:36 smithi039 ceph-mon[31204]: Deploying daemon osd.10 on smithi044 2024-09-12T01:53:37.165 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:36 smithi044 ceph-mon[35259]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:37.165 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:36 smithi044 ceph-mon[35259]: Deploying daemon osd.10 on smithi044 2024-09-12T01:53:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:36 smithi172 ceph-mon[35073]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:36 smithi172 ceph-mon[35073]: Deploying daemon osd.10 on smithi044 2024-09-12T01:53:39.121 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:38 smithi044 ceph-mon[35259]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:39.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:38 smithi039 ceph-mon[31204]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:38 smithi172 ceph-mon[35073]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:40.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:40 smithi044 ceph-mon[35259]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:41.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:40 smithi039 ceph-mon[31204]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:40 smithi172 ceph-mon[35073]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:42.050 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:42.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:42.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:42.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:43.120 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:42 smithi044 ceph-mon[35259]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:43.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:42 smithi039 ceph-mon[31204]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:42 smithi172 ceph-mon[35073]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:45.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.020+0000 7fb711ffb640 1 -- 172.21.15.44:0/3847377708 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb714062630 con 0x7fb7040a2bb0 2024-09-12T01:53:45.021 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 10 on host 'smithi044' 2024-09-12T01:53:45.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 msgr2=0x7fb7040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 0x7fb7040a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb708005ab0 tx=0x7fb708000bc0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 msgr2=0x7fb71419f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00cce0 tx=0x7fb70c00a620 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 shutdown_connections 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7141037c0 0x7fb71419f4c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb714102e00 0x7fb714198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb7040a2bb0 0x7fb7040a5070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 --2- 172.21.15.44:0/3847377708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb714101c00 0x7fb714197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 >> 172.21.15.44:0/3847377708 conn(0x7fb7140fd390 msgr2=0x7fb7141061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 shutdown_connections 2024-09-12T01:53:45.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T01:53:45.023+0000 7fb71b092640 1 -- 172.21.15.44:0/3847377708 wait complete. 2024-09-12T01:53:45.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:45.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:45.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:45.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:45.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:45.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:45.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:45.775 DEBUG:teuthology.orchestra.run.smithi044:osd.10> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T01:53:45.778 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-12T01:53:45.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:53:46.027 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:45 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:46.027 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:45 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.027 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:45 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.036 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:53:46.157 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:45 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:46.157 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:45 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.157 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:45 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:45 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:46.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:45 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:45 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:46.889 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 01:53:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T01:53:46.860+0000 7f16a4a7f640 -1 osd.10 0 log_to_monitors true 2024-09-12T01:53:47.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:46 smithi039 ceph-mon[31204]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:47.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:46 smithi039 ceph-mon[31204]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:47.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:46 smithi039 ceph-mon[31204]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:46 smithi044 ceph-mon[35259]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:46 smithi044 ceph-mon[35259]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:46 smithi044 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:47.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:46 smithi172 ceph-mon[35073]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:47.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:46 smithi172 ceph-mon[35073]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:47.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:46 smithi172 ceph-mon[35073]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:53:48.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:53:48.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:53:48.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:48.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:48 smithi039 ceph-mon[31204]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:48.193 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:53:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:53:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.194 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:48 smithi172 ceph-mon[35073]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:48.297 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T01:53:48.037+0000 7f16a0a02640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T01:53:48.298 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T01:53:48.047+0000 7f169c82a640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: from='osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T01:53:48.298 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:48 smithi044 ceph-mon[35259]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:48.802 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T01:53:48.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-12T01:53:49.092 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:53:49.213 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:53:49.213 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi044 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:49.214 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi044 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:49.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:49.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T01:53:49.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi044 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:49.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 -- 172.21.15.172:0/1591010634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 msgr2=0x7fa150102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 --2- 172.21.15.172:0/1591010634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150102000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa144009900 tx=0x7fa14402a410 comp rx=0 tx=0).stop 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 -- 172.21.15.172:0/1591010634 shutdown_connections 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 --2- 172.21.15.172:0/1591010634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1501037c0 0x7fa15010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 --2- 172.21.15.172:0/1591010634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa150102e00 0x7fa150103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 --2- 172.21.15.172:0/1591010634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150102000 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 -- 172.21.15.172:0/1591010634 >> 172.21.15.172:0/1591010634 conn(0x7fa1500fd390 msgr2=0x7fa1500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 -- 172.21.15.172:0/1591010634 shutdown_connections 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.579+0000 7fa156cfe640 1 -- 172.21.15.172:0/1591010634 wait complete. 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 Processor -- start 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 -- start start 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa150102e00 0x7fa150198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1501037c0 0x7fa15019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa15010d860 con 0x7fa150102e00 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa15010d6e0 con 0x7fa1501037c0 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa156cfe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa15010d9e0 con 0x7fa150101c00 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa154a9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:49.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa154a9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:32844/0 (socket says 172.21.15.172:32844) 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.580+0000 7fa154a9a640 1 -- 172.21.15.172:0/2594339446 learned_addr learned my addr 172.21.15.172:0/2594339446 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 -- 172.21.15.172:0/2594339446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1501037c0 msgr2=0x7fa15019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1501037c0 0x7fa15019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa14ffff640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa150102e00 0x7fa150198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 -- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa150102e00 msgr2=0x7fa150198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa150102e00 0x7fa150198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 -- 172.21.15.172:0/2594339446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15019fb10 con 0x7fa150101c00 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa154a9a640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa144031610 tx=0x7fa1440043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14403f030 con 0x7fa150101c00 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15019fda0 con 0x7fa150101c00 2024-09-12T01:53:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa144003ce0 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144035070 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.581+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1501a01c0 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.582+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa150109050 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.584+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa144042030 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.584+0000 7fa14dffb640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 0x7fa1400a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.585+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6727+0+0 (secure 0 0 0) 0x7fa1440ef370 con 0x7fa150101c00 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.585+0000 7fa14ffff640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 0x7fa1400a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.585+0000 7fa14ffff640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 0x7fa1400a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa13c005fd0 tx=0x7fa13c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:49.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.588+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1440bc860 con 0x7fa150101c00 2024-09-12T01:53:49.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:53:49.764+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa150062630 con 0x7fa1400a2bb0 2024-09-12T01:53:50.339 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] boot 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:50.340 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:50.341 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:50 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:50.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] boot 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:50.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:50 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:50.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:53:50.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: osd.10 [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] boot 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: osdmap e67: 11 total, 11 up, 11 in 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:53:50.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:50 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:51.210 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:51 smithi172 ceph-mon[35073]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:53:51.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:51 smithi039 ceph-mon[31204]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:53:51.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:51 smithi044 ceph-mon[35259]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:53:52.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:52 smithi172 ceph-mon[35073]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:53:52.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:52 smithi172 ceph-mon[35073]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:52.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:52 smithi172 ceph-mon[35073]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:53:52.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:52 smithi039 ceph-mon[31204]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:53:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:52 smithi039 ceph-mon[31204]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:52.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:52 smithi039 ceph-mon[31204]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:53:52.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:52 smithi044 ceph-mon[35259]: osdmap e69: 11 total, 11 up, 11 in 2024-09-12T01:53:52.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:52 smithi044 ceph-mon[35259]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:52.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:52 smithi044 ceph-mon[35259]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T01:53:53.389 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/566282558' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]': finished 2024-09-12T01:53:53.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:53:53.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:53:53.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:53 smithi044 ceph-mon[35259]: from='client.? 172.21.15.172:0/3889069099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:53.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/566282558' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]': finished 2024-09-12T01:53:53.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:53:53.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:53:53.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:53 smithi039 ceph-mon[31204]: from='client.? 172.21.15.172:0/3889069099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/566282558' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]: dispatch 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4246243b-00ad-474b-9b8f-5dca402c7de2"}]': finished 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:53:53.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:53 smithi172 ceph-mon[35073]: from='client.? 172.21.15.172:0/3889069099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:53:54.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:54 smithi039 ceph-mon[31204]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:54.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:54 smithi044 ceph-mon[35259]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:54.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:54 smithi172 ceph-mon[35073]: pgmap v236: 1 pgs: 1 remapped+peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:53:56.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:56 smithi039 ceph-mon[31204]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-12T01:53:56.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:56 smithi044 ceph-mon[35259]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-12T01:53:56.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:56 smithi172 ceph-mon[35073]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-12T01:53:58.616 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:53:58 smithi172 ceph-mon[35073]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:53:58.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:53:58 smithi039 ceph-mon[31204]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:53:58.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:53:58 smithi044 ceph-mon[35259]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-12T01:54:00.622 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:00 smithi172 ceph-mon[35073]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:00.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:00 smithi039 ceph-mon[31204]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:00.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:00 smithi044 ceph-mon[35259]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:54:01.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:54:01.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:01 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:01.592 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:01 smithi172 ceph-mon[35073]: Deploying daemon osd.11 on smithi172 2024-09-12T01:54:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:54:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:01 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:01 smithi039 ceph-mon[31204]: Deploying daemon osd.11 on smithi172 2024-09-12T01:54:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:54:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:01 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:01 smithi044 ceph-mon[35259]: Deploying daemon osd.11 on smithi172 2024-09-12T01:54:02.387 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:02 smithi172 ceph-mon[35073]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:54:02.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:02 smithi039 ceph-mon[31204]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:54:02.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:02 smithi044 ceph-mon[35259]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:54:04.577 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:04 smithi172 ceph-mon[35073]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T01:54:04.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:04 smithi039 ceph-mon[31204]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T01:54:04.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:04 smithi044 ceph-mon[35259]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T01:54:06.637 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:06 smithi172 ceph-mon[35073]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:54:06.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:06 smithi039 ceph-mon[31204]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:54:06.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:06 smithi044 ceph-mon[35259]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:54:07.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:07 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:07.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:07 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:07.613 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:07 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:07.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:07.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:07.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:07 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:07.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:07 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:07.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:07 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:07.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:07 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:09.074 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:08 smithi172 ceph-mon[35073]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:09.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:08 smithi039 ceph-mon[31204]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:09.536 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:08 smithi044 ceph-mon[35259]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:10.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.301+0000 7fa14dffb640 1 -- 172.21.15.172:0/2594339446 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa150062630 con 0x7fa1400a2bb0 2024-09-12T01:54:10.301 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-09-12T01:54:10.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 msgr2=0x7fa1400a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:10.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 0x7fa1400a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa13c005fd0 tx=0x7fa13c005850 comp rx=0 tx=0).stop 2024-09-12T01:54:10.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 msgr2=0x7fa150197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:10.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa144031610 tx=0x7fa1440043b0 comp rx=0 tx=0).stop 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 shutdown_connections 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1501037c0 0x7fa15019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa150102e00 0x7fa150198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa1400a2bb0 0x7fa1400a5070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 --2- 172.21.15.172:0/2594339446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa150101c00 0x7fa150197ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 >> 172.21.15.172:0/2594339446 conn(0x7fa1500fd390 msgr2=0x7fa150106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 shutdown_connections 2024-09-12T01:54:10.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:10.304+0000 7fa156cfe640 1 -- 172.21.15.172:0/2594339446 wait complete. 2024-09-12T01:54:10.940 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T01:54:10.943 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T01:54:10.943 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:54:11.216 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:10 smithi172 ceph-mon[35073]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:10 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:10 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.339 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:10 smithi039 ceph-mon[31204]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:11.339 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:10 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.339 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:10 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:10 smithi044 ceph-mon[35259]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:10 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:10 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 -- 172.21.15.39:0/3203852756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 msgr2=0x7faf88100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 --2- 172.21.15.39:0/3203852756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf88100f00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf78009ca0 tx=0x7faf7802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 -- 172.21.15.39:0/3203852756 shutdown_connections 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 --2- 172.21.15.39:0/3203852756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 0x7faf88108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 --2- 172.21.15.39:0/3203852756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 0x7faf88102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 --2- 172.21.15.39:0/3203852756 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf88100f00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 -- 172.21.15.39:0/3203852756 >> 172.21.15.39:0/3203852756 conn(0x7faf880fc270 msgr2=0x7faf880fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 -- 172.21.15.39:0/3203852756 shutdown_connections 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.703+0000 7faf9012c640 1 -- 172.21.15.39:0/3203852756 wait complete. 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 Processor -- start 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 -- start start 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 0x7faf8819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 0x7faf8819f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faf8810c780 con 0x7faf88100b00 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf8810c600 con 0x7faf881026c0 2024-09-12T01:54:11.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf9012c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf8810c900 con 0x7faf88101d00 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42428/0 (socket says 172.21.15.39:42428) 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 -- 172.21.15.39:0/4070686914 learned_addr learned my addr 172.21.15.39:0/4070686914 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8e6c9640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 0x7faf8819f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8d6c7640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 0x7faf8819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 -- 172.21.15.39:0/4070686914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 msgr2=0x7faf8819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 0x7faf8819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 -- 172.21.15.39:0/4070686914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 msgr2=0x7faf8819f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 0x7faf8819f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 -- 172.21.15.39:0/4070686914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8819fc80 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.704+0000 7faf8dec8640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf78000f80 tx=0x7faf78031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.705+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7802faa0 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.705+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7802fc40 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.705+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8819feb0 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.705+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf780468a0 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.705+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf881a03b0 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.706+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf88108040 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.707+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faf78004b40 con 0x7faf88100b00 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.708+0000 7faf86ffd640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 0x7faf700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.708+0000 7faf8d6c7640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 0x7faf700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.708+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7faf780eff80 con 0x7faf88100b00 2024-09-12T01:54:11.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.708+0000 7faf8d6c7640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 0x7faf700a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf8806b870 tx=0x7faf7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.711+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf780bd550 con 0x7faf88100b00 2024-09-12T01:54:11.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.887+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faf8802da10 con 0x7faf88100b00 2024-09-12T01:54:11.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.887+0000 7faf86ffd640 1 -- 172.21.15.39:0/4070686914 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7faf780bce50 con 0x7faf88100b00 2024-09-12T01:54:11.889 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:11.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.889+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 msgr2=0x7faf700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.889+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 0x7faf700a50c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf8806b870 tx=0x7faf7c005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:11.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.889+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 msgr2=0x7faf8806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.889+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf78000f80 tx=0x7faf78031ee0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 shutdown_connections 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf881026c0 0x7faf8819f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7faf700a2c00 0x7faf700a50c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf88101d00 0x7faf8819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 --2- 172.21.15.39:0/4070686914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faf88100b00 0x7faf8806b2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 >> 172.21.15.39:0/4070686914 conn(0x7faf880fc270 msgr2=0x7faf88105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 shutdown_connections 2024-09-12T01:54:11.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:11.890+0000 7faf9012c640 1 -- 172.21.15.39:0/4070686914 wait complete. 2024-09-12T01:54:12.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.389 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:12 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.389 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:12 smithi039 ceph-mon[31204]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:12.389 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:12 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4070686914' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:12.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:12 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:12 smithi044 ceph-mon[35259]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:12.390 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:12 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4070686914' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:12.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:12 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:12.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:12 smithi172 ceph-mon[35073]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:12.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:12 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4070686914' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:12.645 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726106029,"num_in_osds":12,"osd_in_since":1726106032,"num_remapped_pgs":0} 2024-09-12T01:54:12.981 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 01:54:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T01:54:12.729+0000 7ff067a98640 -1 osd.11 0 log_to_monitors true 2024-09-12T01:54:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:13 smithi172 ceph-mon[35073]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:13 smithi172 ceph-mon[35073]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.341 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:13 smithi044 ceph-mon[35259]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.341 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:13 smithi044 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:13 smithi039 ceph-mon[31204]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:13 smithi039 ceph-mon[31204]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:54:13.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:54:13.915 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:14.186 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:54:14.187 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:54:14.187 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:14.187 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.187 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.187 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-mon[35073]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:14.296 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:54:14.297 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:54:14.297 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:14.297 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.297 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.297 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:14 smithi039 ceph-mon[31204]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 -- 172.21.15.39:0/3784481424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 msgr2=0x7f3214109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 --2- 172.21.15.39:0/3784481424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214109d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f320c009ca0 tx=0x7f320c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 -- 172.21.15.39:0/3784481424 shutdown_connections 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 --2- 172.21.15.39:0/3784481424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214109d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 --2- 172.21.15.39:0/3784481424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214104f90 0x7f3214107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 --2- 172.21.15.39:0/3784481424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214102660 0x7f3214104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 -- 172.21.15.39:0/3784481424 >> 172.21.15.39:0/3784481424 conn(0x7f32140fc280 msgr2=0x7f32140fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 -- 172.21.15.39:0/3784481424 shutdown_connections 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.379+0000 7f32197c6640 1 -- 172.21.15.39:0/3784481424 wait complete. 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 Processor -- start 2024-09-12T01:54:14.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 -- start start 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 0x7f3214101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214104f90 0x7f3214100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f321410d880 con 0x7f32141078c0 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f321410d700 con 0x7f3214102660 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32197c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f321410da00 con 0x7f3214104f90 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32137fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f3212ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 0x7f3214101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32137fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36414/0 (socket says 172.21.15.39:36414) 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32127fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214104f90 0x7f3214100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.380+0000 7f32137fe640 1 -- 172.21.15.39:0/3126354354 learned_addr learned my addr 172.21.15.39:0/3126354354 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:14.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 -- 172.21.15.39:0/3126354354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214104f90 msgr2=0x7f3214100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214104f90 0x7f3214100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 -- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 msgr2=0x7f3214100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 -- 172.21.15.39:0/3126354354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3214101410 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f3212ffd640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 0x7f3214101fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f320400e9f0 tx=0x7f320400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320400ccc0 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32141a2060 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3204005020 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32040049e0 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.381+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141a2520 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.382+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32140fdd70 con 0x7f3214102660 2024-09-12T01:54:14.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.383+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3204005560 con 0x7f3214102660 2024-09-12T01:54:14.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.384+0000 7f31fbfff640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 0x7f31fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:14.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.384+0000 7f32127fc640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 0x7f31fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:14.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.384+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7f32040ce9b0 con 0x7f3214102660 2024-09-12T01:54:14.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.385+0000 7f32127fc640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 0x7f31fc0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32080095f0 tx=0x7f3208005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:14.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.393+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32040051d0 con 0x7f3214102660 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: from='osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T01:54:14.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:14 smithi044 ceph-mon[35259]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:14.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.570+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f321402da30 con 0x7f3214102660 2024-09-12T01:54:14.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.571+0000 7f31fbfff640 1 -- 172.21.15.39:0/3126354354 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f320409bed0 con 0x7f3214102660 2024-09-12T01:54:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 msgr2=0x7f31fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 0x7f31fc0a5040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32080095f0 tx=0x7f3208005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 msgr2=0x7f3214101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 0x7f3214101fc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f320400e9f0 tx=0x7f320400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 shutdown_connections 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32141078c0 0x7f3214100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31fc0a2b80 0x7f31fc0a5040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3214104f90 0x7f3214100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 --2- 172.21.15.39:0/3126354354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3214102660 0x7f3214101fc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 >> 172.21.15.39:0/3126354354 conn(0x7f32140fc280 msgr2=0x7f3214102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 shutdown_connections 2024-09-12T01:54:14.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:14.573+0000 7f32197c6640 1 -- 172.21.15.39:0/3126354354 wait complete. 2024-09-12T01:54:14.753 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T01:54:14.478+0000 7ff06422f640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T01:54:14.753 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 01:54:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T01:54:14.491+0000 7ff05b83b640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: Detected new or changed devices on smithi172 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='osd.11 ' entity='osd.11' 2024-09-12T01:54:15.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:15 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3126354354' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: Detected new or changed devices on smithi172 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='osd.11 ' entity='osd.11' 2024-09-12T01:54:15.425 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:15 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3126354354' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:15.490 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726106029,"num_in_osds":12,"osd_in_since":1726106032,"num_remapped_pgs":0} 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: Detected new or changed devices on smithi172 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.510 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:15.511 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='osd.11 ' entity='osd.11' 2024-09-12T01:54:15.512 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:15 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3126354354' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: purged_snaps scrub starts 2024-09-12T01:54:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: purged_snaps scrub ok 2024-09-12T01:54:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:16.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] boot 2024-09-12T01:54:16.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:54:16.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: purged_snaps scrub starts 2024-09-12T01:54:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: purged_snaps scrub ok 2024-09-12T01:54:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] boot 2024-09-12T01:54:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:54:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:54:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: purged_snaps scrub starts 2024-09-12T01:54:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: purged_snaps scrub ok 2024-09-12T01:54:16.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:54:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: osd.11 [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] boot 2024-09-12T01:54:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T01:54:16.504 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:54:16.759 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:17.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- 172.21.15.39:0/1359981717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 msgr2=0x7f1e30100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 --2- 172.21.15.39:0/1359981717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30100ed0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009900 tx=0x7f1e2002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- 172.21.15.39:0/1359981717 shutdown_connections 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 --2- 172.21.15.39:0/1359981717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30102690 0x7f1e30108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 --2- 172.21.15.39:0/1359981717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30101cd0 0x7f1e30102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 --2- 172.21.15.39:0/1359981717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30100ed0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- 172.21.15.39:0/1359981717 >> 172.21.15.39:0/1359981717 conn(0x7f1e300fc280 msgr2=0x7f1e300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- 172.21.15.39:0/1359981717 shutdown_connections 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- 172.21.15.39:0/1359981717 wait complete. 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 Processor -- start 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.265+0000 7f1e380c0640 1 -- start start 2024-09-12T01:54:17.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30101cd0 0x7f1e30198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 0x7f1e3019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010d8a0 con 0x7f1e30100ad0 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010d720 con 0x7f1e30101cd0 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3010da20 con 0x7f1e30102690 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36438/0 (socket says 172.21.15.39:36438) 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 -- 172.21.15.39:0/4025812417 learned_addr learned my addr 172.21.15.39:0/4025812417 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e3565b640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30101cd0 0x7f1e30198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e3665d640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 0x7f1e3019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 -- 172.21.15.39:0/4025812417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 msgr2=0x7f1e3019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 0x7f1e3019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 -- 172.21.15.39:0/4025812417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30101cd0 msgr2=0x7f1e30198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30101cd0 0x7f1e30198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 -- 172.21.15.39:0/4025812417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3019fb30 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e3665d640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 0x7f1e3019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e35e5c640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e20031440 tx=0x7f1e20032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2003f030 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e20003ce0 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3019fdc0 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20035070 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.266+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301a01e0 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.267+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e30107ea0 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.268+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e20042030 con 0x7f1e30100ad0 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.269+0000 7f1e26ffd640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 0x7f1e1c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:17.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.269+0000 7f1e3565b640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 0x7f1e1c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:17.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.269+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1e200ef1d0 con 0x7f1e30100ad0 2024-09-12T01:54:17.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.270+0000 7f1e3565b640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 0x7f1e1c0a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e30199420 tx=0x7f1e2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:17.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.273+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e200bc5d0 con 0x7f1e30100ad0 2024-09-12T01:54:17.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.448+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1e30062ef0 con 0x7f1e30100ad0 2024-09-12T01:54:17.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.449+0000 7f1e26ffd640 1 -- 172.21.15.39:0/4025812417 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f1e200bbed0 con 0x7f1e30100ad0 2024-09-12T01:54:17.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:17.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 msgr2=0x7f1e1c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 0x7f1e1c0a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e30199420 tx=0x7f1e2c00b390 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 msgr2=0x7f1e30197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e20031440 tx=0x7f1e20032e20 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 shutdown_connections 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e1c0a2bb0 0x7f1e1c0a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e30102690 0x7f1e3019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e30101cd0 0x7f1e30198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 --2- 172.21.15.39:0/4025812417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e30100ad0 0x7f1e30197f00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 >> 172.21.15.39:0/4025812417 conn(0x7f1e300fc280 msgr2=0x7f1e30105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 shutdown_connections 2024-09-12T01:54:17.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:17.451+0000 7f1e380c0640 1 -- 172.21.15.39:0/4025812417 wait complete. 2024-09-12T01:54:17.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:17 smithi172 ceph-mon[35073]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:54:17.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:17 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4025812417' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:17.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:17 smithi039 ceph-mon[31204]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:54:17.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:17 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4025812417' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:17.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:17 smithi044 ceph-mon[35259]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:54:17.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:17 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4025812417' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:54:18.274 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726106055,"num_in_osds":12,"osd_in_since":1726106032,"num_remapped_pgs":0} 2024-09-12T01:54:18.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:54:18.537 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:18.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:18 smithi172 ceph-mon[35073]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:18.802 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:18 smithi039 ceph-mon[31204]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:18.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:18 smithi044 ceph-mon[35259]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:19.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 -- 172.21.15.39:0/1084402435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c102df0 msgr2=0x7fb84c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 --2- 172.21.15.39:0/1084402435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c102df0 0x7fb84c1031d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009ca0 tx=0x7fb83c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 -- 172.21.15.39:0/1084402435 shutdown_connections 2024-09-12T01:54:19.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 --2- 172.21.15.39:0/1084402435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c10c2f0 0x7fb84c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 --2- 172.21.15.39:0/1084402435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c1037a0 0x7fb84c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 --2- 172.21.15.39:0/1084402435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c102df0 0x7fb84c1031d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 -- 172.21.15.39:0/1084402435 >> 172.21.15.39:0/1084402435 conn(0x7fb84c0fc7d0 msgr2=0x7fb84c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 -- 172.21.15.39:0/1084402435 shutdown_connections 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.000+0000 7fb851900640 1 -- 172.21.15.39:0/1084402435 wait complete. 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 Processor -- start 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 -- start start 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 0x7fb84c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 0x7fb84c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:19.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c112110 con 0x7fb84c1037a0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c111f90 con 0x7fb84c102df0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb851900640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c112290 con 0x7fb84c10c2f0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36452/0 (socket says 172.21.15.39:36452) 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 -- 172.21.15.39:0/3669575110 learned_addr learned my addr 172.21.15.39:0/3669575110 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84b7fe640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 0x7fb84c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84affd640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 0x7fb84c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 -- 172.21.15.39:0/3669575110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 msgr2=0x7fb84c19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 0x7fb84c19cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 -- 172.21.15.39:0/3669575110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 msgr2=0x7fb84c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 0x7fb84c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84a7fc640 1 -- 172.21.15.39:0/3669575110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c19d5e0 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84affd640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 0x7fb84c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.001+0000 7fb84b7fe640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 0x7fb84c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb84a7fc640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb83400d750 tx=0x7fb83400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834017070 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb834005500 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c19d8d0 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834004e00 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.002+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c1a51b0 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.003+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c06a790 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.004+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb834004fa0 con 0x7fb84c1037a0 2024-09-12T01:54:19.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.005+0000 7fb8508fe640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 0x7fb8380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:19.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.005+0000 7fb84affd640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 0x7fb8380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:19.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.005+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb8340ce610 con 0x7fb84c1037a0 2024-09-12T01:54:19.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.005+0000 7fb84affd640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 0x7fb8380a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009ca0 tx=0x7fb83c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:19.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.009+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb83409ba10 con 0x7fb84c1037a0 2024-09-12T01:54:19.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.184+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb84c1072a0 con 0x7fb84c1037a0 2024-09-12T01:54:19.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.185+0000 7fb8508fe640 1 -- 172.21.15.39:0/3669575110 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18434 (secure 0 0 0) 0x7fb83409b310 con 0x7fb84c1037a0 2024-09-12T01:54:19.185 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:19.186 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":75,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:54:16.484960+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:54:19.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 msgr2=0x7fb8380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 0x7fb8380a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009ca0 tx=0x7fb83c000f40 comp rx=0 tx=0).stop 2024-09-12T01:54:19.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 msgr2=0x7fb84c198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb83400d750 tx=0x7fb83400dc10 comp rx=0 tx=0).stop 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 shutdown_connections 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb8380a2b80 0x7fb8380a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb84c10c2f0 0x7fb84c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb84c1037a0 0x7fb84c198b70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 --2- 172.21.15.39:0/3669575110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb84c102df0 0x7fb84c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.187+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 >> 172.21.15.39:0/3669575110 conn(0x7fb84c0fc7d0 msgr2=0x7fb84c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.188+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 shutdown_connections 2024-09-12T01:54:19.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:19.188+0000 7fb851900640 1 -- 172.21.15.39:0/3669575110 wait complete. 2024-09-12T01:54:19.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:19 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3669575110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:54:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:19 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3669575110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:54:20.002 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:50:23.669815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:54:20.003 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T01:54:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:19 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3669575110' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:54:20.265 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:20.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:20 smithi039 ceph-mon[31204]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:20.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 -- 172.21.15.39:0/1608290659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68106f10 msgr2=0x7f1e6810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 --2- 172.21.15.39:0/1608290659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68106f10 0x7f1e6810ea90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009ca0 tx=0x7f1e6002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 -- 172.21.15.39:0/1608290659 shutdown_connections 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 --2- 172.21.15.39:0/1608290659 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68106f10 0x7f1e6810ea90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 --2- 172.21.15.39:0/1608290659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68102790 0x7f1e681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 --2- 172.21.15.39:0/1608290659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68101de0 0x7f1e681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 -- 172.21.15.39:0/1608290659 >> 172.21.15.39:0/1608290659 conn(0x7f1e680fd8c0 msgr2=0x7f1e680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 -- 172.21.15.39:0/1608290659 shutdown_connections 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.813+0000 7f1e6df02640 1 -- 172.21.15.39:0/1608290659 wait complete. 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 Processor -- start 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 -- start start 2024-09-12T01:54:20.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68101de0 0x7f1e68198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68106f10 0x7f1e6819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68111f70 con 0x7f1e68102790 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68111df0 con 0x7f1e68106f10 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e6df02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681120f0 con 0x7f1e68101de0 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36468/0 (socket says 172.21.15.39:36468) 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e66ffd640 1 -- 172.21.15.39:0/141189906 learned_addr learned my addr 172.21.15.39:0/141189906 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e677fe640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68101de0 0x7f1e68198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e67fff640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68106f10 0x7f1e6819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e66ffd640 1 -- 172.21.15.39:0/141189906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68101de0 msgr2=0x7f1e68198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.814+0000 7f1e66ffd640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68101de0 0x7f1e68198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e66ffd640 1 -- 172.21.15.39:0/141189906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68106f10 msgr2=0x7f1e6819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e66ffd640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68106f10 0x7f1e6819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e66ffd640 1 -- 172.21.15.39:0/141189906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6819d3e0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e66ffd640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000d950 tx=0x7f1e5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50017070 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6819d6d0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50009c30 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000f6b0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.815+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681a4fb0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.816+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e681021c0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.817+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e500109d0 con 0x7f1e68102790 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.818+0000 7f1e64ff9640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 0x7f1e540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.818+0000 7f1e677fe640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 0x7f1e540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:20.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.818+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1e500ce850 con 0x7f1e68102790 2024-09-12T01:54:20.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.818+0000 7f1e677fe640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 0x7f1e540a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e580058c0 tx=0x7f1e5800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:20.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.822+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e50009de0 con 0x7f1e68102790 2024-09-12T01:54:20.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:20 smithi044 ceph-mon[35259]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.996+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1e6810a0f0 con 0x7f1e68102790 2024-09-12T01:54:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.996+0000 7f1e64ff9640 1 -- 172.21.15.39:0/141189906 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f1e5009bc50 con 0x7f1e68102790 2024-09-12T01:54:20.996 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-12T01:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 msgr2=0x7f1e540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 0x7f1e540a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e580058c0 tx=0x7f1e5800a4c0 comp rx=0 tx=0).stop 2024-09-12T01:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 msgr2=0x7f1e68198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000d950 tx=0x7f1e5000de10 comp rx=0 tx=0).stop 2024-09-12T01:54:20.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 shutdown_connections 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e68106f10 0x7f1e6819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e68102790 0x7f1e68198970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1e540a2b80 0x7f1e540a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 --2- 172.21.15.39:0/141189906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e68101de0 0x7f1e68198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 >> 172.21.15.39:0/141189906 conn(0x7f1e680fd8c0 msgr2=0x7f1e680fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 shutdown_connections 2024-09-12T01:54:21.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:20.999+0000 7f1e6df02640 1 -- 172.21.15.39:0/141189906 wait complete. 2024-09-12T01:54:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:20 smithi172 ceph-mon[35073]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:21.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:21 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/141189906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:54:21.814 INFO:tasks.cephadm:Adding mds.a on smithi039 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.d on smithi039 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.g on smithi039 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.j on smithi039 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.b on smithi044 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.e on smithi044 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.h on smithi044 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.k on smithi044 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-09-12T01:54:21.815 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-09-12T01:54:21.815 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-09-12T01:54:21.845 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:21 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/141189906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:54:21.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:21 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/141189906' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:54:22.077 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:54:22.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- 172.21.15.172:0/926277303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 msgr2=0x7f03701030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 --2- 172.21.15.172:0/926277303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701030c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0360009900 tx=0x7f036002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- 172.21.15.172:0/926277303 shutdown_connections 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 --2- 172.21.15.172:0/926277303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 0x7f0370109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 --2- 172.21.15.172:0/926277303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701030c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 --2- 172.21.15.172:0/926277303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- 172.21.15.172:0/926277303 >> 172.21.15.172:0/926277303 conn(0x7f03700fd1f0 msgr2=0x7f03700ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- 172.21.15.172:0/926277303 shutdown_connections 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- 172.21.15.172:0/926277303 wait complete. 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 Processor -- start 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 -- start start 2024-09-12T01:54:22.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.599+0000 7f037699d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 0x7f037019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f037010d770 con 0x7f0370101a40 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f037010d5f0 con 0x7f0370103600 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f037010d8f0 con 0x7f0370102c40 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47420/0 (socket says 172.21.15.172:47420) 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 -- 172.21.15.172:0/3620709321 learned_addr learned my addr 172.21.15.172:0/3620709321 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037619c640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 0x7f037019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037599b640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 -- 172.21.15.172:0/3620709321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 msgr2=0x7f037019f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 0x7f037019f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 -- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 msgr2=0x7f0370197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:22.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 -- 172.21.15.172:0/3620709321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037019f990 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037599b640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037519a640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0360009230 tx=0x7f0360004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036003f030 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0360003ce0 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037019fc20 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360035070 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.600+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03701a0100 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.602+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0370108d70 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.602+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0360042030 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.603+0000 7f0366ffd640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 0x7f035c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.604+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f03600ef1b0 con 0x7f0370102c40 2024-09-12T01:54:22.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.604+0000 7f037599b640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 0x7f035c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.604+0000 7f037599b640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 0x7f035c0a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f036c006fd0 tx=0x7f036c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.608+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03600bc5b0 con 0x7f0370102c40 2024-09-12T01:54:22.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.786+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7f03700627f0 con 0x7f035c0a2bb0 2024-09-12T01:54:22.787 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:22 smithi172 ceph-mon[35073]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.794+0000 7f0366ffd640 1 -- 172.21.15.172:0/3620709321 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f03700627f0 con 0x7f035c0a2bb0 2024-09-12T01:54:22.794 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 msgr2=0x7f035c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 0x7f035c0a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f036c006fd0 tx=0x7f036c008040 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 msgr2=0x7f03701982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0360009230 tx=0x7f0360004360 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 shutdown_connections 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0370103600 0x7f037019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f035c0a2bb0 0x7f035c0a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0370102c40 0x7f03701982a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 --2- 172.21.15.172:0/3620709321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0370101a40 0x7f0370197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 >> 172.21.15.172:0/3620709321 conn(0x7f03700fd1f0 msgr2=0x7f0370105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 shutdown_connections 2024-09-12T01:54:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T01:54:22.796+0000 7f037699d640 1 -- 172.21.15.172:0/3620709321 wait complete. 2024-09-12T01:54:22.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:22 smithi039 ceph-mon[31204]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:22.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:22 smithi044 ceph-mon[35259]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:23.462 DEBUG:teuthology.orchestra.run.smithi039:mds.a> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T01:54:23.465 DEBUG:teuthology.orchestra.run.smithi039:mds.d> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T01:54:23.508 DEBUG:teuthology.orchestra.run.smithi039:mds.g> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T01:54:23.551 DEBUG:teuthology.orchestra.run.smithi039:mds.j> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T01:54:23.593 DEBUG:teuthology.orchestra.run.smithi044:mds.b> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T01:54:23.596 DEBUG:teuthology.orchestra.run.smithi044:mds.e> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T01:54:23.641 DEBUG:teuthology.orchestra.run.smithi044:mds.h> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T01:54:23.684 DEBUG:teuthology.orchestra.run.smithi044:mds.k> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T01:54:23.727 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T01:54:23.730 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T01:54:23.774 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T01:54:23.817 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T01:54:23.860 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T01:54:23.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:23.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:23.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T01:54:23.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:23.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:23.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:23 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T01:54:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:23.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:23.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:23 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:24.114 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:24.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:24.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:23 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 -- 172.21.15.39:0/2249289182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 msgr2=0x7f0f4810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 --2- 172.21.15.39:0/2249289182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4810ea90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009900 tx=0x7f0f3802a410 comp rx=0 tx=0).stop 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 -- 172.21.15.39:0/2249289182 shutdown_connections 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 --2- 172.21.15.39:0/2249289182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4810ea90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 --2- 172.21.15.39:0/2249289182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 0x7f0f481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 --2- 172.21.15.39:0/2249289182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 0x7f0f481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 -- 172.21.15.39:0/2249289182 >> 172.21.15.39:0/2249289182 conn(0x7f0f480fd8c0 msgr2=0x7f0f480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 -- 172.21.15.39:0/2249289182 shutdown_connections 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.570+0000 7f0f50571640 1 -- 172.21.15.39:0/2249289182 wait complete. 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 Processor -- start 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 -- start start 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 0x7f0f481983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 0x7f0f48198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48111f70 con 0x7f0f48106f10 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48111df0 con 0x7f0f48101de0 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f50571640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481120f0 con 0x7f0f48102790 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43644/0 (socket says 172.21.15.39:43644) 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 -- 172.21.15.39:0/3738410190 learned_addr learned my addr 172.21.15.39:0/3738410190 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4e30d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 0x7f0f481983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4db0c640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 0x7f0f48198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 -- 172.21.15.39:0/3738410190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 msgr2=0x7f0f48198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 0x7f0f48198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 -- 172.21.15.39:0/3738410190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 msgr2=0x7f0f481983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 0x7f0f481983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.571+0000 7f0f4eb0e640 1 -- 172.21.15.39:0/3738410190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4819d3a0 con 0x7f0f48106f10 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f4eb0e640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005ab0 tx=0x7f0f380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3803f030 con 0x7f0f48106f10 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38003ce0 con 0x7f0f48106f10 2024-09-12T01:54:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38035070 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4819d630 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.572+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f481a4f70 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.573+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f481032c0 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.574+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0f38042030 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.575+0000 7f0f477fe640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 0x7f0f300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.575+0000 7f0f4e30d640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 0x7f0f300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.575+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0f380ef500 con 0x7f0f48106f10 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.575+0000 7f0f4e30d640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 0x7f0f300a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f40005fd0 tx=0x7f0f40009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.578+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f380bc2b0 con 0x7f0f48106f10 2024-09-12T01:54:24.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.787+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f481021c0 con 0x7f0f48106f10 2024-09-12T01:54:24.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.787+0000 7f0f477fe640 1 -- 172.21.15.39:0/3738410190 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0f380b6e20 con 0x7f0f48106f10 2024-09-12T01:54:24.787 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:24.787 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"btime":"2024-09-12T01:47:06:646574+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T01:54:24.788 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 1 2024-09-12T01:54:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 msgr2=0x7f0f300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 0x7f0f300a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f40005fd0 tx=0x7f0f40009680 comp rx=0 tx=0).stop 2024-09-12T01:54:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 msgr2=0x7f0f4819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005ab0 tx=0x7f0f380042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 shutdown_connections 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f48106f10 0x7f0f4819ccc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f300a2b80 0x7f0f300a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f48102790 0x7f0f48198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 --2- 172.21.15.39:0/3738410190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48101de0 0x7f0f481983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 >> 172.21.15.39:0/3738410190 conn(0x7f0f480fd8c0 msgr2=0x7f0f480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 shutdown_connections 2024-09-12T01:54:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:24.790+0000 7f0f50571640 1 -- 172.21.15.39:0/3738410190 wait complete. 2024-09-12T01:54:24.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:24 smithi172 ceph-mon[35073]: Deploying daemon mds.l on smithi172 2024-09-12T01:54:24.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:24 smithi172 ceph-mon[35073]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:24.982 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:24 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3738410190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:24 smithi039 ceph-mon[31204]: Deploying daemon mds.l on smithi172 2024-09-12T01:54:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:24 smithi039 ceph-mon[31204]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:24 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3738410190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:24 smithi044 ceph-mon[35259]: Deploying daemon mds.l on smithi172 2024-09-12T01:54:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:24 smithi044 ceph-mon[35259]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:24 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3738410190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:25.253 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 systemd[1]: Starting Ceph mds.l for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:25.635 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 podman[64698]: 2024-09-12 01:54:25.275754034 +0000 UTC m=+0.016187915 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:25.635 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 podman[64698]: 2024-09-12 01:54:25.391143567 +0000 UTC m=+0.131577478 container create f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 podman[64698]: 2024-09-12 01:54:25.635752781 +0000 UTC m=+0.376186653 container init f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 podman[64698]: 2024-09-12 01:54:25.638986139 +0000 UTC m=+0.379420016 container start f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 ceph-mds[64718]: -- 172.21.15.172:0/2585318567 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637bb9bb860 con 0x5637bb998800 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l[64714]: starting mds.l at 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 bash[64698]: f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 2024-09-12T01:54:26.004 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 01:54:25 smithi172 systemd[1]: Started Ceph mds.l for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:26.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:26.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6832/1133915680,v1:172.21.15.172:6833/1133915680] up:boot 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: fsmap 1 up:standby 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:26.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:26.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:26.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:26 smithi044 ceph-mon[35259]: Deploying daemon mds.k on smithi044 2024-09-12T01:54:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6832/1133915680,v1:172.21.15.172:6833/1133915680] up:boot 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: fsmap 1 up:standby 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:27.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:27.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:27.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:26 smithi172 ceph-mon[35073]: Deploying daemon mds.k on smithi044 2024-09-12T01:54:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6832/1133915680,v1:172.21.15.172:6833/1133915680] up:boot 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: fsmap 1 up:standby 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:26 smithi039 ceph-mon[31204]: Deploying daemon mds.k on smithi044 2024-09-12T01:54:27.608 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:27.878 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:27.924 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:27 smithi044 systemd[1]: Starting Ceph mds.k for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:28.329 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 podman[64220]: 2024-09-12 01:54:27.957141287 +0000 UTC m=+0.016122008 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:28.329 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 podman[64220]: 2024-09-12 01:54:28.076956837 +0000 UTC m=+0.135937587 container create 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T01:54:28.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 -- 172.21.15.39:0/920700970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544100a80 msgr2=0x7f5544100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:28.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 --2- 172.21.15.39:0/920700970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544100a80 0x7f5544100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5534009cd0 tx=0x7f553402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 -- 172.21.15.39:0/920700970 shutdown_connections 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 --2- 172.21.15.39:0/920700970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 --2- 172.21.15.39:0/920700970 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544100a80 0x7f5544100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 --2- 172.21.15.39:0/920700970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544106a80 0x7f5544106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 -- 172.21.15.39:0/920700970 >> 172.21.15.39:0/920700970 conn(0x7f55440fc7a0 msgr2=0x7f55440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 -- 172.21.15.39:0/920700970 shutdown_connections 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 -- 172.21.15.39:0/920700970 wait complete. 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.348+0000 7f554acfd640 1 Processor -- start 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 -- start start 2024-09-12T01:54:28.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544100a80 0x7f554410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5544111fa0 con 0x7f5544106a80 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5544111e20 con 0x7f5544101420 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554acfd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5544112120 con 0x7f5544100a80 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43656/0 (socket says 172.21.15.39:43656) 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 -- 172.21.15.39:0/3325373474 learned_addr learned my addr 172.21.15.39:0/3325373474 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f5543fff640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 -- 172.21.15.39:0/3325373474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544100a80 msgr2=0x7f554410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f5548a99640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544100a80 0x7f554410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:28.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544100a80 0x7f554410e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 -- 172.21.15.39:0/3325373474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 msgr2=0x7f554410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 -- 172.21.15.39:0/3325373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441a6960 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f5543fff640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.349+0000 7f554929a640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e970 tx=0x7f553c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.350+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c00ccc0 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.350+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f553c00ce60 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.350+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441a6c50 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.350+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c010490 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.350+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441a7160 con 0x7f5544106a80 2024-09-12T01:54:28.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.351+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5544100ee0 con 0x7f5544106a80 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.352+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f553c005020 con 0x7f5544106a80 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.352+0000 7f5541ffb640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 0x7f55300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.353+0000 7f5548a99640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 0x7f55300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.353+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f553c0cf040 con 0x7f5544106a80 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.353+0000 7f5548a99640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 0x7f55300a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f552c005d80 tx=0x7f552c005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:28.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.357+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f553c09c440 con 0x7f5544106a80 2024-09-12T01:54:28.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.572+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5544108ff0 con 0x7f5544106a80 2024-09-12T01:54:28.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.572+0000 7f5541ffb640 1 -- 172.21.15.39:0/3325373474 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f553c09bd40 con 0x7f5544106a80 2024-09-12T01:54:28.573 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:28.573 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":2,"btime":"2024-09-12T01:54:25:666787+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:54:28.573 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 2 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 msgr2=0x7f55300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 0x7f55300a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f552c005d80 tx=0x7f552c005c90 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 msgr2=0x7f554410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e970 tx=0x7f553c00ed70 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 shutdown_connections 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5544106a80 0x7f554410ee60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5544101420 0x7f554410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f55300a2c00 0x7f55300a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 --2- 172.21.15.39:0/3325373474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5544100a80 0x7f554410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 >> 172.21.15.39:0/3325373474 conn(0x7f55440fc7a0 msgr2=0x7f55440fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 shutdown_connections 2024-09-12T01:54:28.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:28.575+0000 7f554acfd640 1 -- 172.21.15.39:0/3325373474 wait complete. 2024-09-12T01:54:28.673 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 podman[64220]: 2024-09-12 01:54:28.329910861 +0000 UTC m=+0.388891581 container init 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T01:54:28.673 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 podman[64220]: 2024-09-12 01:54:28.33299631 +0000 UTC m=+0.391977027 container start 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T01:54:28.674 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mds[64239]: -- 172.21.15.44:0/1305891139 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56030cb0b860 con 0x56030cae9400 2024-09-12T01:54:28.674 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k[64235]: starting mds.k at 2024-09-12T01:54:28.674 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 bash[64220]: 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 2024-09-12T01:54:28.674 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 01:54:28 smithi044 systemd[1]: Started Ceph mds.k for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:28.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:28 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3325373474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:29.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:29.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:28 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3325373474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:29.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:29.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:29.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:29.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:28 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3325373474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:29.762 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:29 smithi044 ceph-mon[35259]: Deploying daemon mds.j on smithi039 2024-09-12T01:54:29.762 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:29 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6832/2844392088,v1:172.21.15.44:6833/2844392088] up:boot 2024-09-12T01:54:29.763 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:29 smithi044 ceph-mon[35259]: fsmap 2 up:standby 2024-09-12T01:54:29.763 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:29 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:54:29.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:29 smithi039 ceph-mon[31204]: Deploying daemon mds.j on smithi039 2024-09-12T01:54:29.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:29 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6832/2844392088,v1:172.21.15.44:6833/2844392088] up:boot 2024-09-12T01:54:29.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:29 smithi039 ceph-mon[31204]: fsmap 2 up:standby 2024-09-12T01:54:29.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:29 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:54:30.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:29 smithi172 ceph-mon[35073]: Deploying daemon mds.j on smithi039 2024-09-12T01:54:30.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:29 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6832/2844392088,v1:172.21.15.44:6833/2844392088] up:boot 2024-09-12T01:54:30.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:29 smithi172 ceph-mon[35073]: fsmap 2 up:standby 2024-09-12T01:54:30.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:29 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:54:30.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:30 smithi039 ceph-mon[31204]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:31.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:30 smithi172 ceph-mon[35073]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:31.161 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 systemd[1]: Starting Ceph mds.j for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:31.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:30 smithi044 ceph-mon[35259]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:31.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:31.524 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 podman[68018]: 2024-09-12 01:54:31.158956944 +0000 UTC m=+0.016404526 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:31.525 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 podman[68018]: 2024-09-12 01:54:31.268062443 +0000 UTC m=+0.125510013 container create 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:54:31.525 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 podman[68018]: 2024-09-12 01:54:31.496904965 +0000 UTC m=+0.354352535 container init 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:54:31.525 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 podman[68018]: 2024-09-12 01:54:31.500293205 +0000 UTC m=+0.357740776 container start 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T01:54:31.691 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:31.823 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 ceph-mds[68055]: -- 172.21.15.39:0/2048739588 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56173edd7860 con 0x56173edb4800 2024-09-12T01:54:31.824 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j[68038]: starting mds.j at 2024-09-12T01:54:31.824 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 bash[68018]: 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 2024-09-12T01:54:31.824 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 01:54:31 smithi039 systemd[1]: Started Ceph mds.j for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 -- 172.21.15.39:0/657605666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c101420 msgr2=0x7fcc0c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 --2- 172.21.15.39:0/657605666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c101420 0x7fcc0c10d950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009930 tx=0x7fcc0402a420 comp rx=0 tx=0).stop 2024-09-12T01:54:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 -- 172.21.15.39:0/657605666 shutdown_connections 2024-09-12T01:54:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 --2- 172.21.15.39:0/657605666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c101420 0x7fcc0c10d950 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 --2- 172.21.15.39:0/657605666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 --2- 172.21.15.39:0/657605666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c106a80 0x7fcc0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 -- 172.21.15.39:0/657605666 >> 172.21.15.39:0/657605666 conn(0x7fcc0c0fc7a0 msgr2=0x7fcc0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 -- 172.21.15.39:0/657605666 shutdown_connections 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.225+0000 7fcc12fec640 1 -- 172.21.15.39:0/657605666 wait complete. 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 Processor -- start 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 -- start start 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 0x7fcc0c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c110ea0 con 0x7fcc0c106a80 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c110d20 con 0x7fcc0c100a80 2024-09-12T01:54:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc12fec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c111020 con 0x7fcc0c101420 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc11589640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc11589640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43706/0 (socket says 172.21.15.39:43706) 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc11589640 1 -- 172.21.15.39:0/1768562026 learned_addr learned my addr 172.21.15.39:0/1768562026 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc0bfff640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 0x7fcc0c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.226+0000 7fcc10d88640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 -- 172.21.15.39:0/1768562026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 msgr2=0x7fcc0c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 0x7fcc0c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 -- 172.21.15.39:0/1768562026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 msgr2=0x7fcc0c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 -- 172.21.15.39:0/1768562026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c19d480 con 0x7fcc0c106a80 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc10d88640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc0bfff640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 0x7fcc0c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc11589640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005ab0 tx=0x7fcc040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0403f030 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c19d710 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc04003ce0 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04035070 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.227+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c1a5050 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.228+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0c100ee0 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.230+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcc04042030 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.230+0000 7fcc09ffb640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 0x7fcbf80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.231+0000 7fcc10d88640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 0x7fcbf80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.231+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fcc040ef0d0 con 0x7fcc0c106a80 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.231+0000 7fcc10d88640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 0x7fcbf80a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4006fd0 tx=0x7fcbf4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.235+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc040bc4d0 con 0x7fcc0c106a80 2024-09-12T01:54:32.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.462+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc0c1a5220 con 0x7fcc0c106a80 2024-09-12T01:54:32.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.462+0000 7fcc09ffb640 1 -- 172.21.15.39:0/1768562026 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fcc040bbdd0 con 0x7fcc0c106a80 2024-09-12T01:54:32.463 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:32.463 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":4,"btime":"2024-09-12T01:54:31:694946+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:54:32.463 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 4 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 msgr2=0x7fcbf80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 0x7fcbf80a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4006fd0 tx=0x7fcbf4008040 comp rx=0 tx=0).stop 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 msgr2=0x7fcc0c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005ab0 tx=0x7fcc040042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 shutdown_connections 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc0c106a80 0x7fcc0c19cda0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcbf80a2b80 0x7fcbf80a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc0c101420 0x7fcc0c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 --2- 172.21.15.39:0/1768562026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc0c100a80 0x7fcc0c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.464+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 >> 172.21.15.39:0/1768562026 conn(0x7fcc0c0fc7a0 msgr2=0x7fcc0c104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.465+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 shutdown_connections 2024-09-12T01:54:32.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:32.465+0000 7fcc12fec640 1 -- 172.21.15.39:0/1768562026 wait complete. 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: Deploying daemon mds.d on smithi039 2024-09-12T01:54:32.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.39:6834/371087519,v1:172.21.15.39:6835/371087519] up:boot 2024-09-12T01:54:32.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: fsmap 3 up:standby 2024-09-12T01:54:32.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:54:32.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:32 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1768562026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:32.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: Deploying daemon mds.d on smithi039 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.39:6834/371087519,v1:172.21.15.39:6835/371087519] up:boot 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: fsmap 3 up:standby 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:54:32.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:32 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1768562026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:33.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: Deploying daemon mds.d on smithi039 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.39:6834/371087519,v1:172.21.15.39:6835/371087519] up:boot 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: fsmap 3 up:standby 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:54:33.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:32 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1768562026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:34.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:34 smithi172 ceph-mon[35073]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:34.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:34 smithi039 ceph-mon[31204]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:34.911 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:34 smithi039 systemd[1]: Starting Ceph mds.d for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:34.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:34 smithi044 ceph-mon[35259]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:35.290 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:34 smithi039 podman[68432]: 2024-09-12 01:54:34.88410523 +0000 UTC m=+0.016775066 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:35.290 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 podman[68432]: 2024-09-12 01:54:35.029184641 +0000 UTC m=+0.161854509 container create a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T01:54:35.290 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 podman[68432]: 2024-09-12 01:54:35.290523846 +0000 UTC m=+0.423193672 container init a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T01:54:35.660 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 podman[68432]: 2024-09-12 01:54:35.293544964 +0000 UTC m=+0.426214788 container start a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:54:35.661 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 ceph-mds[68451]: -- 172.21.15.39:0/3191267142 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56386b83b860 con 0x56386b818800 2024-09-12T01:54:35.661 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d[68447]: starting mds.d at 2024-09-12T01:54:35.661 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 bash[68432]: a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a 2024-09-12T01:54:35.661 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 01:54:35 smithi039 systemd[1]: Started Ceph mds.d for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:35.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:36.064 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:36.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 -- 172.21.15.39:0/4272458636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 msgr2=0x7f83b810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 --2- 172.21.15.39:0/4272458636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b810ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009cd0 tx=0x7f83b002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 -- 172.21.15.39:0/4272458636 shutdown_connections 2024-09-12T01:54:36.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 --2- 172.21.15.39:0/4272458636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b810ec40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 --2- 172.21.15.39:0/4272458636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b81036e0 0x7f83b8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 --2- 172.21.15.39:0/4272458636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b8102d30 0x7f83b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 -- 172.21.15.39:0/4272458636 >> 172.21.15.39:0/4272458636 conn(0x7f83b80fc7d0 msgr2=0x7f83b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:36.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 -- 172.21.15.39:0/4272458636 shutdown_connections 2024-09-12T01:54:36.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.573+0000 7f83bd224640 1 -- 172.21.15.39:0/4272458636 wait complete. 2024-09-12T01:54:36.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 Processor -- start 2024-09-12T01:54:36.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 -- start start 2024-09-12T01:54:36.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8102d30 0x7f83b8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81120f0 con 0x7f83b81082a0 2024-09-12T01:54:36.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8111f70 con 0x7f83b81036e0 2024-09-12T01:54:36.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83bd224640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8112270 con 0x7f83b8102d30 2024-09-12T01:54:36.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83b759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83b659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83b759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47790/0 (socket says 172.21.15.39:47790) 2024-09-12T01:54:36.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.574+0000 7f83b659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42490/0 (socket says 172.21.15.39:42490) 2024-09-12T01:54:36.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 -- 172.21.15.39:0/375572591 learned_addr learned my addr 172.21.15.39:0/375572591 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:36.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b6d9d640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8102d30 0x7f83b8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 -- 172.21.15.39:0/375572591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8102d30 msgr2=0x7f83b8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8102d30 0x7f83b8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 -- 172.21.15.39:0/375572591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 msgr2=0x7f83b8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 -- 172.21.15.39:0/375572591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b81a6af0 con 0x7f83b81082a0 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b659c640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83b759e640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83b0033040 tx=0x7f83b0031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0004040 con 0x7f83b81082a0 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b00046c0 con 0x7f83b81082a0 2024-09-12T01:54:36.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b81a6d80 con 0x7f83b81082a0 2024-09-12T01:54:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0030ed0 con 0x7f83b81082a0 2024-09-12T01:54:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.575+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81a72e0 con 0x7f83b81082a0 2024-09-12T01:54:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.577+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b8103110 con 0x7f83b81082a0 2024-09-12T01:54:36.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.578+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f83b00041e0 con 0x7f83b81082a0 2024-09-12T01:54:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.578+0000 7f839ffff640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 0x7f83a00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.578+0000 7f83b6d9d640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 0x7f83a00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.579+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f83b00efa50 con 0x7f83b81082a0 2024-09-12T01:54:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.579+0000 7f83b6d9d640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 0x7f83a00a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009bd0 tx=0x7f83a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:36.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.583+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83b00bce40 con 0x7f83b81082a0 2024-09-12T01:54:36.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:36.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: Deploying daemon mds.e on smithi044 2024-09-12T01:54:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.39:6836/1615113005,v1:172.21.15.39:6837/1615113005] up:boot 2024-09-12T01:54:36.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: fsmap 4 up:standby 2024-09-12T01:54:36.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:36 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:54:36.797 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:36.797 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"btime":"2024-09-12T01:54:35:669931+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:54:36.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.795+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83b810a2b0 con 0x7f83b81082a0 2024-09-12T01:54:36.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.796+0000 7f839ffff640 1 -- 172.21.15.39:0/375572591 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f83b00098b0 con 0x7f83b81082a0 2024-09-12T01:54:36.798 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2024-09-12T01:54:36.798 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:36.799 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: Deploying daemon mds.e on smithi044 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.39:6836/1615113005,v1:172.21.15.39:6837/1615113005] up:boot 2024-09-12T01:54:36.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: fsmap 4 up:standby 2024-09-12T01:54:36.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:36 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:54:36.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 msgr2=0x7f83a00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 0x7f83a00a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009bd0 tx=0x7f83a8005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 msgr2=0x7f83b8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83b0033040 tx=0x7f83b0031e60 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 shutdown_connections 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f83b81082a0 0x7f83b8101410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83b81036e0 0x7f83b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f83a00a2c00 0x7f83a00a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 --2- 172.21.15.39:0/375572591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8102d30 0x7f83b8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 >> 172.21.15.39:0/375572591 conn(0x7f83b80fc7d0 msgr2=0x7f83b80fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 shutdown_connections 2024-09-12T01:54:36.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:36.798+0000 7f83bd224640 1 -- 172.21.15.39:0/375572591 wait complete. 2024-09-12T01:54:36.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: Deploying daemon mds.e on smithi044 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.39:6836/1615113005,v1:172.21.15.39:6837/1615113005] up:boot 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: fsmap 4 up:standby 2024-09-12T01:54:36.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:36 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:54:37.623 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:37 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/375572591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:37.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:37 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/375572591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:37.674 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:37 smithi044 systemd[1]: Starting Ceph mds.e for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:37.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/375572591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:38.002 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:37 smithi044 podman[64529]: 2024-09-12 01:54:37.654373408 +0000 UTC m=+0.015735158 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:38.002 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:37 smithi044 podman[64529]: 2024-09-12 01:54:37.766557427 +0000 UTC m=+0.127919156 container create 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:54:38.003 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 podman[64529]: 2024-09-12 01:54:38.002785468 +0000 UTC m=+0.364147207 container init 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T01:54:38.423 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 podman[64529]: 2024-09-12 01:54:38.005723728 +0000 UTC m=+0.367085455 container start 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:54:38.423 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mds[64548]: -- 172.21.15.44:0/177729563 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560047e9d860 con 0x560047e7b400 2024-09-12T01:54:38.423 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: starting mds.e at 2024-09-12T01:54:38.424 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 bash[64529]: 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 2024-09-12T01:54:38.424 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 01:54:38 smithi044 systemd[1]: Started Ceph mds.e for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:38.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:38.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:38 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:38.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:38.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:38 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:38.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:38.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:38 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:39.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:39.738 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:39.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:39 smithi172 ceph-mon[35073]: Deploying daemon mds.f on smithi172 2024-09-12T01:54:39.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:39 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6834/4061596538,v1:172.21.15.44:6835/4061596538] up:boot 2024-09-12T01:54:39.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:39 smithi172 ceph-mon[35073]: fsmap 5 up:standby 2024-09-12T01:54:39.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:39 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:54:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:39 smithi039 ceph-mon[31204]: Deploying daemon mds.f on smithi172 2024-09-12T01:54:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:39 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6834/4061596538,v1:172.21.15.44:6835/4061596538] up:boot 2024-09-12T01:54:39.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:39 smithi039 ceph-mon[31204]: fsmap 5 up:standby 2024-09-12T01:54:39.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:39 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:54:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:39 smithi044 ceph-mon[35259]: Deploying daemon mds.f on smithi172 2024-09-12T01:54:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:39 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6834/4061596538,v1:172.21.15.44:6835/4061596538] up:boot 2024-09-12T01:54:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:39 smithi044 ceph-mon[35259]: fsmap 5 up:standby 2024-09-12T01:54:39.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:39 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:54:40.152 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 systemd[1]: Starting Ceph mds.f for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:40.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 -- 172.21.15.39:0/2294991017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c101420 msgr2=0x7f306c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 --2- 172.21.15.39:0/2294991017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c101420 0x7f306c10d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3064009cd0 tx=0x7f306402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 -- 172.21.15.39:0/2294991017 shutdown_connections 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 --2- 172.21.15.39:0/2294991017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c101420 0x7f306c10d950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 --2- 172.21.15.39:0/2294991017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c100a80 0x7f306c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 --2- 172.21.15.39:0/2294991017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c106a80 0x7f306c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.219+0000 7f3071a2a640 1 -- 172.21.15.39:0/2294991017 >> 172.21.15.39:0/2294991017 conn(0x7f306c0fc7a0 msgr2=0x7f306c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.220+0000 7f3071a2a640 1 -- 172.21.15.39:0/2294991017 shutdown_connections 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.220+0000 7f3071a2a640 1 -- 172.21.15.39:0/2294991017 wait complete. 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.220+0000 7f3071a2a640 1 Processor -- start 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.220+0000 7f3071a2a640 1 -- start start 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c101420 0x7f306c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c106a80 0x7f306c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f306c110e80 con 0x7f306c100a80 2024-09-12T01:54:40.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f306c110d00 con 0x7f306c106a80 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f306c111000 con 0x7f306c101420 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47806/0 (socket says 172.21.15.39:47806) 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 -- 172.21.15.39:0/1075700650 learned_addr learned my addr 172.21.15.39:0/1075700650 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306a7fc640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c101420 0x7f306c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306b7fe640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c106a80 0x7f306c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 -- 172.21.15.39:0/1075700650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c101420 msgr2=0x7f306c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c101420 0x7f306c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 -- 172.21.15.39:0/1075700650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c106a80 msgr2=0x7f306c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c106a80 0x7f306c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 -- 172.21.15.39:0/1075700650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c19f5e0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f306affd640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d950 tx=0x7f305c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c017030 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c19f8d0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f305c004020 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0047a0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.221+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c1a71b0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.222+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c100ee0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.224+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f305c0041d0 con 0x7f306c100a80 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.224+0000 7f3070a28640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 0x7f30540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.224+0000 7f306a7fc640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 0x7f30540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.224+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f305c0ceac0 con 0x7f306c100a80 2024-09-12T01:54:40.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.225+0000 7f306a7fc640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 0x7f30540a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f306c06b870 tx=0x7f306000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.227+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f305c09bec0 con 0x7f306c100a80 2024-09-12T01:54:40.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.438+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f306c19b990 con 0x7f306c100a80 2024-09-12T01:54:40.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.439+0000 7f3070a28640 1 -- 172.21.15.39:0/1075700650 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f306c19b990 con 0x7f306c100a80 2024-09-12T01:54:40.439 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:40.439 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":6,"btime":"2024-09-12T01:54:38:456838+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T01:54:40.439 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 6 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 msgr2=0x7f30540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 0x7f30540a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f306c06b870 tx=0x7f306000b410 comp rx=0 tx=0).stop 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 msgr2=0x7f306c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f305c00d950 tx=0x7f305c00de10 comp rx=0 tx=0).stop 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 shutdown_connections 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f306c106a80 0x7f306c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30540a2b80 0x7f30540a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c101420 0x7f306c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 --2- 172.21.15.39:0/1075700650 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f306c100a80 0x7f306c19a630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 >> 172.21.15.39:0/1075700650 conn(0x7f306c0fc7a0 msgr2=0x7f306c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 shutdown_connections 2024-09-12T01:54:40.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:40.441+0000 7f3071a2a640 1 -- 172.21.15.39:0/1075700650 wait complete. 2024-09-12T01:54:40.479 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 podman[65006]: 2024-09-12 01:54:40.270394246 +0000 UTC m=+0.016548260 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:40.479 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 podman[65006]: 2024-09-12 01:54:40.388339884 +0000 UTC m=+0.134493881 container create 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:54:40.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:40 smithi044 ceph-mon[35259]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:40.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:40 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1075700650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:40 smithi172 ceph-mon[35073]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:40 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1075700650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 podman[65006]: 2024-09-12 01:54:40.65815885 +0000 UTC m=+0.404312855 container init 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 podman[65006]: 2024-09-12 01:54:40.661111672 +0000 UTC m=+0.407265668 container start 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 ceph-mds[65026]: -- 172.21.15.172:0/742906501 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559d7719860 con 0x5559d76f6800 2024-09-12T01:54:40.749 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: starting mds.f at 2024-09-12T01:54:40.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:40 smithi039 ceph-mon[31204]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:40.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:40 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1075700650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:41.003 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 bash[65006]: 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 2024-09-12T01:54:41.003 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 01:54:40 smithi172 systemd[1]: Started Ceph mds.f for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:42.075 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.076 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.076 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.076 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:42.076 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:42.076 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:42.077 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: Deploying daemon mds.c on smithi172 2024-09-12T01:54:42.077 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6834/1679490719,v1:172.21.15.172:6835/1679490719] up:boot 2024-09-12T01:54:42.077 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: fsmap 6 up:standby 2024-09-12T01:54:42.077 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:41 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:54:42.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:42.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:42.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:42.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: Deploying daemon mds.c on smithi172 2024-09-12T01:54:42.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6834/1679490719,v1:172.21.15.172:6835/1679490719] up:boot 2024-09-12T01:54:42.163 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: fsmap 6 up:standby 2024-09-12T01:54:42.163 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:41 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:54:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: Deploying daemon mds.c on smithi172 2024-09-12T01:54:42.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6834/1679490719,v1:172.21.15.172:6835/1679490719] up:boot 2024-09-12T01:54:42.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: fsmap 6 up:standby 2024-09-12T01:54:42.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:41 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:54:42.818 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:42 smithi172 systemd[1]: Starting Ceph mds.c for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:43.115 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:42 smithi172 ceph-mon[35073]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:42 smithi172 podman[65310]: 2024-09-12 01:54:42.859933529 +0000 UTC m=+0.016022740 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:43.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:42 smithi172 podman[65310]: 2024-09-12 01:54:42.996294139 +0000 UTC m=+0.152383346 container create 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:54:43.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:43.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:42 smithi039 ceph-mon[31204]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:42 smithi044 ceph-mon[35259]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:43.421 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:43.753 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 podman[65310]: 2024-09-12 01:54:43.266014969 +0000 UTC m=+0.422104177 container init 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T01:54:43.753 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 podman[65310]: 2024-09-12 01:54:43.269033309 +0000 UTC m=+0.425122520 container start 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T01:54:43.753 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 ceph-mds[65329]: -- 172.21.15.172:0/875372005 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560fcbaed860 con 0x560fcbacb000 2024-09-12T01:54:43.753 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: starting mds.c at 2024-09-12T01:54:43.754 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 bash[65310]: 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 2024-09-12T01:54:43.754 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 01:54:43 smithi172 systemd[1]: Started Ceph mds.c for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:43.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 -- 172.21.15.39:0/2382887246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50541009d0 msgr2=0x7f5054100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 --2- 172.21.15.39:0/2382887246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50541009d0 0x7f5054100db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f504c009900 tx=0x7f504c02a410 comp rx=0 tx=0).stop 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 -- 172.21.15.39:0/2382887246 shutdown_connections 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 --2- 172.21.15.39:0/2382887246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f505410e4f0 0x7f5054110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 --2- 172.21.15.39:0/2382887246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5054101380 0x7f505410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 --2- 172.21.15.39:0/2382887246 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50541009d0 0x7f5054100db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 -- 172.21.15.39:0/2382887246 >> 172.21.15.39:0/2382887246 conn(0x7f50540fc7d0 msgr2=0x7f50540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 -- 172.21.15.39:0/2382887246 shutdown_connections 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.952+0000 7f505b836640 1 -- 172.21.15.39:0/2382887246 wait complete. 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 Processor -- start 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 -- start start 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50541009d0 0x7f505419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:43.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505410e4f0 0x7f505419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5054114250 con 0x7f5054101380 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f50541140d0 con 0x7f50541009d0 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f505b836640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f50541143d0 con 0x7f505410e4f0 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f5058dd1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f5058dd1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36410/0 (socket says 172.21.15.39:36410) 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f5058dd1640 1 -- 172.21.15.39:0/3628798307 learned_addr learned my addr 172.21.15.39:0/3628798307 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f50595d2640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50541009d0 0x7f505419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.953+0000 7f5059dd3640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505410e4f0 0x7f505419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 -- 172.21.15.39:0/3628798307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505410e4f0 msgr2=0x7f505419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505410e4f0 0x7f505419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:43.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 -- 172.21.15.39:0/3628798307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50541009d0 msgr2=0x7f505419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50541009d0 0x7f505419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 -- 172.21.15.39:0/3628798307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505419f680 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f5058dd1640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f504800c920 tx=0x7f504800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048007c70 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5048007e10 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505419f970 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048018890 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.954+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541a7250 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.955+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505406a7d0 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.956+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5048018a50 con 0x7f5054101380 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.957+0000 7f50527fc640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 0x7f503c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.957+0000 7f50595d2640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 0x7f503c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:43.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.957+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f50480ceed0 con 0x7f5054101380 2024-09-12T01:54:43.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.957+0000 7f50595d2640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 0x7f503c0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f504c009230 tx=0x7f504c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:43.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:43.960+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5048014030 con 0x7f5054101380 2024-09-12T01:54:44.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.171+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5054100db0 con 0x7f5054101380 2024-09-12T01:54:44.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.172+0000 7f50527fc640 1 -- 172.21.15.39:0/3628798307 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f5054100db0 con 0x7f5054101380 2024-09-12T01:54:44.174 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:44.174 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"btime":"2024-09-12T01:54:43:818320+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T01:54:44.174 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-09-12T01:54:44.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 msgr2=0x7f503c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 0x7f503c0a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f504c009230 tx=0x7f504c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 msgr2=0x7f505419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f504800c920 tx=0x7f504800cde0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 shutdown_connections 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f503c0a2b80 0x7f503c0a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505410e4f0 0x7f505419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5054101380 0x7f505419ac10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 --2- 172.21.15.39:0/3628798307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50541009d0 0x7f505419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 >> 172.21.15.39:0/3628798307 conn(0x7f50540fc7d0 msgr2=0x7f50540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.174+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 shutdown_connections 2024-09-12T01:54:44.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:44.175+0000 7f505b836640 1 -- 172.21.15.39:0/3628798307 wait complete. 2024-09-12T01:54:44.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:44.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: Deploying daemon mds.h on smithi044 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6836/2267029874,v1:172.21.15.172:6837/2267029874] up:boot 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: fsmap 7 up:standby 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:54:44.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:44 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3628798307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: Deploying daemon mds.h on smithi044 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6836/2267029874,v1:172.21.15.172:6837/2267029874] up:boot 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: fsmap 7 up:standby 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:54:44.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:44 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3628798307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: Deploying daemon mds.h on smithi044 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6836/2267029874,v1:172.21.15.172:6837/2267029874] up:boot 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: fsmap 7 up:standby 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:54:44.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:44 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3628798307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:45.673 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:45 smithi044 systemd[1]: Starting Ceph mds.h for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:46.043 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:45 smithi044 podman[64843]: 2024-09-12 01:54:45.643503611 +0000 UTC m=+0.015966218 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:46.043 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:45 smithi044 podman[64843]: 2024-09-12 01:54:45.774015503 +0000 UTC m=+0.146478103 container create e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T01:54:46.043 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 podman[64843]: 2024-09-12 01:54:46.043542022 +0000 UTC m=+0.416004629 container init e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T01:54:46.423 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 podman[64843]: 2024-09-12 01:54:46.046552549 +0000 UTC m=+0.419015153 container start e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T01:54:46.424 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mds[64862]: -- 172.21.15.44:0/3382221268 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f632b1860 con 0x559f6328e800 2024-09-12T01:54:46.424 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: starting mds.h at 2024-09-12T01:54:46.424 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 bash[64843]: e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 2024-09-12T01:54:46.424 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:54:46 smithi044 systemd[1]: Started Ceph mds.h for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:46.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:46 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:46.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:46.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:46.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:46 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:46.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:46.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:46.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:46 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:47.166 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:47.587 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:47 smithi039 ceph-mon[31204]: Deploying daemon mds.i on smithi172 2024-09-12T01:54:47.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:47 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:boot 2024-09-12T01:54:47.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:47 smithi039 ceph-mon[31204]: fsmap 8 up:standby 2024-09-12T01:54:47.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:47 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 -- 172.21.15.39:0/2747013511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1036e0 msgr2=0x7f6a2c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/2747013511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c107b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009cd0 tx=0x7f6a2002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 -- 172.21.15.39:0/2747013511 shutdown_connections 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/2747013511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/2747013511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c107b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/2747013511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c102d30 0x7f6a2c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 -- 172.21.15.39:0/2747013511 >> 172.21.15.39:0/2747013511 conn(0x7f6a2c0fc7d0 msgr2=0x7f6a2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 -- 172.21.15.39:0/2747013511 shutdown_connections 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 -- 172.21.15.39:0/2747013511 wait complete. 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.669+0000 7f6a33e7e640 1 Processor -- start 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 -- start start 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 0x7f6a2c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c1120a0 con 0x7f6a2c1082a0 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c111f20 con 0x7f6a2c102d30 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a33e7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c112220 con 0x7f6a2c1036e0 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36418/0 (socket says 172.21.15.39:36418) 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 -- 172.21.15.39:0/3740070222 learned_addr learned my addr 172.21.15.39:0/3740070222 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a31419640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a31c1a640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 0x7f6a2c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 -- 172.21.15.39:0/3740070222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 msgr2=0x7f6a2c198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 -- 172.21.15.39:0/3740070222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 msgr2=0x7f6a2c1985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 0x7f6a2c1985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a3241b640 1 -- 172.21.15.39:0/3740070222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c19d590 con 0x7f6a2c1082a0 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a31419640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.670+0000 7f6a31c1a640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 0x7f6a2c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:47.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a3241b640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400d950 tx=0x7f6a2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24017030 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a24004020 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c19d880 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24003c00 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.671+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c1a5160 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.672+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c103110 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.673+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6a2401a070 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.674+0000 7f6a2affd640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 0x7f6a140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.674+0000 7f6a31c1a640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 0x7f6a140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.674+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6a240ce370 con 0x7f6a2c1082a0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.674+0000 7f6a31c1a640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 0x7f6a140a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009c20 tx=0x7f6a1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.678+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a24021070 con 0x7f6a2c1082a0 2024-09-12T01:54:47.698 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:47 smithi172 ceph-mon[35073]: Deploying daemon mds.i on smithi172 2024-09-12T01:54:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:47 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:boot 2024-09-12T01:54:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:47 smithi172 ceph-mon[35073]: fsmap 8 up:standby 2024-09-12T01:54:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:47 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:54:47.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.891+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a2c10a2b0 con 0x7f6a2c1082a0 2024-09-12T01:54:47.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.892+0000 7f6a2affd640 1 -- 172.21.15.39:0/3740070222 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f6a2409b770 con 0x7f6a2c1082a0 2024-09-12T01:54:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:47.893 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"btime":"2024-09-12T01:54:46:418926+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T01:54:47.894 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 msgr2=0x7f6a140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 0x7f6a140a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009c20 tx=0x7f6a1c005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 msgr2=0x7f6a2c19ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400d950 tx=0x7f6a2400de10 comp rx=0 tx=0).stop 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 shutdown_connections 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a2c1082a0 0x7f6a2c19ceb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6a140a2c00 0x7f6a140a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2c1036e0 0x7f6a2c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 --2- 172.21.15.39:0/3740070222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a2c102d30 0x7f6a2c1985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 >> 172.21.15.39:0/3740070222 conn(0x7f6a2c0fc7d0 msgr2=0x7f6a2c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 shutdown_connections 2024-09-12T01:54:47.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:47.895+0000 7f6a33e7e640 1 -- 172.21.15.39:0/3740070222 wait complete. 2024-09-12T01:54:47.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:47 smithi044 ceph-mon[35259]: Deploying daemon mds.i on smithi172 2024-09-12T01:54:47.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:47 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:boot 2024-09-12T01:54:47.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:47 smithi044 ceph-mon[35259]: fsmap 8 up:standby 2024-09-12T01:54:47.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:47 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:54:48.434 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 podman[65626]: 2024-09-12 01:54:48.326821164 +0000 UTC m=+0.140896566 container create 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T01:54:48.651 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:48 smithi039 ceph-mon[31204]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:48.651 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:48 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3740070222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:48 smithi172 ceph-mon[35073]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:48 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3740070222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 podman[65626]: 2024-09-12 01:54:48.6298325 +0000 UTC m=+0.443907865 container init 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 podman[65626]: 2024-09-12 01:54:48.632581688 +0000 UTC m=+0.446657048 container start 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 ceph-mds[65645]: -- 172.21.15.172:0/569446744 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e149bcb860 con 0x55e149ba9000 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: starting mds.i at 2024-09-12T01:54:48.696 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 bash[65626]: 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 2024-09-12T01:54:48.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:48 smithi044 ceph-mon[35259]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:48.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:48 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3740070222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:49.003 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:54:48 smithi172 systemd[1]: Started Ceph mds.i for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:50.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: Deploying daemon mds.g on smithi039 2024-09-12T01:54:50.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:boot 2024-09-12T01:54:50.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: fsmap 9 up:standby 2024-09-12T01:54:50.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:49 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:54:50.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:50.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:50.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: Deploying daemon mds.g on smithi039 2024-09-12T01:54:50.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:boot 2024-09-12T01:54:50.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: fsmap 9 up:standby 2024-09-12T01:54:50.162 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:49 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:50.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:50.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: Deploying daemon mds.g on smithi039 2024-09-12T01:54:50.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:boot 2024-09-12T01:54:50.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: fsmap 9 up:standby 2024-09-12T01:54:50.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:49 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:54:50.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:50.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:50 smithi039 ceph-mon[31204]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:51.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:50 smithi044 ceph-mon[35259]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:50 smithi172 ceph-mon[35073]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:51.390 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:51.514 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 01:54:51 smithi039 systemd[1]: Started Ceph mds.g for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 -- 172.21.15.39:0/2119936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100480 msgr2=0x7f0624100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 --2- 172.21.15.39:0/2119936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100480 0x7f0624100860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0614009900 tx=0x7f061402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 -- 172.21.15.39:0/2119936 shutdown_connections 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 --2- 172.21.15.39:0/2119936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f06241055b0 0x7f062410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 --2- 172.21.15.39:0/2119936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624100e30 0x7f0624104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 --2- 172.21.15.39:0/2119936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100480 0x7f0624100860 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 -- 172.21.15.39:0/2119936 >> 172.21.15.39:0/2119936 conn(0x7f0624077210 msgr2=0x7f06240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 -- 172.21.15.39:0/2119936 shutdown_connections 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.860+0000 7f0629386640 1 -- 172.21.15.39:0/2119936 wait complete. 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 Processor -- start 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 -- start start 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0624100480 0x7f0624198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 0x7f062419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0624110f00 con 0x7f0624100e30 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0624110d80 con 0x7f0624100480 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f0629386640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0624111080 con 0x7f06241055b0 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f06227fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f06227fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36472/0 (socket says 172.21.15.39:36472) 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.861+0000 7f06227fc640 1 -- 172.21.15.39:0/2509780315 learned_addr learned my addr 172.21.15.39:0/2509780315 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f0622ffd640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0624100480 0x7f0624198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06237fe640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 0x7f062419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 -- 172.21.15.39:0/2509780315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 msgr2=0x7f062419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 0x7f062419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 -- 172.21.15.39:0/2509780315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0624100480 msgr2=0x7f0624198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0624100480 0x7f0624198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 -- 172.21.15.39:0/2509780315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062419d430 con 0x7f0624100e30 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06237fe640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 0x7f062419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f06227fc640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f061800b4a0 tx=0x7f061800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618014070 con 0x7f0624100e30 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0618010af0 con 0x7f0624100e30 2024-09-12T01:54:51.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062419d720 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618017d10 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.862+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06241a5000 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.863+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0624100860 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.864+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0618017070 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.865+0000 7f060bfff640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 0x7f060c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.865+0000 7f0622ffd640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 0x7f060c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.865+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f06180ce3b0 con 0x7f0624100e30 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.866+0000 7f0622ffd640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 0x7f060c0a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f0614005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:51.868+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f061809b7b0 con 0x7f0624100e30 2024-09-12T01:54:52.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.087+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06241997e0 con 0x7f0624100e30 2024-09-12T01:54:52.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.088+0000 7f060bfff640 1 -- 172.21.15.39:0/2509780315 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f06241997e0 con 0x7f0624100e30 2024-09-12T01:54:52.089 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:52.089 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":11,"btime":"2024-09-12T01:54:51:765276+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24463,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T01:54:52.089 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 11 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 msgr2=0x7f060c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 0x7f060c0a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f0614005a20 comp rx=0 tx=0).stop 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 msgr2=0x7f06241989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f061800b4a0 tx=0x7f061800b960 comp rx=0 tx=0).stop 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 shutdown_connections 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f060c0a2b80 0x7f060c0a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06241055b0 0x7f062419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0624100e30 0x7f06241989c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 --2- 172.21.15.39:0/2509780315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0624100480 0x7f0624198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 >> 172.21.15.39:0/2509780315 conn(0x7f0624077210 msgr2=0x7f0624103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 shutdown_connections 2024-09-12T01:54:52.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:52.090+0000 7f0629386640 1 -- 172.21.15.39:0/2509780315 wait complete. 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: Deploying daemon mds.a on smithi039 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.39:6838/3465657492,v1:172.21.15.39:6839/3465657492] up:boot 2024-09-12T01:54:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: fsmap 10 up:standby 2024-09-12T01:54:52.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:54:52.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:52 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2509780315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: Deploying daemon mds.a on smithi039 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.39:6838/3465657492,v1:172.21.15.39:6839/3465657492] up:boot 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: fsmap 10 up:standby 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:54:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:52 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2509780315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:52.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.755 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: Deploying daemon mds.a on smithi039 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.39:6838/3465657492,v1:172.21.15.39:6839/3465657492] up:boot 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: fsmap 10 up:standby 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:54:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:52 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2509780315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:54.410 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 systemd[1]: Starting Ceph mds.a for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:54 smithi044 ceph-mon[35259]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:54.723 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:54 smithi039 ceph-mon[31204]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:54.723 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 podman[69616]: 2024-09-12 01:54:54.377884542 +0000 UTC m=+0.016498008 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:54.723 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 podman[69616]: 2024-09-12 01:54:54.495635717 +0000 UTC m=+0.134249173 container create 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T01:54:54.723 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 podman[69616]: 2024-09-12 01:54:54.723591418 +0000 UTC m=+0.362204875 container init 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T01:54:54.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:54 smithi172 ceph-mon[35073]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:54.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:55.117 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:55.160 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 podman[69616]: 2024-09-12 01:54:54.726608753 +0000 UTC m=+0.365222210 container start 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T01:54:55.161 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 ceph-mds[69635]: -- 172.21.15.39:0/3527526743 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567ec807860 con 0x5567ec7e5000 2024-09-12T01:54:55.161 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a[69631]: starting mds.a at 2024-09-12T01:54:55.161 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 bash[69616]: 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 2024-09-12T01:54:55.161 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 01:54:54 smithi039 systemd[1]: Started Ceph mds.a for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:55.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 -- 172.21.15.39:0/3350007254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 msgr2=0x7f3e8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 --2- 172.21.15.39:0/3350007254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e8410d950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009cd0 tx=0x7f3e7c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 -- 172.21.15.39:0/3350007254 shutdown_connections 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 --2- 172.21.15.39:0/3350007254 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e8410d950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 --2- 172.21.15.39:0/3350007254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84100a80 0x7f3e84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 --2- 172.21.15.39:0/3350007254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84106a80 0x7f3e84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 -- 172.21.15.39:0/3350007254 >> 172.21.15.39:0/3350007254 conn(0x7f3e840fc7a0 msgr2=0x7f3e840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 -- 172.21.15.39:0/3350007254 shutdown_connections 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 -- 172.21.15.39:0/3350007254 wait complete. 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.602+0000 7f3e8886e640 1 Processor -- start 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 -- start start 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84100a80 0x7f3e84197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84106a80 0x7f3e8419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84110e80 con 0x7f3e84101420 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84110d00 con 0x7f3e84100a80 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8886e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84111000 con 0x7f3e84106a80 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49652/0 (socket says 172.21.15.39:49652) 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 -- 172.21.15.39:0/531615061 learned_addr learned my addr 172.21.15.39:0/531615061 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e8259c640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84100a80 0x7f3e84197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e82d9d640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84106a80 0x7f3e8419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 -- 172.21.15.39:0/531615061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84106a80 msgr2=0x7f3e8419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84106a80 0x7f3e8419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 -- 172.21.15.39:0/531615061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84100a80 msgr2=0x7f3e84197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84100a80 0x7f3e84197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 -- 172.21.15.39:0/531615061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8419c2c0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.603+0000 7f3e7bfff640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c890 tx=0x7f3e6c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.604+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c004220 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.604+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c0043c0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.604+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8419c5b0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.604+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0049e0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.604+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e841a3e90 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.605+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e84100ee0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.606+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e6c0079b0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.607+0000 7f3e7b7fe640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 0x7f3e700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.607+0000 7f3e8259c640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 0x7f3e700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.607+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f3e6c0cecd0 con 0x7f3e84101420 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.607+0000 7f3e8259c640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 0x7f3e700a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005d00 tx=0x7f3e7400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.610+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e6c014030 con 0x7f3e84101420 2024-09-12T01:54:55.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.822+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e8402d7c0 con 0x7f3e84101420 2024-09-12T01:54:55.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.823+0000 7f3e7b7fe640 1 -- 172.21.15.39:0/531615061 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f3e6c09c030 con 0x7f3e84101420 2024-09-12T01:54:55.824 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:54:55.824 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":12,"btime":"2024-09-12T01:54:55:429079+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24463,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T01:54:55.824 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 12 2024-09-12T01:54:55.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 msgr2=0x7f3e700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 0x7f3e700a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005d00 tx=0x7f3e7400b410 comp rx=0 tx=0).stop 2024-09-12T01:54:55.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 msgr2=0x7f3e84197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:55.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c890 tx=0x7f3e6c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:54:55.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 shutdown_connections 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3e700a2b80 0x7f3e700a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e84106a80 0x7f3e8419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e84101420 0x7f3e84197850 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 --2- 172.21.15.39:0/531615061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e84100a80 0x7f3e84197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 >> 172.21.15.39:0/531615061 conn(0x7f3e840fc7a0 msgr2=0x7f3e840fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 shutdown_connections 2024-09-12T01:54:55.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:55.825+0000 7f3e8886e640 1 -- 172.21.15.39:0/531615061 wait complete. 2024-09-12T01:54:56.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: Deploying daemon mds.b on smithi044 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.39:6840/1943939637,v1:172.21.15.39:6841/1943939637] up:boot 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: fsmap 11 up:standby 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:54:56.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/531615061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:56.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: Deploying daemon mds.b on smithi044 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.39:6840/1943939637,v1:172.21.15.39:6841/1943939637] up:boot 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: fsmap 11 up:standby 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:54:56.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/531615061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:56.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:56.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: Deploying daemon mds.b on smithi044 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.39:6840/1943939637,v1:172.21.15.39:6841/1943939637] up:boot 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: fsmap 11 up:standby 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:54:56.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/531615061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:56.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:56 smithi039 ceph-mon[31204]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:57.022 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:56 smithi044 ceph-mon[35259]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:56 smithi172 ceph-mon[35073]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:57.423 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 systemd[1]: Starting Ceph mds.b for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:54:57.774 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 podman[65146]: 2024-09-12 01:54:57.379874712 +0000 UTC m=+0.015979104 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:54:57.775 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 podman[65146]: 2024-09-12 01:54:57.529988938 +0000 UTC m=+0.166093358 container create 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T01:54:57.775 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 podman[65146]: 2024-09-12 01:54:57.774656635 +0000 UTC m=+0.410761014 container init 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T01:54:58.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 podman[65146]: 2024-09-12 01:54:57.778088029 +0000 UTC m=+0.414192419 container start 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:54:58.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 ceph-mds[65165]: -- 172.21.15.44:0/3201477445 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c0c11d9860 con 0x55c0c11b7400 2024-09-12T01:54:58.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: starting mds.b at 2024-09-12T01:54:58.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 bash[65146]: 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f 2024-09-12T01:54:58.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:54:57 smithi044 systemd[1]: Started Ceph mds.b for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:54:58.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:59.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:boot 2024-09-12T01:54:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: fsmap 12 up:standby 2024-09-12T01:54:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:54:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:59.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:54:58 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:boot 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: fsmap 12 up:standby 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:54:58 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:54:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:boot 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: fsmap 12 up:standby 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:59.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:54:58 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:54:59.293 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:59.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 -- 172.21.15.39:0/186900204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd8106f50 msgr2=0x7f3dd810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 --2- 172.21.15.39:0/186900204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd8106f50 0x7f3dd810eaf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009cd0 tx=0x7f3dd002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 -- 172.21.15.39:0/186900204 shutdown_connections 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 --2- 172.21.15.39:0/186900204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd8106f50 0x7f3dd810eaf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 --2- 172.21.15.39:0/186900204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8100ca0 0x7f3dd8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.774+0000 7f3de0393640 1 --2- 172.21.15.39:0/186900204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd81002f0 0x7f3dd81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- 172.21.15.39:0/186900204 >> 172.21.15.39:0/186900204 conn(0x7f3dd8077210 msgr2=0x7f3dd80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- 172.21.15.39:0/186900204 shutdown_connections 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- 172.21.15.39:0/186900204 wait complete. 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 Processor -- start 2024-09-12T01:54:59.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- start start 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 0x7f3dd81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8106f50 0x7f3dd819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8111fa0 con 0x7f3dd81002f0 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8111e20 con 0x7f3dd8100ca0 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3de0393640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8112120 con 0x7f3dd8106f50 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.775+0000 7f3dde12f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49658/0 (socket says 172.21.15.39:49658) 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 -- 172.21.15.39:0/1488237687 learned_addr learned my addr 172.21.15.39:0/1488237687 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde930640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8106f50 0x7f3dd819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3ddd92e640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 0x7f3dd81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 -- 172.21.15.39:0/1488237687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8106f50 msgr2=0x7f3dd819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8106f50 0x7f3dd819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 -- 172.21.15.39:0/1488237687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 msgr2=0x7f3dd81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 0x7f3dd81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 -- 172.21.15.39:0/1488237687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd819d410 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3ddd92e640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 0x7f3dd81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dde12f640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d950 tx=0x7f3dd400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4017070 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd819d700 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd4009c30 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400f6b0 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.776+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81a4fe0 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.777+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd81006d0 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.778+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3dd40109d0 con 0x7f3dd81002f0 2024-09-12T01:54:59.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.779+0000 7f3dcf7fe640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 0x7f3dc40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.779+0000 7f3ddd92e640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 0x7f3dc40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.779+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f3dd40ce810 con 0x7f3dd81002f0 2024-09-12T01:54:59.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.780+0000 7f3ddd92e640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 0x7f3dc40a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005fd0 tx=0x7f3dc8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:59.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:54:59.784+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dd4009de0 con 0x7f3dd81002f0 2024-09-12T01:55:00.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.026+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd802d7c0 con 0x7f3dd81002f0 2024-09-12T01:55:00.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.027+0000 7f3dcf7fe640 1 -- 172.21.15.39:0/1488237687 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f3dd409bc10 con 0x7f3dd81002f0 2024-09-12T01:55:00.028 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:00.028 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":13,"btime":"2024-09-12T01:54:57:886251+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24463,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T01:55:00.029 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 13 2024-09-12T01:55:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 msgr2=0x7f3dc40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 0x7f3dc40a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005fd0 tx=0x7f3dc8005850 comp rx=0 tx=0).stop 2024-09-12T01:55:00.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 msgr2=0x7f3dd8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d950 tx=0x7f3dd400de10 comp rx=0 tx=0).stop 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 shutdown_connections 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f3dc40a2b80 0x7f3dc40a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd8106f50 0x7f3dd819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dd8100ca0 0x7f3dd81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 --2- 172.21.15.39:0/1488237687 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3dd81002f0 0x7f3dd8198460 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 >> 172.21.15.39:0/1488237687 conn(0x7f3dd8077210 msgr2=0x7f3dd8105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 shutdown_connections 2024-09-12T01:55:00.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:00.030+0000 7f3de0393640 1 -- 172.21.15.39:0/1488237687 wait complete. 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1488237687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.690 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:00.690 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:00.690 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.690 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:00 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T01:55:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1488237687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:00 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.975 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:00.975 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1488237687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:00.976 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:00 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/2110983678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8100a80 msgr2=0x7f0cf8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/2110983678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8100a80 0x7f0cf8100ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009930 tx=0x7f0ce802a420 comp rx=0 tx=0).stop 2024-09-12T01:55:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/2110983678 shutdown_connections 2024-09-12T01:55:02.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/2110983678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/2110983678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8100a80 0x7f0cf8100ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/2110983678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8106a80 0x7f0cf8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/2110983678 >> 172.21.15.39:0/2110983678 conn(0x7f0cf80fc7a0 msgr2=0x7f0cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/2110983678 shutdown_connections 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.161+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/2110983678 wait complete. 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 Processor -- start 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 -- start start 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8100a80 0x7f0cf8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8110e80 con 0x7f0cf8106a80 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8110d00 con 0x7f0cf8101420 2024-09-12T01:55:02.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cfcbcc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8111000 con 0x7f0cf8100a80 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cf5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49678/0 (socket says 172.21.15.39:49678) 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.162+0000 7f0cf6d9d640 1 -- 172.21.15.39:0/1925928427 learned_addr learned my addr 172.21.15.39:0/1925928427 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf659c640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8100a80 0x7f0cf8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 -- 172.21.15.39:0/1925928427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8100a80 msgr2=0x7f0cf8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8100a80 0x7f0cf8199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 -- 172.21.15.39:0/1925928427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 msgr2=0x7f0cf8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf8199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 -- 172.21.15.39:0/1925928427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf81a48d0 con 0x7f0cf8106a80 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf5d9b640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cf6d9d640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d750 tx=0x7f0cf000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:02.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0017070 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf0005500 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf81a4aa0 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0004d90 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.163+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf81a4f60 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.164+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf8100ee0 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.165+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0cf0004f30 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.166+0000 7f0cef7fe640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 0x7f0ce40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.166+0000 7f0cf659c640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 0x7f0ce40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.166+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0cf00ce530 con 0x7f0cf8106a80 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.167+0000 7f0cf659c640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 0x7f0ce40a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00092f0 tx=0x7f0ce0009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:02.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.171+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0cf009b930 con 0x7f0cf8106a80 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.355+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0cf8108ff0 con 0x7f0cf8106a80 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.355+0000 7f0cef7fe640 1 -- 172.21.15.39:0/1925928427 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f0cf009b230 con 0x7f0cf8106a80 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-09-12T01:55:02.356 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-09-12T01:55:02.357 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:55:02.357 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-09-12T01:55:02.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.357+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 msgr2=0x7f0ce40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:02.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.357+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 0x7f0ce40a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00092f0 tx=0x7f0ce0009280 comp rx=0 tx=0).stop 2024-09-12T01:55:02.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.357+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 msgr2=0x7f0cf81a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.357+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d750 tx=0x7f0cf000dc10 comp rx=0 tx=0).stop 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 shutdown_connections 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cf8106a80 0x7f0cf81a4390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8101420 0x7f0cf8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ce40a2c00 0x7f0ce40a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 --2- 172.21.15.39:0/1925928427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf8100a80 0x7f0cf8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 >> 172.21.15.39:0/1925928427 conn(0x7f0cf80fc7a0 msgr2=0x7f0cf80fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 shutdown_connections 2024-09-12T01:55:02.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:02.358+0000 7f0cfcbcc640 1 -- 172.21.15.39:0/1925928427 wait complete. 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:02 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1925928427' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:03.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.036 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:02 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1925928427' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:03.065 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:55:03.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:55:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:03.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:02 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1925928427' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:03.336 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:03.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 -- 172.21.15.39:0/498503514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 msgr2=0x7f99d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 --2- 172.21.15.39:0/498503514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d410ea90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009ca0 tx=0x7f99cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 -- 172.21.15.39:0/498503514 shutdown_connections 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 --2- 172.21.15.39:0/498503514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d410ea90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 --2- 172.21.15.39:0/498503514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4102790 0x7f99d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 --2- 172.21.15.39:0/498503514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4101de0 0x7f99d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 -- 172.21.15.39:0/498503514 >> 172.21.15.39:0/498503514 conn(0x7f99d40fd8c0 msgr2=0x7f99d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 -- 172.21.15.39:0/498503514 shutdown_connections 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.851+0000 7f99dc052640 1 -- 172.21.15.39:0/498503514 wait complete. 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 Processor -- start 2024-09-12T01:55:03.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 -- start start 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111f70 con 0x7f99d4106f10 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111df0 con 0x7f99d4102790 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99dc052640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41120f0 con 0x7f99d4101de0 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.852+0000 7f99da5ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53276/0 (socket says 172.21.15.39:53276) 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 -- 172.21.15.39:0/3196437221 learned_addr learned my addr 172.21.15.39:0/3196437221 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99d95ed640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99d9dee640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 -- 172.21.15.39:0/3196437221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4101de0 msgr2=0x7f99d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 -- 172.21.15.39:0/3196437221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 msgr2=0x7f99d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 -- 172.21.15.39:0/3196437221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41a6740 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99d95ed640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99da5ef640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99cc031a60 tx=0x7f99cc031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc003b70 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99cc003d10 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41a69d0 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc004770 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.853+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41a6f10 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.854+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d41021c0 con 0x7f99d4106f10 2024-09-12T01:55:03.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.856+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f99cc02f790 con 0x7f99d4106f10 2024-09-12T01:55:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.857+0000 7f99caffd640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 0x7f99c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.857+0000 7f99d9dee640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 0x7f99c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.857+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f99cc0efe30 con 0x7f99d4106f10 2024-09-12T01:55:03.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.857+0000 7f99d9dee640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 0x7f99c00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99d000abe0 tx=0x7f99d000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:03.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:03.861+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99cc0bd230 con 0x7f99d4106f10 2024-09-12T01:55:04.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.037+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f99d41a71a0 con 0x7f99d4106f10 2024-09-12T01:55:04.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.521+0000 7f99caffd640 1 -- 172.21.15.39:0/3196437221 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f99cc0bcb30 con 0x7f99d4106f10 2024-09-12T01:55:04.522 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 msgr2=0x7f99c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 0x7f99c00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99d000abe0 tx=0x7f99d000a2d0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 msgr2=0x7f99d4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99cc031a60 tx=0x7f99cc031a90 comp rx=0 tx=0).stop 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 shutdown_connections 2024-09-12T01:55:04.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f99c00a2b80 0x7f99c00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 --2- 172.21.15.39:0/3196437221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.523+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 >> 172.21.15.39:0/3196437221 conn(0x7f99d40fd8c0 msgr2=0x7f99d40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.524+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 shutdown_connections 2024-09-12T01:55:04.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:04.524+0000 7f99dc052640 1 -- 172.21.15.39:0/3196437221 wait complete. 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:04 smithi172 ceph-mon[35073]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:04.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:04.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:04.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.904 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:04 smithi039 ceph-mon[31204]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:04.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:04.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:55:04.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:04 smithi044 ceph-mon[35259]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:05.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:55:05.491 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:05.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:05 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:55:05.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:05 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:55:05.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:05 smithi039 ceph-mon[31204]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:05.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:05 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:55:05.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:05 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:55:05.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:05 smithi172 ceph-mon[35073]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:05.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:05 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:55:05.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:05 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3196437221' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:55:05.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:05 smithi044 ceph-mon[35259]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 -- 172.21.15.39:0/2049598239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d24106f50 msgr2=0x7f0d2410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 --2- 172.21.15.39:0/2049598239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d24106f50 0x7f0d2410eaf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009cd0 tx=0x7f0d1c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 -- 172.21.15.39:0/2049598239 shutdown_connections 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 --2- 172.21.15.39:0/2049598239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d24106f50 0x7f0d2410eaf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 --2- 172.21.15.39:0/2049598239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24100ca0 0x7f0d24106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 --2- 172.21.15.39:0/2049598239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d241002f0 0x7f0d241006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 -- 172.21.15.39:0/2049598239 >> 172.21.15.39:0/2049598239 conn(0x7f0d24077210 msgr2=0x7f0d240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 -- 172.21.15.39:0/2049598239 shutdown_connections 2024-09-12T01:55:05.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.944+0000 7f0d28842640 1 -- 172.21.15.39:0/2049598239 wait complete. 2024-09-12T01:55:05.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 Processor -- start 2024-09-12T01:55:05.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 -- start start 2024-09-12T01:55:05.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d24100ca0 0x7f0d24198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24106f50 0x7f0d2419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112080 con 0x7f0d241002f0 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24111f00 con 0x7f0d24100ca0 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d28842640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112200 con 0x7f0d24106f50 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d2259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d2259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53292/0 (socket says 172.21.15.39:53292) 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d2259c640 1 -- 172.21.15.39:0/2444127664 learned_addr learned my addr 172.21.15.39:0/2444127664 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d21d9b640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d24100ca0 0x7f0d24198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.945+0000 7f0d22d9d640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24106f50 0x7f0d2419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 -- 172.21.15.39:0/2444127664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24106f50 msgr2=0x7f0d2419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24106f50 0x7f0d2419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 -- 172.21.15.39:0/2444127664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d24100ca0 msgr2=0x7f0d24198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d24100ca0 0x7f0d24198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 -- 172.21.15.39:0/2444127664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2419d570 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d2259c640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400b4a0 tx=0x7f0d1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14014070 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d14010af0 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2419d860 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14017d10 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.946+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d241a5140 con 0x7f0d241002f0 2024-09-12T01:55:06.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.947+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d24100750 con 0x7f0d241002f0 2024-09-12T01:55:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.948+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d14017070 con 0x7f0d241002f0 2024-09-12T01:55:06.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.949+0000 7f0d137fe640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 0x7f0d0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.949+0000 7f0d21d9b640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 0x7f0d0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.949+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f0d140ce4c0 con 0x7f0d241002f0 2024-09-12T01:55:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.950+0000 7f0d21d9b640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 0x7f0d0c0a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0d240ff880 tx=0x7f0d18008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:05.953+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d1409b750 con 0x7f0d241002f0 2024-09-12T01:55:06.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.127+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0d2410a1a0 con 0x7f0d241002f0 2024-09-12T01:55:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.568+0000 7f0d137fe640 1 -- 172.21.15.39:0/2444127664 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f0d1409b050 con 0x7f0d241002f0 2024-09-12T01:55:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.571+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 msgr2=0x7f0d0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.571+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 0x7f0d0c0a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0d240ff880 tx=0x7f0d18008040 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.571+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 msgr2=0x7f0d241985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.571+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400b4a0 tx=0x7f0d1400b960 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 shutdown_connections 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d0c0a2c00 0x7f0d0c0a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24106f50 0x7f0d2419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d24100ca0 0x7f0d24198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 --2- 172.21.15.39:0/2444127664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d241002f0 0x7f0d241985c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 >> 172.21.15.39:0/2444127664 conn(0x7f0d24077210 msgr2=0x7f0d241051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 shutdown_connections 2024-09-12T01:55:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:06.572+0000 7f0d28842640 1 -- 172.21.15.39:0/2444127664 wait complete. 2024-09-12T01:55:06.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:06 smithi039 ceph-mon[31204]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:06.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:06 smithi039 ceph-mon[31204]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:55:06.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:06 smithi039 ceph-mon[31204]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:06 smithi044 ceph-mon[35259]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:06 smithi044 ceph-mon[35259]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:55:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:06 smithi044 ceph-mon[35259]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:06 smithi172 ceph-mon[35073]: pgmap v277: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:06 smithi172 ceph-mon[35073]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:55:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:06 smithi172 ceph-mon[35073]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:55:07.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:55:07.620 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:07.870 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:07 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:55:07.870 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:07 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:55:07.870 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:07 smithi039 ceph-mon[31204]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:55:07.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:07 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:55:07.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:07 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:55:07.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:07 smithi044 ceph-mon[35259]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:55:08.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:07 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:55:08.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:07 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2444127664' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:55:08.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:07 smithi172 ceph-mon[35073]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:55:08.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 -- 172.21.15.39:0/94076302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 msgr2=0x7f968010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 --2- 172.21.15.39:0/94076302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f968010d950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9678009cd0 tx=0x7f967802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 -- 172.21.15.39:0/94076302 shutdown_connections 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 --2- 172.21.15.39:0/94076302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f968010d950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 --2- 172.21.15.39:0/94076302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680100a80 0x7f9680100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.102+0000 7f96879d6640 1 --2- 172.21.15.39:0/94076302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680106a80 0x7f9680106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.103+0000 7f96879d6640 1 -- 172.21.15.39:0/94076302 >> 172.21.15.39:0/94076302 conn(0x7f96800fc7a0 msgr2=0x7f96800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.103+0000 7f96879d6640 1 -- 172.21.15.39:0/94076302 shutdown_connections 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.103+0000 7f96879d6640 1 -- 172.21.15.39:0/94076302 wait complete. 2024-09-12T01:55:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.103+0000 7f96879d6640 1 Processor -- start 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.103+0000 7f96879d6640 1 -- start start 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680100a80 0x7f9680199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 0x7f96801a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9680110e80 con 0x7f9680101420 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9680110d00 con 0x7f9680106a80 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96879d6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9680111000 con 0x7f9680100a80 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:08.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53312/0 (socket says 172.21.15.39:53312) 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 -- 172.21.15.39:0/1991950057 learned_addr learned my addr 172.21.15.39:0/1991950057 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9685772640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680100a80 0x7f9680199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9685f73640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 0x7f96801a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 -- 172.21.15.39:0/1991950057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680100a80 msgr2=0x7f9680199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680100a80 0x7f9680199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 -- 172.21.15.39:0/1991950057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 msgr2=0x7f96801a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 0x7f96801a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 -- 172.21.15.39:0/1991950057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801a4840 con 0x7f9680101420 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9685f73640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 0x7f96801a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f9684f71640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.104+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670017070 con 0x7f9680101420 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.105+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801a4a10 con 0x7f9680101420 2024-09-12T01:55:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.105+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9670009c30 con 0x7f9680101420 2024-09-12T01:55:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.105+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967000f6b0 con 0x7f9680101420 2024-09-12T01:55:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.105+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a4f50 con 0x7f9680101420 2024-09-12T01:55:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.106+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680100ee0 con 0x7f9680101420 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.107+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f96700109d0 con 0x7f9680101420 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.108+0000 7f96767fc640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 0x7f966c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.108+0000 7f9685772640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 0x7f966c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.108+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f96700cec00 con 0x7f9680101420 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.108+0000 7f9685772640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 0x7f966c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f967c009ae0 tx=0x7f967c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:08.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.111+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9670009de0 con 0x7f9680101420 2024-09-12T01:55:08.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.324+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f968006ad80 con 0x7f9680101420 2024-09-12T01:55:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.585+0000 7f96767fc640 1 -- 172.21.15.39:0/1991950057 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f968006ad80 con 0x7f9680101420 2024-09-12T01:55:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:55:08.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 msgr2=0x7f966c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:08.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 0x7f966c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f967c009ae0 tx=0x7f967c005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:08.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 msgr2=0x7f96801997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:08.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000de10 comp rx=0 tx=0).stop 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 shutdown_connections 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9680106a80 0x7f96801a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9680101420 0x7f96801997c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f966c0a2b80 0x7f966c0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 --2- 172.21.15.39:0/1991950057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9680100a80 0x7f9680199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 >> 172.21.15.39:0/1991950057 conn(0x7f96800fc7a0 msgr2=0x7f96800fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 shutdown_connections 2024-09-12T01:55:08.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:08.586+0000 7f96879d6640 1 -- 172.21.15.39:0/1991950057 wait complete. 2024-09-12T01:55:08.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:08 smithi039 ceph-mon[31204]: pgmap v280: 97 pgs: 19 creating+peering, 68 unknown, 10 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:08.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:08 smithi039 ceph-mon[31204]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:55:08.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:08 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:55:08.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:08 smithi039 ceph-mon[31204]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:55:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:08 smithi044 ceph-mon[35259]: pgmap v280: 97 pgs: 19 creating+peering, 68 unknown, 10 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:08 smithi044 ceph-mon[35259]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:55:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:08 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:55:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:08 smithi044 ceph-mon[35259]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:55:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:08 smithi172 ceph-mon[35073]: pgmap v280: 97 pgs: 19 creating+peering, 68 unknown, 10 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:55:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:08 smithi172 ceph-mon[35073]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:55:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:08 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:55:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:08 smithi172 ceph-mon[35073]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:55:09.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:09.511 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:09 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:55:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:09 smithi039 ceph-mon[31204]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:55:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:09 smithi039 ceph-mon[31204]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:55:09.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:09 smithi039 ceph-mon[31204]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:55:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:09 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:55:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:09 smithi044 ceph-mon[35259]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:55:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:09 smithi044 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:55:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:09 smithi044 ceph-mon[35259]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:55:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:09 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1991950057' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:55:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:09 smithi172 ceph-mon[35073]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:55:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:09 smithi172 ceph-mon[35073]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:55:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:09 smithi172 ceph-mon[35073]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:55:10.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 -- 172.21.15.39:0/2779640017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 msgr2=0x7f150c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:10.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 --2- 172.21.15.39:0/2779640017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c10df40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009900 tx=0x7f14fc02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 -- 172.21.15.39:0/2779640017 shutdown_connections 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 --2- 172.21.15.39:0/2779640017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c10e480 0x7f150c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 --2- 172.21.15.39:0/2779640017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c10df40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 --2- 172.21.15.39:0/2779640017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c1008d0 0x7f150c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 -- 172.21.15.39:0/2779640017 >> 172.21.15.39:0/2779640017 conn(0x7f150c0fc7a0 msgr2=0x7f150c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 -- 172.21.15.39:0/2779640017 shutdown_connections 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.024+0000 7f151350d640 1 -- 172.21.15.39:0/2779640017 wait complete. 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 Processor -- start 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 -- start start 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 0x7f150c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 0x7f150c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:10.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f150c114190 con 0x7f150c101280 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f150c114010 con 0x7f150c1008d0 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f151350d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f150c114310 con 0x7f150c10e480 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f1510aa8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f1510aa8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53332/0 (socket says 172.21.15.39:53332) 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f1510aa8640 1 -- 172.21.15.39:0/2930620836 learned_addr learned my addr 172.21.15.39:0/2930620836 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f1511aaa640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 0x7f150c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.025+0000 7f15112a9640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 0x7f150c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 -- 172.21.15.39:0/2930620836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 msgr2=0x7f150c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 0x7f150c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 -- 172.21.15.39:0/2930620836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 msgr2=0x7f150c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 0x7f150c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 -- 172.21.15.39:0/2930620836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c19f620 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f15112a9640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 0x7f150c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1511aaa640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 0x7f150c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f1510aa8640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc03f030 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14fc003ce0 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c19f8b0 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc035070 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.026+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c1a71f0 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.028+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150c06b070 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.028+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f14fc042030 con 0x7f150c101280 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.029+0000 7f15027fc640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 0x7f14f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.029+0000 7f15112a9640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 0x7f14f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:10.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.029+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14fc0ef900 con 0x7f150c101280 2024-09-12T01:55:10.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.029+0000 7f15112a9640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 0x7f14f80a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15080058c0 tx=0x7f1508005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:10.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.033+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14fc0bca70 con 0x7f150c101280 2024-09-12T01:55:10.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.209+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f150c109610 con 0x7f150c101280 2024-09-12T01:55:10.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.210+0000 7f15027fc640 1 -- 172.21.15.39:0/2930620836 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22245 (secure 0 0 0) 0x7f14fc0bc370 con 0x7f150c101280 2024-09-12T01:55:10.211 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:10.211 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":80,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:55:08.326279+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:10.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.212+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 msgr2=0x7f14f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.212+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 0x7f14f80a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15080058c0 tx=0x7f1508005850 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 msgr2=0x7f150c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc0042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 shutdown_connections 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f14f80a2b80 0x7f14f80a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f150c10e480 0x7f150c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f150c101280 0x7f150c19abb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 --2- 172.21.15.39:0/2930620836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f150c1008d0 0x7f150c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 >> 172.21.15.39:0/2930620836 conn(0x7f150c0fc7a0 msgr2=0x7f150c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:10.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 shutdown_connections 2024-09-12T01:55:10.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:10.213+0000 7f151350d640 1 -- 172.21.15.39:0/2930620836 wait complete. 2024-09-12T01:55:10.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: pgmap v283: 97 pgs: 1 creating+activating, 26 creating+peering, 15 unknown, 55 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: Cluster is now healthy 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:active 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:10.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:10 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2930620836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:10.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: pgmap v283: 97 pgs: 1 creating+activating, 26 creating+peering, 15 unknown, 55 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-12T01:55:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:55:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: Cluster is now healthy 2024-09-12T01:55:10.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:active 2024-09-12T01:55:10.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:10.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:10.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:10 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2930620836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: pgmap v283: 97 pgs: 1 creating+activating, 26 creating+peering, 15 unknown, 55 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: Cluster is now healthy 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] up:active 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:11.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:10 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2930620836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:11.172 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 -- 172.21.15.39:0/3569098438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268101420 msgr2=0x7f026810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 --2- 172.21.15.39:0/3569098438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268101420 0x7f026810d950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0260009cd0 tx=0x7f026002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 -- 172.21.15.39:0/3569098438 shutdown_connections 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 --2- 172.21.15.39:0/3569098438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268101420 0x7f026810d950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 --2- 172.21.15.39:0/3569098438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268100a80 0x7f0268100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 --2- 172.21.15.39:0/3569098438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268106a80 0x7f0268106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 -- 172.21.15.39:0/3569098438 >> 172.21.15.39:0/3569098438 conn(0x7f02680fc7a0 msgr2=0x7f02680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 -- 172.21.15.39:0/3569098438 shutdown_connections 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 -- 172.21.15.39:0/3569098438 wait complete. 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.659+0000 7f026f66d640 1 Processor -- start 2024-09-12T01:55:11.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 -- start start 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268100a80 0x7f0268198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101420 0x7f02681988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0268111fe0 con 0x7f0268106a80 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0268111e60 con 0x7f0268101420 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026f66d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0268112160 con 0x7f0268100a80 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53352/0 (socket says 172.21.15.39:53352) 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 -- 172.21.15.39:0/217099151 learned_addr learned my addr 172.21.15.39:0/217099151 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026cc08640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101420 0x7f02681988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026d409640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268100a80 0x7f0268198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 -- 172.21.15.39:0/217099151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268100a80 msgr2=0x7f0268198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:11.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268100a80 0x7f0268198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 -- 172.21.15.39:0/217099151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101420 msgr2=0x7f02681988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101420 0x7f02681988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 -- 172.21.15.39:0/217099151 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026819d330 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.660+0000 7f026dc0a640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0260033040 tx=0x7f0260003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.661+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260004040 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.661+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02600046c0 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.661+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026819d5c0 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.661+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260046480 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.661+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02681a4f00 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.662+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0268100ee0 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.664+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f02600305a0 con 0x7f0268106a80 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.664+0000 7f025e7fc640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 0x7f02540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:11.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.664+0000 7f026d409640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 0x7f02540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:11.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.664+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f026002e030 con 0x7f0268106a80 2024-09-12T01:55:11.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.665+0000 7f026d409640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 0x7f02540a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f026400cac0 tx=0x7f026400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:11.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.668+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f026004b060 con 0x7f0268106a80 2024-09-12T01:55:11.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.844+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02681a5160 con 0x7f0268106a80 2024-09-12T01:55:11.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.845+0000 7f025e7fc640 1 -- 172.21.15.39:0/217099151 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22245 (secure 0 0 0) 0x7f02600bd7f0 con 0x7f0268106a80 2024-09-12T01:55:11.846 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:11.846 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":80,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:55:08.326279+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 msgr2=0x7f02540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 0x7f02540a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f026400cac0 tx=0x7f026400c4a0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 msgr2=0x7f026819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0260033040 tx=0x7f0260003970 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 shutdown_connections 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0268106a80 0x7f026819cc50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101420 0x7f02681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02540a2c00 0x7f02540a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 --2- 172.21.15.39:0/217099151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0268100a80 0x7f0268198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 >> 172.21.15.39:0/217099151 conn(0x7f02680fc7a0 msgr2=0x7f02680fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:11.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 shutdown_connections 2024-09-12T01:55:11.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:11.848+0000 7f026f66d640 1 -- 172.21.15.39:0/217099151 wait complete. 2024-09-12T01:55:12.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:55:12.836 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:12.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:12 smithi044 ceph-mon[35259]: pgmap v284: 97 pgs: 1 creating+activating, 17 creating+peering, 79 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-12T01:55:12.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:12 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/217099151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:12 smithi039 ceph-mon[31204]: pgmap v284: 97 pgs: 1 creating+activating, 17 creating+peering, 79 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-12T01:55:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:12 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/217099151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:12 smithi172 ceph-mon[35073]: pgmap v284: 97 pgs: 1 creating+activating, 17 creating+peering, 79 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-12T01:55:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:12 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/217099151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:55:12 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T01:55:12.907+0000 7f4776c8f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:55:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- 172.21.15.39:0/1873279427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 msgr2=0x7ff0d81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/1873279427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81067f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009900 tx=0x7ff0c002a410 comp rx=0 tx=0).stop 2024-09-12T01:55:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- 172.21.15.39:0/1873279427 shutdown_connections 2024-09-12T01:55:13.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/1873279427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8106f20 0x7ff0d810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/1873279427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81067f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/1873279427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8101df0 0x7ff0d81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- 172.21.15.39:0/1873279427 >> 172.21.15.39:0/1873279427 conn(0x7ff0d80fd8b0 msgr2=0x7ff0d80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- 172.21.15.39:0/1873279427 shutdown_connections 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- 172.21.15.39:0/1873279427 wait complete. 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 Processor -- start 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.330+0000 7ff0dea5a640 1 -- start start 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 0x7ff0d81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:13.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8106f20 0x7ff0d819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8111f80 con 0x7ff0d81027a0 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8111e00 con 0x7ff0d8106f20 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8112100 con 0x7ff0d8101df0 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46278/0 (socket says 172.21.15.39:46278) 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 -- 172.21.15.39:0/3051977384 learned_addr learned my addr 172.21.15.39:0/3051977384 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dcff7640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8106f20 0x7ff0d819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0d7fff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 0x7ff0d81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 -- 172.21.15.39:0/3051977384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 msgr2=0x7ff0d81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:13.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 0x7ff0d81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 -- 172.21.15.39:0/3051977384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8106f20 msgr2=0x7ff0d819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8106f20 0x7ff0d819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 -- 172.21.15.39:0/3051977384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d819d360 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0d7fff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 0x7ff0d81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0cffff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006010 tx=0x7ff0c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c003f030 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d819d5f0 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0c0003ce0 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.331+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0035070 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.332+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d81a4f30 con 0x7ff0d81027a0 2024-09-12T01:55:13.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.333+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d81032d0 con 0x7ff0d81027a0 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.334+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff0c0042030 con 0x7ff0d81027a0 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.334+0000 7ff0d5ffb640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 0x7ff0c40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.335+0000 7ff0d7fff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 0x7ff0c40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.335+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff0c00ef850 con 0x7ff0d81027a0 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.335+0000 7ff0d7fff640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 0x7ff0c40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005fd0 tx=0x7ff0c800b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.338+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0c00bc9c0 con 0x7ff0d81027a0 2024-09-12T01:55:13.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.551+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff0d810a160 con 0x7ff0d81027a0 2024-09-12T01:55:13.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.625+0000 7ff0d5ffb640 1 -- 172.21.15.39:0/3051977384 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7ff0c00bc2c0 con 0x7ff0d81027a0 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 msgr2=0x7ff0c40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 0x7ff0c40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005fd0 tx=0x7ff0c800b5f0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 msgr2=0x7ff0d81988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0006010 tx=0x7ff0c00042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 shutdown_connections 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8106f20 0x7ff0d819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d81027a0 0x7ff0d81988f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff0c40a2b80 0x7ff0c40a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 --2- 172.21.15.39:0/3051977384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8101df0 0x7ff0d81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:13.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 >> 172.21.15.39:0/3051977384 conn(0x7ff0d80fd8b0 msgr2=0x7ff0d80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:13.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 shutdown_connections 2024-09-12T01:55:13.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:13.627+0000 7ff0dea5a640 1 -- 172.21.15.39:0/3051977384 wait complete. 2024-09-12T01:55:13.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:13 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:55:13.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:13 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:55:14.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:13 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:55:14.253 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:55:14.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T01:55:14.511 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:14.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:14 smithi039 ceph-mon[31204]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T01:55:14.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:14 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:55:14.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:14 smithi039 ceph-mon[31204]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:14 smithi044 ceph-mon[35259]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T01:55:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:14 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:55:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:14 smithi044 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:15.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:14 smithi172 ceph-mon[35073]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T01:55:15.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:14 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3051977384' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:55:15.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:14 smithi172 ceph-mon[35073]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- 172.21.15.39:0/1380593274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501036e0 msgr2=0x7fe450107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 --2- 172.21.15.39:0/1380593274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501036e0 0x7fe450107b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe440009cd0 tx=0x7fe44002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- 172.21.15.39:0/1380593274 shutdown_connections 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 --2- 172.21.15.39:0/1380593274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501082a0 0x7fe45010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 --2- 172.21.15.39:0/1380593274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501036e0 0x7fe450107b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 --2- 172.21.15.39:0/1380593274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- 172.21.15.39:0/1380593274 >> 172.21.15.39:0/1380593274 conn(0x7fe4500fc7d0 msgr2=0x7fe4500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- 172.21.15.39:0/1380593274 shutdown_connections 2024-09-12T01:55:15.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- 172.21.15.39:0/1380593274 wait complete. 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 Processor -- start 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.025+0000 7fe45706a640 1 -- start start 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501036e0 0x7fe450198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe4501120c0 con 0x7fe4501082a0 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe450111f40 con 0x7fe450102d30 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe45706a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe450112240 con 0x7fe4501036e0 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46292/0 (socket says 172.21.15.39:46292) 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 -- 172.21.15.39:0/235912142 learned_addr learned my addr 172.21.15.39:0/235912142 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe44ffff640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501036e0 0x7fe450198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe454e06640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 -- 172.21.15.39:0/235912142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501036e0 msgr2=0x7fe450198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501036e0 0x7fe450198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 -- 172.21.15.39:0/235912142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 msgr2=0x7fe450198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 -- 172.21.15.39:0/235912142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45019d5f0 con 0x7fe4501082a0 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe454e06640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.026+0000 7fe455607640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe44800d950 tx=0x7fe44800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:15.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.027+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448017030 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.027+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45019d8e0 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.027+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe448004020 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.027+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448003c00 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.027+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4501a51c0 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.028+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe450103110 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.029+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe44801a070 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.030+0000 7fe44dffb640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 0x7fe43c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.030+0000 7fe454e06640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 0x7fe43c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.030+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe4480ce890 con 0x7fe4501082a0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.030+0000 7fe454e06640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 0x7fe43c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe438009930 tx=0x7fe438008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:15.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.034+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe448021070 con 0x7fe4501082a0 2024-09-12T01:55:15.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.246+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fe45010a2b0 con 0x7fe4501082a0 2024-09-12T01:55:15.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.635+0000 7fe44dffb640 1 -- 172.21.15.39:0/235912142 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fe44809b940 con 0x7fe4501082a0 2024-09-12T01:55:15.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 msgr2=0x7fe43c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 0x7fe43c0a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe438009930 tx=0x7fe438008040 comp rx=0 tx=0).stop 2024-09-12T01:55:15.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 msgr2=0x7fe45019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe44800d950 tx=0x7fe44800de10 comp rx=0 tx=0).stop 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 shutdown_connections 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe4501082a0 0x7fe45019cf10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe43c0a2b80 0x7fe43c0a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4501036e0 0x7fe450198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 --2- 172.21.15.39:0/235912142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe450102d30 0x7fe450198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 >> 172.21.15.39:0/235912142 conn(0x7fe4500fc7d0 msgr2=0x7fe450105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 shutdown_connections 2024-09-12T01:55:15.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:15.638+0000 7fe45706a640 1 -- 172.21.15.39:0/235912142 wait complete. 2024-09-12T01:55:15.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:15 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T01:55:15.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:15 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T01:55:16.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:15 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T01:55:16.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T01:55:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:16.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:55:16.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:55:16.904 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T01:55:16.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:55:16.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:16.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T01:55:16.905 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:16 smithi172 ceph-mon[35073]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T01:55:16.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:16 smithi039 ceph-mon[31204]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T01:55:16.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-12T01:55:16.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:55:16.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/235912142' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T01:55:16.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:55:16.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:55:16.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T01:55:16.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:16 smithi044 ceph-mon[35259]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T01:55:17.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 -- 172.21.15.39:0/1472019709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04102ef0 msgr2=0x7fea0410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 --2- 172.21.15.39:0/1472019709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04102ef0 0x7fea0410da40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009ca0 tx=0x7fe9fc02a950 comp rx=0 tx=0).stop 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 -- 172.21.15.39:0/1472019709 shutdown_connections 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 --2- 172.21.15.39:0/1472019709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04102ef0 0x7fea0410da40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 --2- 172.21.15.39:0/1472019709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 0x7fea041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 --2- 172.21.15.39:0/1472019709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04100e20 0x7fea04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 -- 172.21.15.39:0/1472019709 >> 172.21.15.39:0/1472019709 conn(0x7fea040fc7d0 msgr2=0x7fea040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 -- 172.21.15.39:0/1472019709 shutdown_connections 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.147+0000 7fea09dec640 1 -- 172.21.15.39:0/1472019709 wait complete. 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 Processor -- start 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 -- start start 2024-09-12T01:55:17.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 0x7fea040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04102ef0 0x7fea040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea04110f80 con 0x7fea04100e20 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fea04110e00 con 0x7fea04102570 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea09dec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea04111100 con 0x7fea04102ef0 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46308/0 (socket says 172.21.15.39:46308) 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.148+0000 7fea037fe640 1 -- 172.21.15.39:0/2496029315 learned_addr learned my addr 172.21.15.39:0/2496029315 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea02ffd640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 0x7fea040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea03fff640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04102ef0 0x7fea040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 -- 172.21.15.39:0/2496029315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04102ef0 msgr2=0x7fea040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04102ef0 0x7fea040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 -- 172.21.15.39:0/2496029315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 msgr2=0x7fea040fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 0x7fea040fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 -- 172.21.15.39:0/2496029315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea041a6910 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea037fe640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400d950 tx=0x7fe9f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4017030 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9f4004020 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea041a6c00 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40047a0 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.149+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea041a7190 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.150+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea04101200 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.151+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe9f40041d0 con 0x7fea04100e20 2024-09-12T01:55:17.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.152+0000 7fea00ff9640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 0x7fe9ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.152+0000 7fea02ffd640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 0x7fe9ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.152+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe9f40ce7a0 con 0x7fea04100e20 2024-09-12T01:55:17.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.153+0000 7fea02ffd640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 0x7fe9ec0a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea040fe710 tx=0x7fe9f800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:17.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.157+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9f409b850 con 0x7fea04100e20 2024-09-12T01:55:17.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.369+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fea0410a0a0 con 0x7fea04100e20 2024-09-12T01:55:17.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.663+0000 7fea00ff9640 1 -- 172.21.15.39:0/2496029315 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fe9f409b150 con 0x7fea04100e20 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.665+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 msgr2=0x7fe9ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.665+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 0x7fe9ec0a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea040fe710 tx=0x7fe9f800b390 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.665+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 msgr2=0x7fea040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.665+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400d950 tx=0x7fe9f400de10 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 shutdown_connections 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9ec0a2c00 0x7fe9ec0a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea04102ef0 0x7fea040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04102570 0x7fea040fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 --2- 172.21.15.39:0/2496029315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea04100e20 0x7fea040fcc80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 >> 172.21.15.39:0/2496029315 conn(0x7fea040fc7d0 msgr2=0x7fea0406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:17.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 shutdown_connections 2024-09-12T01:55:17.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:17.666+0000 7fea09dec640 1 -- 172.21.15.39:0/2496029315 wait complete. 2024-09-12T01:55:17.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:55:17.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:55:17.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:55:17.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: Cluster is now healthy 2024-09-12T01:55:17.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T01:55:17.910 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T01:55:17.910 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T01:55:17.910 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: Cluster is now healthy 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T01:55:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T01:55:17.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T01:55:17.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:17 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:55:18.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:55:18.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:55:18.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:55:18.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: Cluster is now healthy 2024-09-12T01:55:18.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T01:55:18.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T01:55:18.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T01:55:18.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:17 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:55:18.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T01:55:17.907+0000 7f4776c8f640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T01:55:18.173 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:55:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T01:55:17.907+0000 7f4776c8f640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T01:55:18.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T01:55:18.725 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:18.847 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:18 smithi039 ceph-mon[31204]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-12T01:55:18.847 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:18 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:55:18.847 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:55:18.848 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:18 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T01:55:18.848 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:18 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:18.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:18 smithi044 ceph-mon[35259]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-12T01:55:18.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:18 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:55:18.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:55:18.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:18 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T01:55:18.926 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:18 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:18 smithi172 ceph-mon[35073]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-12T01:55:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:18 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2496029315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:55:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:55:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:18 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T01:55:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:18 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 -- 172.21.15.39:0/350311689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102ef0 msgr2=0x7f2f4410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 --2- 172.21.15.39:0/350311689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102ef0 0x7f2f4410da40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009ca0 tx=0x7f2f3c02a950 comp rx=0 tx=0).stop 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 -- 172.21.15.39:0/350311689 shutdown_connections 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 --2- 172.21.15.39:0/350311689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102ef0 0x7f2f4410da40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 --2- 172.21.15.39:0/350311689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102570 0x7f2f441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 --2- 172.21.15.39:0/350311689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 0x7f2f44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 -- 172.21.15.39:0/350311689 >> 172.21.15.39:0/350311689 conn(0x7f2f440fc7d0 msgr2=0x7f2f440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 -- 172.21.15.39:0/350311689 shutdown_connections 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.188+0000 7f2f488d9640 1 -- 172.21.15.39:0/350311689 wait complete. 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 Processor -- start 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 -- start start 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 0x7f2f441972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102ef0 0x7f2f4419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44110f80 con 0x7f2f44102570 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44110e00 con 0x7f2f44102ef0 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f488d9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44111100 con 0x7f2f44100e20 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f41d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:19.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f41d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46318/0 (socket says 172.21.15.39:46318) 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f41d9b640 1 -- 172.21.15.39:0/3988960903 learned_addr learned my addr 172.21.15.39:0/3988960903 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f42d9d640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102ef0 0x7f2f4419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.189+0000 7f2f4259c640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 0x7f2f441972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 -- 172.21.15.39:0/3988960903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 msgr2=0x7f2f441972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 0x7f2f441972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 -- 172.21.15.39:0/3988960903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102ef0 msgr2=0x7f2f4419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102ef0 0x7f2f4419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 -- 172.21.15.39:0/3988960903 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4419c250 con 0x7f2f44102570 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f41d9b640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c920 tx=0x7f2f2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c007c70 con 0x7f2f44102570 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2c007e10 con 0x7f2f44102570 2024-09-12T01:55:19.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4419c540 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c018890 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.190+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f441a3e20 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.191+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f44101200 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.193+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2f2c018a50 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.194+0000 7f2f3b7fe640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 0x7f2f300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.194+0000 7f2f4259c640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 0x7f2f300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.194+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2f2c0cf220 con 0x7f2f44102570 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.195+0000 7f2f4259c640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 0x7f2f300a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f340058c0 tx=0x7f2f3400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:19.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.197+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f2c014030 con 0x7f2f44102570 2024-09-12T01:55:19.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.409+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f2f441a4020 con 0x7f2f44102570 2024-09-12T01:55:19.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.674+0000 7f2f3b7fe640 1 -- 172.21.15.39:0/3988960903 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f2f2c09c360 con 0x7f2f44102570 2024-09-12T01:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 msgr2=0x7f2f300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 0x7f2f300a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f340058c0 tx=0x7f2f3400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 msgr2=0x7f2f441977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00c920 tx=0x7f2f2c00cde0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 shutdown_connections 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f44102ef0 0x7f2f4419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f44102570 0x7f2f441977e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2f300a2b80 0x7f2f300a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 --2- 172.21.15.39:0/3988960903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f44100e20 0x7f2f441972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 >> 172.21.15.39:0/3988960903 conn(0x7f2f440fc7d0 msgr2=0x7f2f441067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 shutdown_connections 2024-09-12T01:55:19.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:19.677+0000 7f2f488d9640 1 -- 172.21.15.39:0/3988960903 wait complete. 2024-09-12T01:55:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:19 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:55:20.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:19 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:55:20.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:19 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:55:20.498 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T01:55:20.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T01:55:20.755 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:20.876 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:20 smithi039 ceph-mon[31204]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 576 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-12T01:55:20.876 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:20 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:55:20.876 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:20 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:20 smithi172 ceph-mon[35073]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 576 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-12T01:55:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:20 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:55:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:20 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:20 smithi044 ceph-mon[35259]: pgmap v288: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 576 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-12T01:55:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:20 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3988960903' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:55:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:20 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:55:21.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3919793552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc100e20 msgr2=0x7f4ecc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:21.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3919793552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc100e20 0x7f4ecc101200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009900 tx=0x7f4ebc02a480 comp rx=0 tx=0).stop 2024-09-12T01:55:21.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3919793552 shutdown_connections 2024-09-12T01:55:21.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3919793552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3919793552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 0x7f4ecc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3919793552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc100e20 0x7f4ecc101200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3919793552 >> 172.21.15.39:0/3919793552 conn(0x7f4ecc0fc7d0 msgr2=0x7f4ecc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3919793552 shutdown_connections 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.265+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3919793552 wait complete. 2024-09-12T01:55:21.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 Processor -- start 2024-09-12T01:55:21.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 -- start start 2024-09-12T01:55:21.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc100e20 0x7f4ecc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:21.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 0x7f4ecc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:21.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:21.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc110f80 con 0x7f4ecc102ef0 2024-09-12T01:55:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc110e00 con 0x7f4ecc102570 2024-09-12T01:55:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed24f6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc111100 con 0x7f4ecc100e20 2024-09-12T01:55:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.266+0000 7f4ed0a93640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46346/0 (socket says 172.21.15.39:46346) 2024-09-12T01:55:21.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ec3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 0x7f4ecc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 -- 172.21.15.39:0/3762673005 learned_addr learned my addr 172.21.15.39:0/3762673005 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ecbfff640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc100e20 0x7f4ecc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 -- 172.21.15.39:0/3762673005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc100e20 msgr2=0x7f4ecc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc100e20 0x7f4ecc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 -- 172.21.15.39:0/3762673005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 msgr2=0x7f4ecc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:21.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 0x7f4ecc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 -- 172.21.15.39:0/3762673005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc1a6a40 con 0x7f4ecc102ef0 2024-09-12T01:55:21.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed0a93640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400cad0 tx=0x7f4ec400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:21.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400ae20 con 0x7f4ecc102ef0 2024-09-12T01:55:21.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc1a6d30 con 0x7f4ecc102ef0 2024-09-12T01:55:21.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ec4005020 con 0x7f4ecc102ef0 2024-09-12T01:55:21.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400f6b0 con 0x7f4ecc102ef0 2024-09-12T01:55:21.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.267+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc1a7270 con 0x7f4ecc102ef0 2024-09-12T01:55:21.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.268+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc101200 con 0x7f4ecc102ef0 2024-09-12T01:55:21.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.269+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4ec40051d0 con 0x7f4ecc102ef0 2024-09-12T01:55:21.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.270+0000 7f4ec9ffb640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 0x7f4eb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.270+0000 7f4ecbfff640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 0x7f4eb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.270+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4ec40cf1d0 con 0x7f4ecc102ef0 2024-09-12T01:55:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.270+0000 7f4ecbfff640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 0x7f4eb80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005ab0 tx=0x7f4ebc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:21.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.274+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ec4014030 con 0x7f4ecc102ef0 2024-09-12T01:55:21.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.472+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4ecc062630 con 0x7f4eb80a2b80 2024-09-12T01:55:21.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.496+0000 7f4ec9ffb640 1 -- 172.21.15.39:0/3762673005 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ecc062630 con 0x7f4eb80a2b80 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 msgr2=0x7f4eb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 0x7f4eb80a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc005ab0 tx=0x7f4ebc005a20 comp rx=0 tx=0).stop 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 msgr2=0x7f4ecc0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400cad0 tx=0x7f4ec400cf90 comp rx=0 tx=0).stop 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 shutdown_connections 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ecc102ef0 0x7f4ecc0fd700 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc102570 0x7f4ecc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4eb80a2b80 0x7f4eb80a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 --2- 172.21.15.39:0/3762673005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ecc100e20 0x7f4ecc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.498+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 >> 172.21.15.39:0/3762673005 conn(0x7f4ecc0fc7d0 msgr2=0x7f4ecc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.499+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 shutdown_connections 2024-09-12T01:55:21.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:21.499+0000 7f4ed24f6640 1 -- 172.21.15.39:0/3762673005 wait complete. 2024-09-12T01:55:21.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:55:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:55:21.477+0000 7f84ed90c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:55:21.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:55:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:55:21.477+0000 7f84ed90c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:55:21.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:55:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:55:21.477+0000 7f84ed90c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:55:21.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:55:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:55:21.477+0000 7f84ed90c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:55:21.911 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 01:55:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x[31428]: 2024-09-12T01:55:21.477+0000 7f84ed90c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:55:22.216 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T01:55:22.473 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:22.890 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:22 smithi039 ceph-mon[31204]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T01:55:22.890 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:22 smithi039 ceph-mon[31204]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:22 smithi172 ceph-mon[35073]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T01:55:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:22 smithi172 ceph-mon[35073]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 -- 172.21.15.39:0/532511666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 msgr2=0x7fee881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/532511666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee881067e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009900 tx=0x7fee7c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 -- 172.21.15.39:0/532511666 shutdown_connections 2024-09-12T01:55:23.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/532511666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88106f10 0x7fee8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/532511666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee881067e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/532511666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee88101de0 0x7fee881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 -- 172.21.15.39:0/532511666 >> 172.21.15.39:0/532511666 conn(0x7fee880fd8c0 msgr2=0x7fee880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 -- 172.21.15.39:0/532511666 shutdown_connections 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.977+0000 7fee8cfc8640 1 -- 172.21.15.39:0/532511666 wait complete. 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 Processor -- start 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 -- start start 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 0x7fee881983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee88106f10 0x7fee8819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fee88111f70 con 0x7fee88102790 2024-09-12T01:55:23.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee88111df0 con 0x7fee88101de0 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8cfc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee881120f0 con 0x7fee88106f10 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee85d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee85d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38924/0 (socket says 172.21.15.39:38924) 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee85d9b640 1 -- 172.21.15.39:0/255630625 learned_addr learned my addr 172.21.15.39:0/255630625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.978+0000 7fee8659c640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 0x7fee881983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 -- 172.21.15.39:0/255630625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee88106f10 msgr2=0x7fee8819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee88106f10 0x7fee8819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 -- 172.21.15.39:0/255630625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 msgr2=0x7fee881983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 0x7fee881983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 -- 172.21.15.39:0/255630625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8819d370 con 0x7fee88102790 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee8659c640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 0x7fee881983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:23.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee85d9b640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005ab0 tx=0x7fee7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c03f030 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee7c003ce0 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8819d600 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c035070 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.979+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee881a4f40 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.980+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee881021c0 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.981+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fee7c042030 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.982+0000 7fee777fe640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 0x7fee700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.982+0000 7fee8659c640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 0x7fee700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.982+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fee7c0ef830 con 0x7fee88102790 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.982+0000 7fee8659c640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 0x7fee700a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee7800abe0 tx=0x7fee7800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:23.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:22.986+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee7c0bc8e0 con 0x7fee88102790 2024-09-12T01:55:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:22 smithi044 ceph-mon[35259]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-12T01:55:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:22 smithi044 ceph-mon[35259]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.188+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fee88062630 con 0x7fee700a2c00 2024-09-12T01:55:23.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.212+0000 7fee777fe640 1 -- 172.21.15.39:0/255630625 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fee88062630 con 0x7fee700a2c00 2024-09-12T01:55:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 msgr2=0x7fee700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 0x7fee700a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee7800abe0 tx=0x7fee7800a5c0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 msgr2=0x7fee88198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005ab0 tx=0x7fee7c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 shutdown_connections 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fee700a2c00 0x7fee700a50c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee88106f10 0x7fee8819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fee88102790 0x7fee88198900 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 --2- 172.21.15.39:0/255630625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee88101de0 0x7fee881983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.214+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 >> 172.21.15.39:0/255630625 conn(0x7fee880fd8c0 msgr2=0x7fee880febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:23.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.215+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 shutdown_connections 2024-09-12T01:55:23.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:23.215+0000 7fee8cfc8640 1 -- 172.21.15.39:0/255630625 wait complete. 2024-09-12T01:55:24.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T01:55:24.281 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 -- 172.21.15.39:0/3955465103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc10c170 msgr2=0x7f91bc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 --2- 172.21.15.39:0/3955465103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc10c170 0x7f91bc10e610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009ca0 tx=0x7f91b402a950 comp rx=0 tx=0).stop 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 -- 172.21.15.39:0/3955465103 shutdown_connections 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 --2- 172.21.15.39:0/3955465103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc10c170 0x7f91bc10e610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 --2- 172.21.15.39:0/3955465103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc103660 0x7f91bc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 --2- 172.21.15.39:0/3955465103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 0x7f91bc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 -- 172.21.15.39:0/3955465103 >> 172.21.15.39:0/3955465103 conn(0x7f91bc0fc7a0 msgr2=0x7f91bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 -- 172.21.15.39:0/3955465103 shutdown_connections 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.807+0000 7f91c1f25640 1 -- 172.21.15.39:0/3955465103 wait complete. 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 Processor -- start 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 -- start start 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 0x7f91bc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 0x7f91bc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc111fd0 con 0x7f91bc103660 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc111e50 con 0x7f91bc10c170 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91c1f25640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc112150 con 0x7f91bc102d40 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38952/0 (socket says 172.21.15.39:38952) 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 -- 172.21.15.39:0/2779462395 learned_addr learned my addr 172.21.15.39:0/2779462395 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91bb7fe640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 0x7f91bc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91bbfff640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 0x7f91bc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 -- 172.21.15.39:0/2779462395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 msgr2=0x7f91bc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 0x7f91bc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 -- 172.21.15.39:0/2779462395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 msgr2=0x7f91bc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 0x7f91bc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91baffd640 1 -- 172.21.15.39:0/2779462395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc19d440 con 0x7f91bc103660 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.808+0000 7f91bbfff640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 0x7f91bc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91baffd640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b3f0 tx=0x7f91b000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0015020 con 0x7f91bc103660 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc19d730 con 0x7f91bc103660 2024-09-12T01:55:24.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91b0011d10 con 0x7f91bc103660 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b000f2e0 con 0x7f91bc103660 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.809+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1a5010 con 0x7f91bc103660 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.810+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc103120 con 0x7f91bc103660 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.811+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f91b0018020 con 0x7f91bc103660 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.812+0000 7f91b8ff9640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 0x7f91a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.812+0000 7f91bb7fe640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 0x7f91a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:24.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.812+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f91b00ce770 con 0x7f91bc103660 2024-09-12T01:55:24.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.812+0000 7f91bb7fe640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 0x7f91a40a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91ac005fd0 tx=0x7f91ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:24.816+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91b001f020 con 0x7f91bc103660 2024-09-12T01:55:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:24 smithi172 ceph-mon[35073]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:24 smithi172 ceph-mon[35073]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T01:55:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:24 smithi172 ceph-mon[35073]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:55:25.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.018+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f91bc0fe480 con 0x7f91a40a2c10 2024-09-12T01:55:25.018 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:24 smithi039 ceph-mon[31204]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:25.018 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:24 smithi039 ceph-mon[31204]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T01:55:25.018 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:24 smithi039 ceph-mon[31204]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:55:25.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.022+0000 7f91b8ff9640 1 -- 172.21.15.39:0/2779462395 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f91bc0fe480 con 0x7f91a40a2c10 2024-09-12T01:55:25.022 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_0/1b5ac0eb-3f82-4add-9dde-f59c4da2791c 2024-09-12T01:55:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 msgr2=0x7f91a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 0x7f91a40a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91ac005fd0 tx=0x7f91ac00b390 comp rx=0 tx=0).stop 2024-09-12T01:55:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 msgr2=0x7f91bc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91b000b3f0 tx=0x7f91b000b8b0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 shutdown_connections 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91bc10c170 0x7f91bc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91bc103660 0x7f91bc1989d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f91a40a2c10 0x7f91a40a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 --2- 172.21.15.39:0/2779462395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91bc102d40 0x7f91bc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.024+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 >> 172.21.15.39:0/2779462395 conn(0x7f91bc0fc7a0 msgr2=0x7f91bc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.025+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 shutdown_connections 2024-09-12T01:55:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:25.025+0000 7f91c1f25640 1 -- 172.21.15.39:0/2779462395 wait complete. 2024-09-12T01:55:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:24 smithi044 ceph-mon[35259]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:24 smithi044 ceph-mon[35259]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-12T01:55:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:24 smithi044 ceph-mon[35259]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T01:55:25.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T01:55:25.944 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 -- 172.21.15.39:0/2029818213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 msgr2=0x7f8f4c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 --2- 172.21.15.39:0/2029818213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c10df40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009900 tx=0x7f8f3c02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 -- 172.21.15.39:0/2029818213 shutdown_connections 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 --2- 172.21.15.39:0/2029818213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c10e480 0x7f8f4c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 --2- 172.21.15.39:0/2029818213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c10df40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 --2- 172.21.15.39:0/2029818213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c1008d0 0x7f8f4c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 -- 172.21.15.39:0/2029818213 >> 172.21.15.39:0/2029818213 conn(0x7f8f4c0fc7a0 msgr2=0x7f8f4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 -- 172.21.15.39:0/2029818213 shutdown_connections 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.447+0000 7f8f54255640 1 -- 172.21.15.39:0/2029818213 wait complete. 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.448+0000 7f8f54255640 1 Processor -- start 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.448+0000 7f8f54255640 1 -- start start 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c1008d0 0x7f8f4c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c10e480 0x7f8f4c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c114190 con 0x7f8f4c101280 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c114010 con 0x7f8f4c1008d0 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c114310 con 0x7f8f4c10e480 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38966/0 (socket says 172.21.15.39:38966) 2024-09-12T01:55:26.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 -- 172.21.15.39:0/2786531080 learned_addr learned my addr 172.21.15.39:0/2786531080 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f51ff1640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c1008d0 0x7f8f4c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f527f2640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c10e480 0x7f8f4c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 -- 172.21.15.39:0/2786531080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c10e480 msgr2=0x7f8f4c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c10e480 0x7f8f4c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 -- 172.21.15.39:0/2786531080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c1008d0 msgr2=0x7f8f4c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c1008d0 0x7f8f4c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 -- 172.21.15.39:0/2786531080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c19f6a0 con 0x7f8f4c101280 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f517f0640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c006010 tx=0x7f8f3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c03f030 con 0x7f8f4c101280 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f3c003ce0 con 0x7f8f4c101280 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c19f930 con 0x7f8f4c101280 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c035070 con 0x7f8f4c101280 2024-09-12T01:55:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.449+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c1a7270 con 0x7f8f4c101280 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.450+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c06b070 con 0x7f8f4c101280 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.452+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8f3c042030 con 0x7f8f4c101280 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.452+0000 7f8f42ffd640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 0x7f8f380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.452+0000 7f8f51ff1640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 0x7f8f380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.452+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8f3c0ef8d0 con 0x7f8f4c101280 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.453+0000 7f8f51ff1640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 0x7f8f380a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005fd0 tx=0x7f8f48009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.456+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f3c0bc2f0 con 0x7f8f4c101280 2024-09-12T01:55:26.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.658+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8f4c062630 con 0x7f8f380a2c10 2024-09-12T01:55:26.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.683+0000 7f8f42ffd640 1 -- 172.21.15.39:0/2786531080 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f4c062630 con 0x7f8f380a2c10 2024-09-12T01:55:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 msgr2=0x7f8f380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 0x7f8f380a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005fd0 tx=0x7f8f48009680 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 msgr2=0x7f8f4c19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c006010 tx=0x7f8f3c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 shutdown_connections 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8f380a2c10 0x7f8f380a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f4c10e480 0x7f8f4c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8f4c101280 0x7f8f4c19ac30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 --2- 172.21.15.39:0/2786531080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c1008d0 0x7f8f4c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 >> 172.21.15.39:0/2786531080 conn(0x7f8f4c0fc7a0 msgr2=0x7f8f4c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.685+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 shutdown_connections 2024-09-12T01:55:26.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:26.686+0000 7f8f54255640 1 -- 172.21.15.39:0/2786531080 wait complete. 2024-09-12T01:55:26.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:26 smithi039 ceph-mon[31204]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:26.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:26 smithi039 ceph-mon[31204]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T01:55:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:26 smithi172 ceph-mon[35073]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:26 smithi172 ceph-mon[35073]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T01:55:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:26 smithi044 ceph-mon[35259]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:26 smithi044 ceph-mon[35259]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.6 KiB/s wr, 13 op/s 2024-09-12T01:55:27.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T01:55:27.611 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:27.999 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:27 smithi039 ceph-mon[31204]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:27 smithi172 ceph-mon[35073]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:28.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:27 smithi044 ceph-mon[35259]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:28.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 -- 172.21.15.39:0/997522532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 msgr2=0x7f5ffc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 --2- 172.21.15.39:0/997522532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc10ea90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009ca0 tx=0x7f5ff402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 -- 172.21.15.39:0/997522532 shutdown_connections 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 --2- 172.21.15.39:0/997522532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc10ea90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 --2- 172.21.15.39:0/997522532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc102790 0x7f5ffc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 --2- 172.21.15.39:0/997522532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc101de0 0x7f5ffc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 -- 172.21.15.39:0/997522532 >> 172.21.15.39:0/997522532 conn(0x7f5ffc0fd8c0 msgr2=0x7f5ffc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 -- 172.21.15.39:0/997522532 shutdown_connections 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.088+0000 7f60021ae640 1 -- 172.21.15.39:0/997522532 wait complete. 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 Processor -- start 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 -- start start 2024-09-12T01:55:28.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc101de0 0x7f5ffc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 0x7f5ffc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc111f70 con 0x7f5ffc106f10 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc111df0 con 0x7f5ffc102790 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.089+0000 7f60021ae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1120f0 con 0x7f5ffc101de0 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38988/0 (socket says 172.21.15.39:38988) 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 -- 172.21.15.39:0/1310374839 learned_addr learned my addr 172.21.15.39:0/1310374839 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffb7fe640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc101de0 0x7f5ffc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffaffd640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 0x7f5ffc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 -- 172.21.15.39:0/1310374839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc101de0 msgr2=0x7f5ffc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc101de0 0x7f5ffc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 -- 172.21.15.39:0/1310374839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 msgr2=0x7f5ffc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 0x7f5ffc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 -- 172.21.15.39:0/1310374839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc19f590 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffaffd640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 0x7f5ffc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ffbfff640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4031a20 tx=0x7f5ff4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4003c30 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff4003dd0 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc19f820 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff402fcf0 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.090+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc1a7160 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.091+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ffc1021c0 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.093+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5ff4004050 con 0x7f5ffc106f10 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.094+0000 7f5ff8ff9640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 0x7f5fe40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.094+0000 7f5ffb7fe640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 0x7f5fe40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.094+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5ff40f0420 con 0x7f5ffc106f10 2024-09-12T01:55:28.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.094+0000 7f5ffb7fe640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 0x7f5fe40a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00bbe0 tx=0x7f5fec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:28.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.098+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ff40bd570 con 0x7f5ffc106f10 2024-09-12T01:55:28.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.303+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5ffc0febc0 con 0x7f5fe40a2c10 2024-09-12T01:55:28.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.308+0000 7f5ff8ff9640 1 -- 172.21.15.39:0/1310374839 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5ffc0febc0 con 0x7f5fe40a2c10 2024-09-12T01:55:28.308 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 msgr2=0x7f5fe40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 0x7f5fe40a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00bbe0 tx=0x7f5fec00b390 comp rx=0 tx=0).stop 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 msgr2=0x7f5ffc19eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4031a20 tx=0x7f5ff4031a50 comp rx=0 tx=0).stop 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 shutdown_connections 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ffc106f10 0x7f5ffc19eeb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ffc102790 0x7f5ffc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5fe40a2c10 0x7f5fe40a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 --2- 172.21.15.39:0/1310374839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ffc101de0 0x7f5ffc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 >> 172.21.15.39:0/1310374839 conn(0x7f5ffc0fd8c0 msgr2=0x7f5ffc0ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:28.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 shutdown_connections 2024-09-12T01:55:28.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:28.310+0000 7f60021ae640 1 -- 172.21.15.39:0/1310374839 wait complete. 2024-09-12T01:55:29.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:28 smithi039 ceph-mon[31204]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-12T01:55:29.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:28 smithi172 ceph-mon[35073]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-12T01:55:29.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:28 smithi044 ceph-mon[35259]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-12T01:55:29.287 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:29.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 -- 172.21.15.39:0/1590025601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28102d40 msgr2=0x7fed28103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 --2- 172.21.15.39:0/1590025601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28102d40 0x7fed28103120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed24009900 tx=0x7fed2402a480 comp rx=0 tx=0).stop 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 -- 172.21.15.39:0/1590025601 shutdown_connections 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 --2- 172.21.15.39:0/1590025601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2810c170 0x7fed2810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 --2- 172.21.15.39:0/1590025601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed28103660 0x7fed2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 --2- 172.21.15.39:0/1590025601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28102d40 0x7fed28103120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 -- 172.21.15.39:0/1590025601 >> 172.21.15.39:0/1590025601 conn(0x7fed280fc7a0 msgr2=0x7fed280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 -- 172.21.15.39:0/1590025601 shutdown_connections 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.788+0000 7fed306a1640 1 -- 172.21.15.39:0/1590025601 wait complete. 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 Processor -- start 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 -- start start 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed28102d40 0x7fed281983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2810c170 0x7fed2819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fed28111f70 con 0x7fed28103660 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed28111df0 con 0x7fed2810c170 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed306a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed281120f0 con 0x7fed28102d40 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.789+0000 7fed2dc3c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39006/0 (socket says 172.21.15.39:39006) 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 -- 172.21.15.39:0/2213509549 learned_addr learned my addr 172.21.15.39:0/2213509549 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2ec3e640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2810c170 0x7fed2819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2e43d640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed28102d40 0x7fed281983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 -- 172.21.15.39:0/2213509549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed28102d40 msgr2=0x7fed281983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed28102d40 0x7fed281983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 -- 172.21.15.39:0/2213509549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2810c170 msgr2=0x7fed2819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2810c170 0x7fed2819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 -- 172.21.15.39:0/2213509549 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2819d390 con 0x7fed28103660 2024-09-12T01:55:29.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed2dc3c640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c940 tx=0x7fed1800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004220 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed180043c0 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2819d680 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18004a00 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.790+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed281a4f60 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.791+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed28103120 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.793+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fed180079b0 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.793+0000 7fed1f7fe640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 0x7fed140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.793+0000 7fed2e43d640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 0x7fed140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.793+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fed180ceec0 con 0x7fed28103660 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.794+0000 7fed2e43d640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 0x7fed140a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed24000c00 tx=0x7fed240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:29.797+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed18014030 con 0x7fed28103660 2024-09-12T01:55:30.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:29 smithi172 ceph-mon[35073]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:30.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.006+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed28106c80 con 0x7fed28103660 2024-09-12T01:55:30.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:29 smithi039 ceph-mon[31204]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:30.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.007+0000 7fed1f7fe640 1 -- 172.21.15.39:0/2213509549 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7fed1809b8a0 con 0x7fed28103660 2024-09-12T01:55:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:30.007 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:55:30.007 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:55:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 msgr2=0x7fed140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 0x7fed140a5150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed24000c00 tx=0x7fed240058d0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.009 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 msgr2=0x7fed28198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c940 tx=0x7fed1800ce00 comp rx=0 tx=0).stop 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 shutdown_connections 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2810c170 0x7fed2819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fed28103660 0x7fed28198920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fed140a2c90 0x7fed140a5150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 --2- 172.21.15.39:0/2213509549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed28102d40 0x7fed281983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.009+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 >> 172.21.15.39:0/2213509549 conn(0x7fed280fc7a0 msgr2=0x7fed280fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.010+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 shutdown_connections 2024-09-12T01:55:30.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:30.010+0000 7fed306a1640 1 -- 172.21.15.39:0/2213509549 wait complete. 2024-09-12T01:55:30.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:29 smithi044 ceph-mon[35259]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:55:30.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:31.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:30 smithi172 ceph-mon[35073]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-12T01:55:31.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:30 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2213509549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:31.072 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:30 smithi039 ceph-mon[31204]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-12T01:55:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:30 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2213509549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:31.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:30 smithi044 ceph-mon[35259]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-09-12T01:55:31.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:30 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2213509549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 -- 172.21.15.39:0/4223299096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 msgr2=0x7f4e98101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/4223299096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e98101200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009900 tx=0x7f4e9002a480 comp rx=0 tx=0).stop 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 -- 172.21.15.39:0/4223299096 shutdown_connections 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/4223299096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102ef0 0x7f4e9810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/4223299096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102570 0x7f4e981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/4223299096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e98101200 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.546+0000 7f4e9fe45640 1 -- 172.21.15.39:0/4223299096 >> 172.21.15.39:0/4223299096 conn(0x7f4e980fc7d0 msgr2=0x7f4e980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- 172.21.15.39:0/4223299096 shutdown_connections 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- 172.21.15.39:0/4223299096 wait complete. 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 Processor -- start 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- start start 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102570 0x7f4e981998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 0x7f4e981a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4e98110f80 con 0x7f4e98100e20 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e98110e00 con 0x7f4e98102570 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.547+0000 7f4e9fe45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e98111100 con 0x7f4e98102ef0 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9dbe1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9dbe1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39024/0 (socket says 172.21.15.39:39024) 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9dbe1640 1 -- 172.21.15.39:0/2440940033 learned_addr learned my addr 172.21.15.39:0/2440940033 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:31.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 0x7f4e981a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9d3e0640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102570 0x7f4e981998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 -- 172.21.15.39:0/2440940033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102570 msgr2=0x7f4e981998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102570 0x7f4e981998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 -- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 msgr2=0x7f4e981993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9e3e2640 1 -- 172.21.15.39:0/2440940033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e981a4970 con 0x7f4e98102ef0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.548+0000 7f4e9dbe1640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e9e3e2640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 0x7f4e981a4430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800da10 tx=0x7f4e8800ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88018070 con 0x7f4e98102ef0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e981971a0 con 0x7f4e98102ef0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e88016070 con 0x7f4e98102ef0 2024-09-12T01:55:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88004030 con 0x7f4e98102ef0 2024-09-12T01:55:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.549+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e98197690 con 0x7f4e98102ef0 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.550+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e98101200 con 0x7f4e98102ef0 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.551+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4e88004b40 con 0x7f4e98102ef0 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.552+0000 7f4e96ffd640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 0x7f4e800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.552+0000 7f4e9dbe1640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 0x7f4e800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.552+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4e880d2e00 con 0x7f4e98102ef0 2024-09-12T01:55:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.552+0000 7f4e9dbe1640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 0x7f4e800a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e900314e0 tx=0x7f4e900095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.555+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e8809fe50 con 0x7f4e98102ef0 2024-09-12T01:55:31.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.738+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e98109090 con 0x7f4e98102ef0 2024-09-12T01:55:31.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.739+0000 7f4e96ffd640 1 -- 172.21.15.39:0/2440940033 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22245 (secure 0 0 0) 0x7f4e8809f750 con 0x7f4e98102ef0 2024-09-12T01:55:31.739 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:31.740 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":80,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:55:08.326279+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 msgr2=0x7f4e800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 0x7f4e800a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e900314e0 tx=0x7f4e900095f0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 msgr2=0x7f4e981a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 0x7f4e981a4430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800da10 tx=0x7f4e8800ded0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 shutdown_connections 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e800a2c10 0x7f4e800a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e98102ef0 0x7f4e981a4430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e98102570 0x7f4e981998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 --2- 172.21.15.39:0/2440940033 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e98100e20 0x7f4e981993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.741+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 >> 172.21.15.39:0/2440940033 conn(0x7f4e980fc7d0 msgr2=0x7f4e980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.742+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 shutdown_connections 2024-09-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:31.742+0000 7f4e9fe45640 1 -- 172.21.15.39:0/2440940033 wait complete. 2024-09-12T01:55:32.558 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:55:32.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:55:32.821 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:32.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:32 smithi039 ceph-mon[31204]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-12T01:55:32.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:32 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2440940033' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:33.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:32 smithi172 ceph-mon[35073]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-12T01:55:33.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:32 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2440940033' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:33.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:32 smithi044 ceph-mon[35259]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-12T01:55:33.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:32 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2440940033' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:33.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 -- 172.21.15.39:0/866852245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 msgr2=0x7f85d410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 --2- 172.21.15.39:0/866852245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d410d950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009cd0 tx=0x7f85cc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 -- 172.21.15.39:0/866852245 shutdown_connections 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 --2- 172.21.15.39:0/866852245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d410d950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 --2- 172.21.15.39:0/866852245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 0x7f85d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 --2- 172.21.15.39:0/866852245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 0x7f85d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 -- 172.21.15.39:0/866852245 >> 172.21.15.39:0/866852245 conn(0x7f85d40fc7a0 msgr2=0x7f85d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 -- 172.21.15.39:0/866852245 shutdown_connections 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.338+0000 7f85dba40640 1 -- 172.21.15.39:0/866852245 wait complete. 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 Processor -- start 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 -- start start 2024-09-12T01:55:33.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 0x7f85d419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 0x7f85d419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4110f20 con 0x7f85d4101420 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4110da0 con 0x7f85d4100a80 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85dba40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41110a0 con 0x7f85d4106a80 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.339+0000 7f85d8fdb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52704/0 (socket says 172.21.15.39:52704) 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 -- 172.21.15.39:0/3413372921 learned_addr learned my addr 172.21.15.39:0/3413372921 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d9fdd640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 0x7f85d419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d97dc640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 0x7f85d419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 -- 172.21.15.39:0/3413372921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 msgr2=0x7f85d419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 0x7f85d419f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 -- 172.21.15.39:0/3413372921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 msgr2=0x7f85d419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 0x7f85d419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 -- 172.21.15.39:0/3413372921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d419f6f0 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85d8fdb640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85c400b4a0 tx=0x7f85c400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4015020 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85c4011d10 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d419f9e0 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c400f2e0 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.340+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41a72c0 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.341+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d4100f60 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.342+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f85c4018020 con 0x7f85d4101420 2024-09-12T01:55:33.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.343+0000 7f85ca7fc640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 0x7f85c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.343+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f85c40ce760 con 0x7f85d4101420 2024-09-12T01:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.343+0000 7f85d97dc640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 0x7f85c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.344+0000 7f85d97dc640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 0x7f85c00a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f85d0009990 tx=0x7f85d0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.347+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85c401f020 con 0x7f85d4101420 2024-09-12T01:55:33.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.519+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85d406afa0 con 0x7f85c00a2c10 2024-09-12T01:55:33.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.527+0000 7f85ca7fc640 1 -- 172.21.15.39:0/3413372921 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258861 (secure 0 0 0) 0x7f85d406afa0 con 0x7f85c00a2c10 2024-09-12T01:55:33.531 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:33.532 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 msgr2=0x7f85c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 0x7f85c00a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f85d0009990 tx=0x7f85d0009110 comp rx=0 tx=0).stop 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 msgr2=0x7f85d419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85c400b4a0 tx=0x7f85c400b8a0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 shutdown_connections 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f85c00a2c10 0x7f85c00a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4106a80 0x7f85d419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85d4101420 0x7f85d419ac80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 --2- 172.21.15.39:0/3413372921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d4100a80 0x7f85d419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 >> 172.21.15.39:0/3413372921 conn(0x7f85d40fc7a0 msgr2=0x7f85d406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 shutdown_connections 2024-09-12T01:55:33.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:33.530+0000 7f85dba40640 1 -- 172.21.15.39:0/3413372921 wait complete. 2024-09-12T01:55:34.430 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-12T01:55:33.243139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641407,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":332,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359964,"kb_used_data":10716,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581860,"statfs":{"total":1151940427776,"available":1151571824640,"internally_reserved":0,"allocated":10973184,"data_stored":6975919,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45907,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":74,"num_read_kb":86,"num_write":34,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589295+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:55:08.589295+0000","last_peered":"2024-09-12T01:55:08.589295+0000","last_clean":"2024-09-12T01:55:08.589295+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:55:08.589295+0000","last_undegraded":"2024-09-12T01:55:08.589295+0000","last_fullsized":"2024-09-12T01:55:08.589295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597995+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:55:08.597995+0000","last_peered":"2024-09-12T01:55:08.597995+0000","last_clean":"2024-09-12T01:55:08.597995+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:55:08.597995+0000","last_undegraded":"2024-09-12T01:55:08.597995+0000","last_fullsized":"2024-09-12T01:55:08.597995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597682+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:55:08.597682+0000","last_peered":"2024-09-12T01:55:08.597682+0000","last_clean":"2024-09-12T01:55:08.597682+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:55:08.597682+0000","last_undegraded":"2024-09-12T01:55:08.597682+0000","last_fullsized":"2024-09-12T01:55:08.597682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596059+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:55:08.596059+0000","last_peered":"2024-09-12T01:55:08.596059+0000","last_clean":"2024-09-12T01:55:08.596059+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:55:08.596059+0000","last_undegraded":"2024-09-12T01:55:08.596059+0000","last_fullsized":"2024-09-12T01:55:08.596059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596652+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:55:08.596652+0000","last_peered":"2024-09-12T01:55:08.596652+0000","last_clean":"2024-09-12T01:55:08.596652+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:55:08.596652+0000","last_undegraded":"2024-09-12T01:55:08.596652+0000","last_fullsized":"2024-09-12T01:55:08.596652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589373+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:55:08.589373+0000","last_peered":"2024-09-12T01:55:08.589373+0000","last_clean":"2024-09-12T01:55:08.589373+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:55:08.589373+0000","last_undegraded":"2024-09-12T01:55:08.589373+0000","last_fullsized":"2024-09-12T01:55:08.589373+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599859+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:55:08.599859+0000","last_peered":"2024-09-12T01:55:08.599859+0000","last_clean":"2024-09-12T01:55:08.599859+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:55:08.599859+0000","last_undegraded":"2024-09-12T01:55:08.599859+0000","last_fullsized":"2024-09-12T01:55:08.599859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591778+0000","last_change":"2024-09-12T01:55:07.611371+0000","last_active":"2024-09-12T01:55:08.591778+0000","last_peered":"2024-09-12T01:55:08.591778+0000","last_clean":"2024-09-12T01:55:08.591778+0000","last_became_active":"2024-09-12T01:55:07.609457+0000","last_became_peered":"2024-09-12T01:55:07.609457+0000","last_unstale":"2024-09-12T01:55:08.591778+0000","last_undegraded":"2024-09-12T01:55:08.591778+0000","last_fullsized":"2024-09-12T01:55:08.591778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:10.253485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597767+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:55:08.597767+0000","last_peered":"2024-09-12T01:55:08.597767+0000","last_clean":"2024-09-12T01:55:08.597767+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:55:08.597767+0000","last_undegraded":"2024-09-12T01:55:08.597767+0000","last_fullsized":"2024-09-12T01:55:08.597767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589598+0000","last_change":"2024-09-12T01:55:07.604127+0000","last_active":"2024-09-12T01:55:08.589598+0000","last_peered":"2024-09-12T01:55:08.589598+0000","last_clean":"2024-09-12T01:55:08.589598+0000","last_became_active":"2024-09-12T01:55:07.603702+0000","last_became_peered":"2024-09-12T01:55:07.603702+0000","last_unstale":"2024-09-12T01:55:08.589598+0000","last_undegraded":"2024-09-12T01:55:08.589598+0000","last_fullsized":"2024-09-12T01:55:08.589598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:25.859732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600707+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:55:08.600707+0000","last_peered":"2024-09-12T01:55:08.600707+0000","last_clean":"2024-09-12T01:55:08.600707+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:55:08.600707+0000","last_undegraded":"2024-09-12T01:55:08.600707+0000","last_fullsized":"2024-09-12T01:55:08.600707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596230+0000","last_change":"2024-09-12T01:55:07.601369+0000","last_active":"2024-09-12T01:55:08.596230+0000","last_peered":"2024-09-12T01:55:08.596230+0000","last_clean":"2024-09-12T01:55:08.596230+0000","last_became_active":"2024-09-12T01:55:07.601053+0000","last_became_peered":"2024-09-12T01:55:07.601053+0000","last_unstale":"2024-09-12T01:55:08.596230+0000","last_undegraded":"2024-09-12T01:55:08.596230+0000","last_fullsized":"2024-09-12T01:55:08.596230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:14.532121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595084+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:55:08.595084+0000","last_peered":"2024-09-12T01:55:08.595084+0000","last_clean":"2024-09-12T01:55:08.595084+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:55:08.595084+0000","last_undegraded":"2024-09-12T01:55:08.595084+0000","last_fullsized":"2024-09-12T01:55:08.595084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597884+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:55:08.597884+0000","last_peered":"2024-09-12T01:55:08.597884+0000","last_clean":"2024-09-12T01:55:08.597884+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:55:08.597884+0000","last_undegraded":"2024-09-12T01:55:08.597884+0000","last_fullsized":"2024-09-12T01:55:08.597884+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597533+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:55:08.597533+0000","last_peered":"2024-09-12T01:55:08.597533+0000","last_clean":"2024-09-12T01:55:08.597533+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:55:08.597533+0000","last_undegraded":"2024-09-12T01:55:08.597533+0000","last_fullsized":"2024-09-12T01:55:08.597533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596755+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:55:08.596755+0000","last_peered":"2024-09-12T01:55:08.596755+0000","last_clean":"2024-09-12T01:55:08.596755+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:55:08.596755+0000","last_undegraded":"2024-09-12T01:55:08.596755+0000","last_fullsized":"2024-09-12T01:55:08.596755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589305+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:55:08.589305+0000","last_peered":"2024-09-12T01:55:08.589305+0000","last_clean":"2024-09-12T01:55:08.589305+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:55:08.589305+0000","last_undegraded":"2024-09-12T01:55:08.589305+0000","last_fullsized":"2024-09-12T01:55:08.589305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595902+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:55:08.595902+0000","last_peered":"2024-09-12T01:55:08.595902+0000","last_clean":"2024-09-12T01:55:08.595902+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:55:08.595902+0000","last_undegraded":"2024-09-12T01:55:08.595902+0000","last_fullsized":"2024-09-12T01:55:08.595902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596310+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:55:08.596310+0000","last_peered":"2024-09-12T01:55:08.596310+0000","last_clean":"2024-09-12T01:55:08.596310+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:55:08.596310+0000","last_undegraded":"2024-09-12T01:55:08.596310+0000","last_fullsized":"2024-09-12T01:55:08.596310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589062+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:55:08.589062+0000","last_peered":"2024-09-12T01:55:08.589062+0000","last_clean":"2024-09-12T01:55:08.589062+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:55:08.589062+0000","last_undegraded":"2024-09-12T01:55:08.589062+0000","last_fullsized":"2024-09-12T01:55:08.589062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595110+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:55:08.595110+0000","last_peered":"2024-09-12T01:55:08.595110+0000","last_clean":"2024-09-12T01:55:08.595110+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:55:08.595110+0000","last_undegraded":"2024-09-12T01:55:08.595110+0000","last_fullsized":"2024-09-12T01:55:08.595110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597323+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:55:08.597323+0000","last_peered":"2024-09-12T01:55:08.597323+0000","last_clean":"2024-09-12T01:55:08.597323+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:55:08.597323+0000","last_undegraded":"2024-09-12T01:55:08.597323+0000","last_fullsized":"2024-09-12T01:55:08.597323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591939+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:55:08.591939+0000","last_peered":"2024-09-12T01:55:08.591939+0000","last_clean":"2024-09-12T01:55:08.591939+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:55:08.591939+0000","last_undegraded":"2024-09-12T01:55:08.591939+0000","last_fullsized":"2024-09-12T01:55:08.591939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601557+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:55:08.601557+0000","last_peered":"2024-09-12T01:55:08.601557+0000","last_clean":"2024-09-12T01:55:08.601557+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:55:08.601557+0000","last_undegraded":"2024-09-12T01:55:08.601557+0000","last_fullsized":"2024-09-12T01:55:08.601557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592467+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:55:08.592467+0000","last_peered":"2024-09-12T01:55:08.592467+0000","last_clean":"2024-09-12T01:55:08.592467+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:55:08.592467+0000","last_undegraded":"2024-09-12T01:55:08.592467+0000","last_fullsized":"2024-09-12T01:55:08.592467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596455+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:55:08.596455+0000","last_peered":"2024-09-12T01:55:08.596455+0000","last_clean":"2024-09-12T01:55:08.596455+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:55:08.596455+0000","last_undegraded":"2024-09-12T01:55:08.596455+0000","last_fullsized":"2024-09-12T01:55:08.596455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589262+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:55:08.589262+0000","last_peered":"2024-09-12T01:55:08.589262+0000","last_clean":"2024-09-12T01:55:08.589262+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:55:08.589262+0000","last_undegraded":"2024-09-12T01:55:08.589262+0000","last_fullsized":"2024-09-12T01:55:08.589262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594644+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:55:08.594644+0000","last_peered":"2024-09-12T01:55:08.594644+0000","last_clean":"2024-09-12T01:55:08.594644+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:55:08.594644+0000","last_undegraded":"2024-09-12T01:55:08.594644+0000","last_fullsized":"2024-09-12T01:55:08.594644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598415+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:55:08.598415+0000","last_peered":"2024-09-12T01:55:08.598415+0000","last_clean":"2024-09-12T01:55:08.598415+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:55:08.598415+0000","last_undegraded":"2024-09-12T01:55:08.598415+0000","last_fullsized":"2024-09-12T01:55:08.598415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595412+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:55:08.595412+0000","last_peered":"2024-09-12T01:55:08.595412+0000","last_clean":"2024-09-12T01:55:08.595412+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:55:08.595412+0000","last_undegraded":"2024-09-12T01:55:08.595412+0000","last_fullsized":"2024-09-12T01:55:08.595412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595661+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:55:08.595661+0000","last_peered":"2024-09-12T01:55:08.595661+0000","last_clean":"2024-09-12T01:55:08.595661+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:55:08.595661+0000","last_undegraded":"2024-09-12T01:55:08.595661+0000","last_fullsized":"2024-09-12T01:55:08.595661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.588963+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:55:08.588963+0000","last_peered":"2024-09-12T01:55:08.588963+0000","last_clean":"2024-09-12T01:55:08.588963+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:55:08.588963+0000","last_undegraded":"2024-09-12T01:55:08.588963+0000","last_fullsized":"2024-09-12T01:55:08.588963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597169+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:55:08.597169+0000","last_peered":"2024-09-12T01:55:08.597169+0000","last_clean":"2024-09-12T01:55:08.597169+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:55:08.597169+0000","last_undegraded":"2024-09-12T01:55:08.597169+0000","last_fullsized":"2024-09-12T01:55:08.597169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:27.691805+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:55:27.691805+0000","last_peered":"2024-09-12T01:55:27.691805+0000","last_clean":"2024-09-12T01:55:27.691805+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:55:27.691805+0000","last_undegraded":"2024-09-12T01:55:27.691805+0000","last_fullsized":"2024-09-12T01:55:27.691805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596075+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:55:08.596075+0000","last_peered":"2024-09-12T01:55:08.596075+0000","last_clean":"2024-09-12T01:55:08.596075+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:55:08.596075+0000","last_undegraded":"2024-09-12T01:55:08.596075+0000","last_fullsized":"2024-09-12T01:55:08.596075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.661413+0000","last_change":"2024-09-12T01:55:05.545411+0000","last_active":"2024-09-12T01:55:16.661413+0000","last_peered":"2024-09-12T01:55:16.661413+0000","last_clean":"2024-09-12T01:55:16.661413+0000","last_became_active":"2024-09-12T01:55:05.545033+0000","last_became_peered":"2024-09-12T01:55:05.545033+0000","last_unstale":"2024-09-12T01:55:16.661413+0000","last_undegraded":"2024-09-12T01:55:16.661413+0000","last_fullsized":"2024-09-12T01:55:16.661413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:50.232473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662156+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:55:16.662156+0000","last_peered":"2024-09-12T01:55:16.662156+0000","last_clean":"2024-09-12T01:55:16.662156+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:55:16.662156+0000","last_undegraded":"2024-09-12T01:55:16.662156+0000","last_fullsized":"2024-09-12T01:55:16.662156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591767+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:55:08.591767+0000","last_peered":"2024-09-12T01:55:08.591767+0000","last_clean":"2024-09-12T01:55:08.591767+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:55:08.591767+0000","last_undegraded":"2024-09-12T01:55:08.591767+0000","last_fullsized":"2024-09-12T01:55:08.591767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.835443+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:55:08.835443+0000","last_peered":"2024-09-12T01:55:08.835443+0000","last_clean":"2024-09-12T01:55:08.835443+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:55:08.835443+0000","last_undegraded":"2024-09-12T01:55:08.835443+0000","last_fullsized":"2024-09-12T01:55:08.835443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595567+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:55:08.595567+0000","last_peered":"2024-09-12T01:55:08.595567+0000","last_clean":"2024-09-12T01:55:08.595567+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:55:08.595567+0000","last_undegraded":"2024-09-12T01:55:08.595567+0000","last_fullsized":"2024-09-12T01:55:08.595567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:28.692200+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:55:28.692200+0000","last_peered":"2024-09-12T01:55:28.692200+0000","last_clean":"2024-09-12T01:55:28.692200+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:55:28.692200+0000","last_undegraded":"2024-09-12T01:55:28.692200+0000","last_fullsized":"2024-09-12T01:55:28.692200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597775+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:55:08.597775+0000","last_peered":"2024-09-12T01:55:08.597775+0000","last_clean":"2024-09-12T01:55:08.597775+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:55:08.597775+0000","last_undegraded":"2024-09-12T01:55:08.597775+0000","last_fullsized":"2024-09-12T01:55:08.597775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.654210+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:55:15.654210+0000","last_peered":"2024-09-12T01:55:15.654210+0000","last_clean":"2024-09-12T01:55:15.654210+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:55:15.654210+0000","last_undegraded":"2024-09-12T01:55:15.654210+0000","last_fullsized":"2024-09-12T01:55:15.654210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598755+0000","last_change":"2024-09-12T01:55:07.606992+0000","last_active":"2024-09-12T01:55:08.598755+0000","last_peered":"2024-09-12T01:55:08.598755+0000","last_clean":"2024-09-12T01:55:08.598755+0000","last_became_active":"2024-09-12T01:55:07.606154+0000","last_became_peered":"2024-09-12T01:55:07.606154+0000","last_unstale":"2024-09-12T01:55:08.598755+0000","last_undegraded":"2024-09-12T01:55:08.598755+0000","last_fullsized":"2024-09-12T01:55:08.598755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:16.192629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.652719+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:55:15.652719+0000","last_peered":"2024-09-12T01:55:15.652719+0000","last_clean":"2024-09-12T01:55:15.652719+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:55:15.652719+0000","last_undegraded":"2024-09-12T01:55:15.652719+0000","last_fullsized":"2024-09-12T01:55:15.652719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597539+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:55:08.597539+0000","last_peered":"2024-09-12T01:55:08.597539+0000","last_clean":"2024-09-12T01:55:08.597539+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:55:08.597539+0000","last_undegraded":"2024-09-12T01:55:08.597539+0000","last_fullsized":"2024-09-12T01:55:08.597539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'22","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:29.695352+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:55:29.695352+0000","last_peered":"2024-09-12T01:55:29.695352+0000","last_clean":"2024-09-12T01:55:29.695352+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:55:29.695352+0000","last_undegraded":"2024-09-12T01:55:29.695352+0000","last_fullsized":"2024-09-12T01:55:29.695352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596934+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:55:08.596934+0000","last_peered":"2024-09-12T01:55:08.596934+0000","last_clean":"2024-09-12T01:55:08.596934+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:55:08.596934+0000","last_undegraded":"2024-09-12T01:55:08.596934+0000","last_fullsized":"2024-09-12T01:55:08.596934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.661708+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:55:16.661708+0000","last_peered":"2024-09-12T01:55:16.661708+0000","last_clean":"2024-09-12T01:55:16.661708+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:55:16.661708+0000","last_undegraded":"2024-09-12T01:55:16.661708+0000","last_fullsized":"2024-09-12T01:55:16.661708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594506+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:55:08.594506+0000","last_peered":"2024-09-12T01:55:08.594506+0000","last_clean":"2024-09-12T01:55:08.594506+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:55:08.594506+0000","last_undegraded":"2024-09-12T01:55:08.594506+0000","last_fullsized":"2024-09-12T01:55:08.594506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.651803+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:55:15.651803+0000","last_peered":"2024-09-12T01:55:15.651803+0000","last_clean":"2024-09-12T01:55:15.651803+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:55:15.651803+0000","last_undegraded":"2024-09-12T01:55:15.651803+0000","last_fullsized":"2024-09-12T01:55:15.651803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601055+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:55:08.601055+0000","last_peered":"2024-09-12T01:55:08.601055+0000","last_clean":"2024-09-12T01:55:08.601055+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:55:08.601055+0000","last_undegraded":"2024-09-12T01:55:08.601055+0000","last_fullsized":"2024-09-12T01:55:08.601055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:28.693234+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:55:28.693234+0000","last_peered":"2024-09-12T01:55:28.693234+0000","last_clean":"2024-09-12T01:55:28.693234+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:55:28.693234+0000","last_undegraded":"2024-09-12T01:55:28.693234+0000","last_fullsized":"2024-09-12T01:55:28.693234+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599892+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:55:08.599892+0000","last_peered":"2024-09-12T01:55:08.599892+0000","last_clean":"2024-09-12T01:55:08.599892+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:55:08.599892+0000","last_undegraded":"2024-09-12T01:55:08.599892+0000","last_fullsized":"2024-09-12T01:55:08.599892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.664164+0000","last_change":"2024-09-12T01:55:05.545008+0000","last_active":"2024-09-12T01:55:16.664164+0000","last_peered":"2024-09-12T01:55:16.664164+0000","last_clean":"2024-09-12T01:55:16.664164+0000","last_became_active":"2024-09-12T01:55:05.543984+0000","last_became_peered":"2024-09-12T01:55:05.543984+0000","last_unstale":"2024-09-12T01:55:16.664164+0000","last_undegraded":"2024-09-12T01:55:16.664164+0000","last_fullsized":"2024-09-12T01:55:16.664164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:49.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597610+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:55:08.597610+0000","last_peered":"2024-09-12T01:55:08.597610+0000","last_clean":"2024-09-12T01:55:08.597610+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:55:08.597610+0000","last_undegraded":"2024-09-12T01:55:08.597610+0000","last_fullsized":"2024-09-12T01:55:08.597610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:17.674262+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:55:17.674262+0000","last_peered":"2024-09-12T01:55:17.674262+0000","last_clean":"2024-09-12T01:55:17.674262+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:55:17.674262+0000","last_undegraded":"2024-09-12T01:55:17.674262+0000","last_fullsized":"2024-09-12T01:55:17.674262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589233+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:55:08.589233+0000","last_peered":"2024-09-12T01:55:08.589233+0000","last_clean":"2024-09-12T01:55:08.589233+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:55:08.589233+0000","last_undegraded":"2024-09-12T01:55:08.589233+0000","last_fullsized":"2024-09-12T01:55:08.589233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601654+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:55:08.601654+0000","last_peered":"2024-09-12T01:55:08.601654+0000","last_clean":"2024-09-12T01:55:08.601654+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:55:08.601654+0000","last_undegraded":"2024-09-12T01:55:08.601654+0000","last_fullsized":"2024-09-12T01:55:08.601654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600622+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:55:08.600622+0000","last_peered":"2024-09-12T01:55:08.600622+0000","last_clean":"2024-09-12T01:55:08.600622+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:55:08.600622+0000","last_undegraded":"2024-09-12T01:55:08.600622+0000","last_fullsized":"2024-09-12T01:55:08.600622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.835530+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:55:08.835530+0000","last_peered":"2024-09-12T01:55:08.835530+0000","last_clean":"2024-09-12T01:55:08.835530+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:55:08.835530+0000","last_undegraded":"2024-09-12T01:55:08.835530+0000","last_fullsized":"2024-09-12T01:55:08.835530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:09.081729+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:55:09.081729+0000","last_peered":"2024-09-12T01:55:09.081729+0000","last_clean":"2024-09-12T01:55:09.081729+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:55:09.081729+0000","last_undegraded":"2024-09-12T01:55:09.081729+0000","last_fullsized":"2024-09-12T01:55:09.081729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662967+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:55:16.662967+0000","last_peered":"2024-09-12T01:55:16.662967+0000","last_clean":"2024-09-12T01:55:16.662967+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:55:16.662967+0000","last_undegraded":"2024-09-12T01:55:16.662967+0000","last_fullsized":"2024-09-12T01:55:16.662967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601250+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:55:08.601250+0000","last_peered":"2024-09-12T01:55:08.601250+0000","last_clean":"2024-09-12T01:55:08.601250+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:55:08.601250+0000","last_undegraded":"2024-09-12T01:55:08.601250+0000","last_fullsized":"2024-09-12T01:55:08.601250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":331,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599994+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:55:08.599994+0000","last_peered":"2024-09-12T01:55:08.599994+0000","last_clean":"2024-09-12T01:55:08.599994+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:55:08.599994+0000","last_undegraded":"2024-09-12T01:55:08.599994+0000","last_fullsized":"2024-09-12T01:55:08.599994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:17.673857+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:55:17.673857+0000","last_peered":"2024-09-12T01:55:17.673857+0000","last_clean":"2024-09-12T01:55:17.673857+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:55:17.673857+0000","last_undegraded":"2024-09-12T01:55:17.673857+0000","last_fullsized":"2024-09-12T01:55:17.673857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592155+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:55:08.592155+0000","last_peered":"2024-09-12T01:55:08.592155+0000","last_clean":"2024-09-12T01:55:08.592155+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:55:08.592155+0000","last_undegraded":"2024-09-12T01:55:08.592155+0000","last_fullsized":"2024-09-12T01:55:08.592155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662614+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:55:16.662614+0000","last_peered":"2024-09-12T01:55:16.662614+0000","last_clean":"2024-09-12T01:55:16.662614+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:55:16.662614+0000","last_undegraded":"2024-09-12T01:55:16.662614+0000","last_fullsized":"2024-09-12T01:55:16.662614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594473+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:55:08.594473+0000","last_peered":"2024-09-12T01:55:08.594473+0000","last_clean":"2024-09-12T01:55:08.594473+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:55:08.594473+0000","last_undegraded":"2024-09-12T01:55:08.594473+0000","last_fullsized":"2024-09-12T01:55:08.594473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:29.694251+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:55:29.694251+0000","last_peered":"2024-09-12T01:55:29.694251+0000","last_clean":"2024-09-12T01:55:29.694251+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:55:29.694251+0000","last_undegraded":"2024-09-12T01:55:29.694251+0000","last_fullsized":"2024-09-12T01:55:29.694251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601247+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:55:08.601247+0000","last_peered":"2024-09-12T01:55:08.601247+0000","last_clean":"2024-09-12T01:55:08.601247+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:55:08.601247+0000","last_undegraded":"2024-09-12T01:55:08.601247+0000","last_fullsized":"2024-09-12T01:55:08.601247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:09.081714+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:55:09.081714+0000","last_peered":"2024-09-12T01:55:09.081714+0000","last_clean":"2024-09-12T01:55:09.081714+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:55:09.081714+0000","last_undegraded":"2024-09-12T01:55:09.081714+0000","last_fullsized":"2024-09-12T01:55:09.081714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589727+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:55:08.589727+0000","last_peered":"2024-09-12T01:55:08.589727+0000","last_clean":"2024-09-12T01:55:08.589727+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:55:08.589727+0000","last_undegraded":"2024-09-12T01:55:08.589727+0000","last_fullsized":"2024-09-12T01:55:08.589727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595835+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:55:08.595835+0000","last_peered":"2024-09-12T01:55:08.595835+0000","last_clean":"2024-09-12T01:55:08.595835+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:55:08.595835+0000","last_undegraded":"2024-09-12T01:55:08.595835+0000","last_fullsized":"2024-09-12T01:55:08.595835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:10.041395+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:55:10.041395+0000","last_peered":"2024-09-12T01:55:10.041395+0000","last_clean":"2024-09-12T01:55:10.041395+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:55:10.041395+0000","last_undegraded":"2024-09-12T01:55:10.041395+0000","last_fullsized":"2024-09-12T01:55:10.041395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.653618+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:55:15.653618+0000","last_peered":"2024-09-12T01:55:15.653618+0000","last_clean":"2024-09-12T01:55:15.653618+0000","last_became_active":"2024-09-12T01:55:05.540174+0000","last_became_peered":"2024-09-12T01:55:05.540174+0000","last_unstale":"2024-09-12T01:55:15.653618+0000","last_undegraded":"2024-09-12T01:55:15.653618+0000","last_fullsized":"2024-09-12T01:55:15.653618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:28.569699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594706+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:55:08.594706+0000","last_peered":"2024-09-12T01:55:08.594706+0000","last_clean":"2024-09-12T01:55:08.594706+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:55:08.594706+0000","last_undegraded":"2024-09-12T01:55:08.594706+0000","last_fullsized":"2024-09-12T01:55:08.594706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:27.596105+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:55:27.596105+0000","last_peered":"2024-09-12T01:55:27.596105+0000","last_clean":"2024-09-12T01:55:27.596105+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:55:27.596105+0000","last_undegraded":"2024-09-12T01:55:27.596105+0000","last_fullsized":"2024-09-12T01:55:27.596105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592601+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:55:08.592601+0000","last_peered":"2024-09-12T01:55:08.592601+0000","last_clean":"2024-09-12T01:55:08.592601+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:55:08.592601+0000","last_undegraded":"2024-09-12T01:55:08.592601+0000","last_fullsized":"2024-09-12T01:55:08.592601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.650332+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:55:15.650332+0000","last_peered":"2024-09-12T01:55:15.650332+0000","last_clean":"2024-09-12T01:55:15.650332+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:55:15.650332+0000","last_undegraded":"2024-09-12T01:55:15.650332+0000","last_fullsized":"2024-09-12T01:55:15.650332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598063+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:55:08.598063+0000","last_peered":"2024-09-12T01:55:08.598063+0000","last_clean":"2024-09-12T01:55:08.598063+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:55:08.598063+0000","last_undegraded":"2024-09-12T01:55:08.598063+0000","last_fullsized":"2024-09-12T01:55:08.598063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.653668+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:55:15.653668+0000","last_peered":"2024-09-12T01:55:15.653668+0000","last_clean":"2024-09-12T01:55:15.653668+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:55:15.653668+0000","last_undegraded":"2024-09-12T01:55:15.653668+0000","last_fullsized":"2024-09-12T01:55:15.653668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596967+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:55:08.596967+0000","last_peered":"2024-09-12T01:55:08.596967+0000","last_clean":"2024-09-12T01:55:08.596967+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:55:08.596967+0000","last_undegraded":"2024-09-12T01:55:08.596967+0000","last_fullsized":"2024-09-12T01:55:08.596967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.652917+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:55:15.652917+0000","last_peered":"2024-09-12T01:55:15.652917+0000","last_clean":"2024-09-12T01:55:15.652917+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:55:15.652917+0000","last_undegraded":"2024-09-12T01:55:15.652917+0000","last_fullsized":"2024-09-12T01:55:15.652917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589164+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:55:08.589164+0000","last_peered":"2024-09-12T01:55:08.589164+0000","last_clean":"2024-09-12T01:55:08.589164+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:55:08.589164+0000","last_undegraded":"2024-09-12T01:55:08.589164+0000","last_fullsized":"2024-09-12T01:55:08.589164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597532+0000","last_change":"2024-09-12T01:55:05.543774+0000","last_active":"2024-09-12T01:55:08.597532+0000","last_peered":"2024-09-12T01:55:08.597532+0000","last_clean":"2024-09-12T01:55:08.597532+0000","last_became_active":"2024-09-12T01:55:05.543418+0000","last_became_peered":"2024-09-12T01:55:05.543418+0000","last_unstale":"2024-09-12T01:55:08.597532+0000","last_undegraded":"2024-09-12T01:55:08.597532+0000","last_fullsized":"2024-09-12T01:55:08.597532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.058102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592290+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:55:08.592290+0000","last_peered":"2024-09-12T01:55:08.592290+0000","last_clean":"2024-09-12T01:55:08.592290+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:55:08.592290+0000","last_undegraded":"2024-09-12T01:55:08.592290+0000","last_fullsized":"2024-09-12T01:55:08.592290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.654240+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:55:15.654240+0000","last_peered":"2024-09-12T01:55:15.654240+0000","last_clean":"2024-09-12T01:55:15.654240+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:55:15.654240+0000","last_undegraded":"2024-09-12T01:55:15.654240+0000","last_fullsized":"2024-09-12T01:55:15.654240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600465+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:55:08.600465+0000","last_peered":"2024-09-12T01:55:08.600465+0000","last_clean":"2024-09-12T01:55:08.600465+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:55:08.600465+0000","last_undegraded":"2024-09-12T01:55:08.600465+0000","last_fullsized":"2024-09-12T01:55:08.600465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597896+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:55:08.597896+0000","last_peered":"2024-09-12T01:55:08.597896+0000","last_clean":"2024-09-12T01:55:08.597896+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:55:08.597896+0000","last_undegraded":"2024-09-12T01:55:08.597896+0000","last_fullsized":"2024-09-12T01:55:08.597896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.604021+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:55:08.604021+0000","last_peered":"2024-09-12T01:55:08.604021+0000","last_clean":"2024-09-12T01:55:08.604021+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:55:08.604021+0000","last_undegraded":"2024-09-12T01:55:08.604021+0000","last_fullsized":"2024-09-12T01:55:08.604021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597413+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:55:08.597413+0000","last_peered":"2024-09-12T01:55:08.597413+0000","last_clean":"2024-09-12T01:55:08.597413+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:55:08.597413+0000","last_undegraded":"2024-09-12T01:55:08.597413+0000","last_fullsized":"2024-09-12T01:55:08.597413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.663297+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:55:16.663297+0000","last_peered":"2024-09-12T01:55:16.663297+0000","last_clean":"2024-09-12T01:55:16.663297+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:55:16.663297+0000","last_undegraded":"2024-09-12T01:55:16.663297+0000","last_fullsized":"2024-09-12T01:55:16.663297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598720+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:55:08.598720+0000","last_peered":"2024-09-12T01:55:08.598720+0000","last_clean":"2024-09-12T01:55:08.598720+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:55:08.598720+0000","last_undegraded":"2024-09-12T01:55:08.598720+0000","last_fullsized":"2024-09-12T01:55:08.598720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.602545+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:55:08.602545+0000","last_peered":"2024-09-12T01:55:08.602545+0000","last_clean":"2024-09-12T01:55:08.602545+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:55:08.602545+0000","last_undegraded":"2024-09-12T01:55:08.602545+0000","last_fullsized":"2024-09-12T01:55:08.602545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592689+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:55:08.592689+0000","last_peered":"2024-09-12T01:55:08.592689+0000","last_clean":"2024-09-12T01:55:08.592689+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:55:08.592689+0000","last_undegraded":"2024-09-12T01:55:08.592689+0000","last_fullsized":"2024-09-12T01:55:08.592689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.663119+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:55:16.663119+0000","last_peered":"2024-09-12T01:55:16.663119+0000","last_clean":"2024-09-12T01:55:16.663119+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:55:16.663119+0000","last_undegraded":"2024-09-12T01:55:16.663119+0000","last_fullsized":"2024-09-12T01:55:16.663119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50805,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":103,"num_read_kb":107,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":160058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":421398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1059681,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":421634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":421554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1013486,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":421023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1013170,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":421460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":421334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":463624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":475261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":422294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:55:34.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:55:34.697 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:35.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:34 smithi172 ceph-mon[35073]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T01:55:35.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:34 smithi172 ceph-mon[35073]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:35.067 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:34 smithi039 ceph-mon[31204]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T01:55:35.067 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:34 smithi039 ceph-mon[31204]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:35.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 -- 172.21.15.39:0/1325477060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 msgr2=0x7fc2141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/1325477060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc2141067e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc204009900 tx=0x7fc20402a410 comp rx=0 tx=0).stop 2024-09-12T01:55:35.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 -- 172.21.15.39:0/1325477060 shutdown_connections 2024-09-12T01:55:35.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/1325477060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 0x7fc21410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/1325477060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc2141067e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/1325477060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 0x7fc2141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 -- 172.21.15.39:0/1325477060 >> 172.21.15.39:0/1325477060 conn(0x7fc2140fd8c0 msgr2=0x7fc2140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:35.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 -- 172.21.15.39:0/1325477060 shutdown_connections 2024-09-12T01:55:35.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.148+0000 7fc21c1cc640 1 -- 172.21.15.39:0/1325477060 wait complete. 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 Processor -- start 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 -- start start 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 0x7fc214198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 0x7fc21419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc214111f90 con 0x7fc214102790 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc214111e10 con 0x7fc214106f10 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc21c1cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc214112110 con 0x7fc214101de0 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.149+0000 7fc219767640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52718/0 (socket says 172.21.15.39:52718) 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 -- 172.21.15.39:0/3113407739 learned_addr learned my addr 172.21.15.39:0/3113407739 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc21a769640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 0x7fc21419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219f68640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 0x7fc214198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 -- 172.21.15.39:0/3113407739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 msgr2=0x7fc214198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 0x7fc214198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 -- 172.21.15.39:0/3113407739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 msgr2=0x7fc21419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 0x7fc21419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 -- 172.21.15.39:0/3113407739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21419d3c0 con 0x7fc214102790 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc219767640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc204005ab0 tx=0x7fc2040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20403f030 con 0x7fc214102790 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc204003ce0 con 0x7fc214102790 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21419d650 con 0x7fc214102790 2024-09-12T01:55:35.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc204035070 con 0x7fc214102790 2024-09-12T01:55:35.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.150+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2141a4f90 con 0x7fc214102790 2024-09-12T01:55:35.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.151+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2141021c0 con 0x7fc214102790 2024-09-12T01:55:35.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.152+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc204042030 con 0x7fc214102790 2024-09-12T01:55:35.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.153+0000 7fc20affd640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.153+0000 7fc219f68640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.154+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc2040ef910 con 0x7fc214102790 2024-09-12T01:55:35.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.154+0000 7fc219f68640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 0x7fc2000a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc210009890 tx=0x7fc210008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.158+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2040bc8c0 con 0x7fc214102790 2024-09-12T01:55:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:34 smithi044 ceph-mon[35259]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-12T01:55:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:34 smithi044 ceph-mon[35259]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:35.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.330+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc214062630 con 0x7fc2000a2c10 2024-09-12T01:55:35.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.339+0000 7fc20affd640 1 -- 172.21.15.39:0/3113407739 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258861 (secure 0 0 0) 0x7fc214062630 con 0x7fc2000a2c10 2024-09-12T01:55:35.342 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:35.344 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 msgr2=0x7fc2000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 0x7fc2000a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc210009890 tx=0x7fc210008040 comp rx=0 tx=0).stop 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 msgr2=0x7fc214198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc204005ab0 tx=0x7fc2040042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 shutdown_connections 2024-09-12T01:55:35.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc214106f10 0x7fc21419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc214102790 0x7fc214198950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 --2- 172.21.15.39:0/3113407739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc214101de0 0x7fc214198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 >> 172.21.15.39:0/3113407739 conn(0x7fc2140fd8c0 msgr2=0x7fc2140fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 shutdown_connections 2024-09-12T01:55:35.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:35.343+0000 7fc21c1cc640 1 -- 172.21.15.39:0/3113407739 wait complete. 2024-09-12T01:55:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-12T01:55:35.243678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649050,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":255,"num_read_kb":234,"num_write":335,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359980,"kb_used_data":10732,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581844,"statfs":{"total":1151940427776,"available":1151571808256,"internally_reserved":0,"allocated":10989568,"data_stored":6989299,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53460,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":95,"num_write":29,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003249"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589295+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:55:08.589295+0000","last_peered":"2024-09-12T01:55:08.589295+0000","last_clean":"2024-09-12T01:55:08.589295+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:55:08.589295+0000","last_undegraded":"2024-09-12T01:55:08.589295+0000","last_fullsized":"2024-09-12T01:55:08.589295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597995+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:55:08.597995+0000","last_peered":"2024-09-12T01:55:08.597995+0000","last_clean":"2024-09-12T01:55:08.597995+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:55:08.597995+0000","last_undegraded":"2024-09-12T01:55:08.597995+0000","last_fullsized":"2024-09-12T01:55:08.597995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597682+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:55:08.597682+0000","last_peered":"2024-09-12T01:55:08.597682+0000","last_clean":"2024-09-12T01:55:08.597682+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:55:08.597682+0000","last_undegraded":"2024-09-12T01:55:08.597682+0000","last_fullsized":"2024-09-12T01:55:08.597682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596059+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:55:08.596059+0000","last_peered":"2024-09-12T01:55:08.596059+0000","last_clean":"2024-09-12T01:55:08.596059+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:55:08.596059+0000","last_undegraded":"2024-09-12T01:55:08.596059+0000","last_fullsized":"2024-09-12T01:55:08.596059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596652+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:55:08.596652+0000","last_peered":"2024-09-12T01:55:08.596652+0000","last_clean":"2024-09-12T01:55:08.596652+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:55:08.596652+0000","last_undegraded":"2024-09-12T01:55:08.596652+0000","last_fullsized":"2024-09-12T01:55:08.596652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589373+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:55:08.589373+0000","last_peered":"2024-09-12T01:55:08.589373+0000","last_clean":"2024-09-12T01:55:08.589373+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:55:08.589373+0000","last_undegraded":"2024-09-12T01:55:08.589373+0000","last_fullsized":"2024-09-12T01:55:08.589373+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599859+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:55:08.599859+0000","last_peered":"2024-09-12T01:55:08.599859+0000","last_clean":"2024-09-12T01:55:08.599859+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:55:08.599859+0000","last_undegraded":"2024-09-12T01:55:08.599859+0000","last_fullsized":"2024-09-12T01:55:08.599859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591778+0000","last_change":"2024-09-12T01:55:07.611371+0000","last_active":"2024-09-12T01:55:08.591778+0000","last_peered":"2024-09-12T01:55:08.591778+0000","last_clean":"2024-09-12T01:55:08.591778+0000","last_became_active":"2024-09-12T01:55:07.609457+0000","last_became_peered":"2024-09-12T01:55:07.609457+0000","last_unstale":"2024-09-12T01:55:08.591778+0000","last_undegraded":"2024-09-12T01:55:08.591778+0000","last_fullsized":"2024-09-12T01:55:08.591778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:10.253485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597767+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:55:08.597767+0000","last_peered":"2024-09-12T01:55:08.597767+0000","last_clean":"2024-09-12T01:55:08.597767+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:55:08.597767+0000","last_undegraded":"2024-09-12T01:55:08.597767+0000","last_fullsized":"2024-09-12T01:55:08.597767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589598+0000","last_change":"2024-09-12T01:55:07.604127+0000","last_active":"2024-09-12T01:55:08.589598+0000","last_peered":"2024-09-12T01:55:08.589598+0000","last_clean":"2024-09-12T01:55:08.589598+0000","last_became_active":"2024-09-12T01:55:07.603702+0000","last_became_peered":"2024-09-12T01:55:07.603702+0000","last_unstale":"2024-09-12T01:55:08.589598+0000","last_undegraded":"2024-09-12T01:55:08.589598+0000","last_fullsized":"2024-09-12T01:55:08.589598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:25.859732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600707+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:55:08.600707+0000","last_peered":"2024-09-12T01:55:08.600707+0000","last_clean":"2024-09-12T01:55:08.600707+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:55:08.600707+0000","last_undegraded":"2024-09-12T01:55:08.600707+0000","last_fullsized":"2024-09-12T01:55:08.600707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596230+0000","last_change":"2024-09-12T01:55:07.601369+0000","last_active":"2024-09-12T01:55:08.596230+0000","last_peered":"2024-09-12T01:55:08.596230+0000","last_clean":"2024-09-12T01:55:08.596230+0000","last_became_active":"2024-09-12T01:55:07.601053+0000","last_became_peered":"2024-09-12T01:55:07.601053+0000","last_unstale":"2024-09-12T01:55:08.596230+0000","last_undegraded":"2024-09-12T01:55:08.596230+0000","last_fullsized":"2024-09-12T01:55:08.596230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:14.532121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595084+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:55:08.595084+0000","last_peered":"2024-09-12T01:55:08.595084+0000","last_clean":"2024-09-12T01:55:08.595084+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:55:08.595084+0000","last_undegraded":"2024-09-12T01:55:08.595084+0000","last_fullsized":"2024-09-12T01:55:08.595084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597884+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:55:08.597884+0000","last_peered":"2024-09-12T01:55:08.597884+0000","last_clean":"2024-09-12T01:55:08.597884+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:55:08.597884+0000","last_undegraded":"2024-09-12T01:55:08.597884+0000","last_fullsized":"2024-09-12T01:55:08.597884+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597533+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:55:08.597533+0000","last_peered":"2024-09-12T01:55:08.597533+0000","last_clean":"2024-09-12T01:55:08.597533+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:55:08.597533+0000","last_undegraded":"2024-09-12T01:55:08.597533+0000","last_fullsized":"2024-09-12T01:55:08.597533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596755+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:55:08.596755+0000","last_peered":"2024-09-12T01:55:08.596755+0000","last_clean":"2024-09-12T01:55:08.596755+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:55:08.596755+0000","last_undegraded":"2024-09-12T01:55:08.596755+0000","last_fullsized":"2024-09-12T01:55:08.596755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589305+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:55:08.589305+0000","last_peered":"2024-09-12T01:55:08.589305+0000","last_clean":"2024-09-12T01:55:08.589305+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:55:08.589305+0000","last_undegraded":"2024-09-12T01:55:08.589305+0000","last_fullsized":"2024-09-12T01:55:08.589305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595902+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:55:08.595902+0000","last_peered":"2024-09-12T01:55:08.595902+0000","last_clean":"2024-09-12T01:55:08.595902+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:55:08.595902+0000","last_undegraded":"2024-09-12T01:55:08.595902+0000","last_fullsized":"2024-09-12T01:55:08.595902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596310+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:55:08.596310+0000","last_peered":"2024-09-12T01:55:08.596310+0000","last_clean":"2024-09-12T01:55:08.596310+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:55:08.596310+0000","last_undegraded":"2024-09-12T01:55:08.596310+0000","last_fullsized":"2024-09-12T01:55:08.596310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589062+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:55:08.589062+0000","last_peered":"2024-09-12T01:55:08.589062+0000","last_clean":"2024-09-12T01:55:08.589062+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:55:08.589062+0000","last_undegraded":"2024-09-12T01:55:08.589062+0000","last_fullsized":"2024-09-12T01:55:08.589062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595110+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:55:08.595110+0000","last_peered":"2024-09-12T01:55:08.595110+0000","last_clean":"2024-09-12T01:55:08.595110+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:55:08.595110+0000","last_undegraded":"2024-09-12T01:55:08.595110+0000","last_fullsized":"2024-09-12T01:55:08.595110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597323+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:55:08.597323+0000","last_peered":"2024-09-12T01:55:08.597323+0000","last_clean":"2024-09-12T01:55:08.597323+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:55:08.597323+0000","last_undegraded":"2024-09-12T01:55:08.597323+0000","last_fullsized":"2024-09-12T01:55:08.597323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591939+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:55:08.591939+0000","last_peered":"2024-09-12T01:55:08.591939+0000","last_clean":"2024-09-12T01:55:08.591939+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:55:08.591939+0000","last_undegraded":"2024-09-12T01:55:08.591939+0000","last_fullsized":"2024-09-12T01:55:08.591939+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601557+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:55:08.601557+0000","last_peered":"2024-09-12T01:55:08.601557+0000","last_clean":"2024-09-12T01:55:08.601557+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:55:08.601557+0000","last_undegraded":"2024-09-12T01:55:08.601557+0000","last_fullsized":"2024-09-12T01:55:08.601557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592467+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:55:08.592467+0000","last_peered":"2024-09-12T01:55:08.592467+0000","last_clean":"2024-09-12T01:55:08.592467+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:55:08.592467+0000","last_undegraded":"2024-09-12T01:55:08.592467+0000","last_fullsized":"2024-09-12T01:55:08.592467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596455+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:55:08.596455+0000","last_peered":"2024-09-12T01:55:08.596455+0000","last_clean":"2024-09-12T01:55:08.596455+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:55:08.596455+0000","last_undegraded":"2024-09-12T01:55:08.596455+0000","last_fullsized":"2024-09-12T01:55:08.596455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589262+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:55:08.589262+0000","last_peered":"2024-09-12T01:55:08.589262+0000","last_clean":"2024-09-12T01:55:08.589262+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:55:08.589262+0000","last_undegraded":"2024-09-12T01:55:08.589262+0000","last_fullsized":"2024-09-12T01:55:08.589262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594644+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:55:08.594644+0000","last_peered":"2024-09-12T01:55:08.594644+0000","last_clean":"2024-09-12T01:55:08.594644+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:55:08.594644+0000","last_undegraded":"2024-09-12T01:55:08.594644+0000","last_fullsized":"2024-09-12T01:55:08.594644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598415+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:55:08.598415+0000","last_peered":"2024-09-12T01:55:08.598415+0000","last_clean":"2024-09-12T01:55:08.598415+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:55:08.598415+0000","last_undegraded":"2024-09-12T01:55:08.598415+0000","last_fullsized":"2024-09-12T01:55:08.598415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595412+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:55:08.595412+0000","last_peered":"2024-09-12T01:55:08.595412+0000","last_clean":"2024-09-12T01:55:08.595412+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:55:08.595412+0000","last_undegraded":"2024-09-12T01:55:08.595412+0000","last_fullsized":"2024-09-12T01:55:08.595412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595661+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:55:08.595661+0000","last_peered":"2024-09-12T01:55:08.595661+0000","last_clean":"2024-09-12T01:55:08.595661+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:55:08.595661+0000","last_undegraded":"2024-09-12T01:55:08.595661+0000","last_fullsized":"2024-09-12T01:55:08.595661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.588963+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:55:08.588963+0000","last_peered":"2024-09-12T01:55:08.588963+0000","last_clean":"2024-09-12T01:55:08.588963+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:55:08.588963+0000","last_undegraded":"2024-09-12T01:55:08.588963+0000","last_fullsized":"2024-09-12T01:55:08.588963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597169+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:55:08.597169+0000","last_peered":"2024-09-12T01:55:08.597169+0000","last_clean":"2024-09-12T01:55:08.597169+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:55:08.597169+0000","last_undegraded":"2024-09-12T01:55:08.597169+0000","last_fullsized":"2024-09-12T01:55:08.597169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:32.699207+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:55:32.699207+0000","last_peered":"2024-09-12T01:55:32.699207+0000","last_clean":"2024-09-12T01:55:32.699207+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:55:32.699207+0000","last_undegraded":"2024-09-12T01:55:32.699207+0000","last_fullsized":"2024-09-12T01:55:32.699207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596075+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:55:08.596075+0000","last_peered":"2024-09-12T01:55:08.596075+0000","last_clean":"2024-09-12T01:55:08.596075+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:55:08.596075+0000","last_undegraded":"2024-09-12T01:55:08.596075+0000","last_fullsized":"2024-09-12T01:55:08.596075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.661413+0000","last_change":"2024-09-12T01:55:05.545411+0000","last_active":"2024-09-12T01:55:16.661413+0000","last_peered":"2024-09-12T01:55:16.661413+0000","last_clean":"2024-09-12T01:55:16.661413+0000","last_became_active":"2024-09-12T01:55:05.545033+0000","last_became_peered":"2024-09-12T01:55:05.545033+0000","last_unstale":"2024-09-12T01:55:16.661413+0000","last_undegraded":"2024-09-12T01:55:16.661413+0000","last_fullsized":"2024-09-12T01:55:16.661413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:50.232473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662156+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:55:16.662156+0000","last_peered":"2024-09-12T01:55:16.662156+0000","last_clean":"2024-09-12T01:55:16.662156+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:55:16.662156+0000","last_undegraded":"2024-09-12T01:55:16.662156+0000","last_fullsized":"2024-09-12T01:55:16.662156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.591767+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:55:08.591767+0000","last_peered":"2024-09-12T01:55:08.591767+0000","last_clean":"2024-09-12T01:55:08.591767+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:55:08.591767+0000","last_undegraded":"2024-09-12T01:55:08.591767+0000","last_fullsized":"2024-09-12T01:55:08.591767+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.835443+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:55:08.835443+0000","last_peered":"2024-09-12T01:55:08.835443+0000","last_clean":"2024-09-12T01:55:08.835443+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:55:08.835443+0000","last_undegraded":"2024-09-12T01:55:08.835443+0000","last_fullsized":"2024-09-12T01:55:08.835443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595567+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:55:08.595567+0000","last_peered":"2024-09-12T01:55:08.595567+0000","last_clean":"2024-09-12T01:55:08.595567+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:55:08.595567+0000","last_undegraded":"2024-09-12T01:55:08.595567+0000","last_fullsized":"2024-09-12T01:55:08.595567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:33.699623+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:55:33.699623+0000","last_peered":"2024-09-12T01:55:33.699623+0000","last_clean":"2024-09-12T01:55:33.699623+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:55:33.699623+0000","last_undegraded":"2024-09-12T01:55:33.699623+0000","last_fullsized":"2024-09-12T01:55:33.699623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597775+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:55:08.597775+0000","last_peered":"2024-09-12T01:55:08.597775+0000","last_clean":"2024-09-12T01:55:08.597775+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:55:08.597775+0000","last_undegraded":"2024-09-12T01:55:08.597775+0000","last_fullsized":"2024-09-12T01:55:08.597775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.654210+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:55:15.654210+0000","last_peered":"2024-09-12T01:55:15.654210+0000","last_clean":"2024-09-12T01:55:15.654210+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:55:15.654210+0000","last_undegraded":"2024-09-12T01:55:15.654210+0000","last_fullsized":"2024-09-12T01:55:15.654210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598755+0000","last_change":"2024-09-12T01:55:07.606992+0000","last_active":"2024-09-12T01:55:08.598755+0000","last_peered":"2024-09-12T01:55:08.598755+0000","last_clean":"2024-09-12T01:55:08.598755+0000","last_became_active":"2024-09-12T01:55:07.606154+0000","last_became_peered":"2024-09-12T01:55:07.606154+0000","last_unstale":"2024-09-12T01:55:08.598755+0000","last_undegraded":"2024-09-12T01:55:08.598755+0000","last_fullsized":"2024-09-12T01:55:08.598755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:16.192629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.652719+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:55:15.652719+0000","last_peered":"2024-09-12T01:55:15.652719+0000","last_clean":"2024-09-12T01:55:15.652719+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:55:15.652719+0000","last_undegraded":"2024-09-12T01:55:15.652719+0000","last_fullsized":"2024-09-12T01:55:15.652719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597539+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:55:08.597539+0000","last_peered":"2024-09-12T01:55:08.597539+0000","last_clean":"2024-09-12T01:55:08.597539+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:55:08.597539+0000","last_undegraded":"2024-09-12T01:55:08.597539+0000","last_fullsized":"2024-09-12T01:55:08.597539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:34.701807+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:55:34.701807+0000","last_peered":"2024-09-12T01:55:34.701807+0000","last_clean":"2024-09-12T01:55:34.701807+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:55:34.701807+0000","last_undegraded":"2024-09-12T01:55:34.701807+0000","last_fullsized":"2024-09-12T01:55:34.701807+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54445,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":74,"num_write":26,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596934+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:55:08.596934+0000","last_peered":"2024-09-12T01:55:08.596934+0000","last_clean":"2024-09-12T01:55:08.596934+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:55:08.596934+0000","last_undegraded":"2024-09-12T01:55:08.596934+0000","last_fullsized":"2024-09-12T01:55:08.596934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.661708+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:55:16.661708+0000","last_peered":"2024-09-12T01:55:16.661708+0000","last_clean":"2024-09-12T01:55:16.661708+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:55:16.661708+0000","last_undegraded":"2024-09-12T01:55:16.661708+0000","last_fullsized":"2024-09-12T01:55:16.661708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594506+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:55:08.594506+0000","last_peered":"2024-09-12T01:55:08.594506+0000","last_clean":"2024-09-12T01:55:08.594506+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:55:08.594506+0000","last_undegraded":"2024-09-12T01:55:08.594506+0000","last_fullsized":"2024-09-12T01:55:08.594506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.651803+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:55:15.651803+0000","last_peered":"2024-09-12T01:55:15.651803+0000","last_clean":"2024-09-12T01:55:15.651803+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:55:15.651803+0000","last_undegraded":"2024-09-12T01:55:15.651803+0000","last_fullsized":"2024-09-12T01:55:15.651803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601055+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:55:08.601055+0000","last_peered":"2024-09-12T01:55:08.601055+0000","last_clean":"2024-09-12T01:55:08.601055+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:55:08.601055+0000","last_undegraded":"2024-09-12T01:55:08.601055+0000","last_fullsized":"2024-09-12T01:55:08.601055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:33.700346+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:55:33.700346+0000","last_peered":"2024-09-12T01:55:33.700346+0000","last_clean":"2024-09-12T01:55:33.700346+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:55:33.700346+0000","last_undegraded":"2024-09-12T01:55:33.700346+0000","last_fullsized":"2024-09-12T01:55:33.700346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599892+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:55:08.599892+0000","last_peered":"2024-09-12T01:55:08.599892+0000","last_clean":"2024-09-12T01:55:08.599892+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:55:08.599892+0000","last_undegraded":"2024-09-12T01:55:08.599892+0000","last_fullsized":"2024-09-12T01:55:08.599892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.664164+0000","last_change":"2024-09-12T01:55:05.545008+0000","last_active":"2024-09-12T01:55:16.664164+0000","last_peered":"2024-09-12T01:55:16.664164+0000","last_clean":"2024-09-12T01:55:16.664164+0000","last_became_active":"2024-09-12T01:55:05.543984+0000","last_became_peered":"2024-09-12T01:55:05.543984+0000","last_unstale":"2024-09-12T01:55:16.664164+0000","last_undegraded":"2024-09-12T01:55:16.664164+0000","last_fullsized":"2024-09-12T01:55:16.664164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:49.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597610+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:55:08.597610+0000","last_peered":"2024-09-12T01:55:08.597610+0000","last_clean":"2024-09-12T01:55:08.597610+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:55:08.597610+0000","last_undegraded":"2024-09-12T01:55:08.597610+0000","last_fullsized":"2024-09-12T01:55:08.597610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:17.674262+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:55:17.674262+0000","last_peered":"2024-09-12T01:55:17.674262+0000","last_clean":"2024-09-12T01:55:17.674262+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:55:17.674262+0000","last_undegraded":"2024-09-12T01:55:17.674262+0000","last_fullsized":"2024-09-12T01:55:17.674262+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589233+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:55:08.589233+0000","last_peered":"2024-09-12T01:55:08.589233+0000","last_clean":"2024-09-12T01:55:08.589233+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:55:08.589233+0000","last_undegraded":"2024-09-12T01:55:08.589233+0000","last_fullsized":"2024-09-12T01:55:08.589233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601654+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:55:08.601654+0000","last_peered":"2024-09-12T01:55:08.601654+0000","last_clean":"2024-09-12T01:55:08.601654+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:55:08.601654+0000","last_undegraded":"2024-09-12T01:55:08.601654+0000","last_fullsized":"2024-09-12T01:55:08.601654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600622+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:55:08.600622+0000","last_peered":"2024-09-12T01:55:08.600622+0000","last_clean":"2024-09-12T01:55:08.600622+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:55:08.600622+0000","last_undegraded":"2024-09-12T01:55:08.600622+0000","last_fullsized":"2024-09-12T01:55:08.600622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.835530+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:55:08.835530+0000","last_peered":"2024-09-12T01:55:08.835530+0000","last_clean":"2024-09-12T01:55:08.835530+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:55:08.835530+0000","last_undegraded":"2024-09-12T01:55:08.835530+0000","last_fullsized":"2024-09-12T01:55:08.835530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:09.081729+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:55:09.081729+0000","last_peered":"2024-09-12T01:55:09.081729+0000","last_clean":"2024-09-12T01:55:09.081729+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:55:09.081729+0000","last_undegraded":"2024-09-12T01:55:09.081729+0000","last_fullsized":"2024-09-12T01:55:09.081729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662967+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:55:16.662967+0000","last_peered":"2024-09-12T01:55:16.662967+0000","last_clean":"2024-09-12T01:55:16.662967+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:55:16.662967+0000","last_undegraded":"2024-09-12T01:55:16.662967+0000","last_fullsized":"2024-09-12T01:55:16.662967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601250+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:55:08.601250+0000","last_peered":"2024-09-12T01:55:08.601250+0000","last_clean":"2024-09-12T01:55:08.601250+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:55:08.601250+0000","last_undegraded":"2024-09-12T01:55:08.601250+0000","last_fullsized":"2024-09-12T01:55:08.601250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":331,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.599994+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:55:08.599994+0000","last_peered":"2024-09-12T01:55:08.599994+0000","last_clean":"2024-09-12T01:55:08.599994+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:55:08.599994+0000","last_undegraded":"2024-09-12T01:55:08.599994+0000","last_fullsized":"2024-09-12T01:55:08.599994+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:17.673857+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:55:17.673857+0000","last_peered":"2024-09-12T01:55:17.673857+0000","last_clean":"2024-09-12T01:55:17.673857+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:55:17.673857+0000","last_undegraded":"2024-09-12T01:55:17.673857+0000","last_fullsized":"2024-09-12T01:55:17.673857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592155+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:55:08.592155+0000","last_peered":"2024-09-12T01:55:08.592155+0000","last_clean":"2024-09-12T01:55:08.592155+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:55:08.592155+0000","last_undegraded":"2024-09-12T01:55:08.592155+0000","last_fullsized":"2024-09-12T01:55:08.592155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.662614+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:55:16.662614+0000","last_peered":"2024-09-12T01:55:16.662614+0000","last_clean":"2024-09-12T01:55:16.662614+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:55:16.662614+0000","last_undegraded":"2024-09-12T01:55:16.662614+0000","last_fullsized":"2024-09-12T01:55:16.662614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594473+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:55:08.594473+0000","last_peered":"2024-09-12T01:55:08.594473+0000","last_clean":"2024-09-12T01:55:08.594473+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:55:08.594473+0000","last_undegraded":"2024-09-12T01:55:08.594473+0000","last_fullsized":"2024-09-12T01:55:08.594473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:29.694251+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:55:29.694251+0000","last_peered":"2024-09-12T01:55:29.694251+0000","last_clean":"2024-09-12T01:55:29.694251+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:55:29.694251+0000","last_undegraded":"2024-09-12T01:55:29.694251+0000","last_fullsized":"2024-09-12T01:55:29.694251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.601247+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:55:08.601247+0000","last_peered":"2024-09-12T01:55:08.601247+0000","last_clean":"2024-09-12T01:55:08.601247+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:55:08.601247+0000","last_undegraded":"2024-09-12T01:55:08.601247+0000","last_fullsized":"2024-09-12T01:55:08.601247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:09.081714+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:55:09.081714+0000","last_peered":"2024-09-12T01:55:09.081714+0000","last_clean":"2024-09-12T01:55:09.081714+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:55:09.081714+0000","last_undegraded":"2024-09-12T01:55:09.081714+0000","last_fullsized":"2024-09-12T01:55:09.081714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589727+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:55:08.589727+0000","last_peered":"2024-09-12T01:55:08.589727+0000","last_clean":"2024-09-12T01:55:08.589727+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:55:08.589727+0000","last_undegraded":"2024-09-12T01:55:08.589727+0000","last_fullsized":"2024-09-12T01:55:08.589727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.595835+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:55:08.595835+0000","last_peered":"2024-09-12T01:55:08.595835+0000","last_clean":"2024-09-12T01:55:08.595835+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:55:08.595835+0000","last_undegraded":"2024-09-12T01:55:08.595835+0000","last_fullsized":"2024-09-12T01:55:08.595835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:10.041395+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:55:10.041395+0000","last_peered":"2024-09-12T01:55:10.041395+0000","last_clean":"2024-09-12T01:55:10.041395+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:55:10.041395+0000","last_undegraded":"2024-09-12T01:55:10.041395+0000","last_fullsized":"2024-09-12T01:55:10.041395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.653618+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:55:15.653618+0000","last_peered":"2024-09-12T01:55:15.653618+0000","last_clean":"2024-09-12T01:55:15.653618+0000","last_became_active":"2024-09-12T01:55:05.540174+0000","last_became_peered":"2024-09-12T01:55:05.540174+0000","last_unstale":"2024-09-12T01:55:15.653618+0000","last_undegraded":"2024-09-12T01:55:15.653618+0000","last_fullsized":"2024-09-12T01:55:15.653618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:28.569699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.594706+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:55:08.594706+0000","last_peered":"2024-09-12T01:55:08.594706+0000","last_clean":"2024-09-12T01:55:08.594706+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:55:08.594706+0000","last_undegraded":"2024-09-12T01:55:08.594706+0000","last_fullsized":"2024-09-12T01:55:08.594706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:27.596105+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:55:27.596105+0000","last_peered":"2024-09-12T01:55:27.596105+0000","last_clean":"2024-09-12T01:55:27.596105+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:55:27.596105+0000","last_undegraded":"2024-09-12T01:55:27.596105+0000","last_fullsized":"2024-09-12T01:55:27.596105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592601+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:55:08.592601+0000","last_peered":"2024-09-12T01:55:08.592601+0000","last_clean":"2024-09-12T01:55:08.592601+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:55:08.592601+0000","last_undegraded":"2024-09-12T01:55:08.592601+0000","last_fullsized":"2024-09-12T01:55:08.592601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.650332+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:55:15.650332+0000","last_peered":"2024-09-12T01:55:15.650332+0000","last_clean":"2024-09-12T01:55:15.650332+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:55:15.650332+0000","last_undegraded":"2024-09-12T01:55:15.650332+0000","last_fullsized":"2024-09-12T01:55:15.650332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598063+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:55:08.598063+0000","last_peered":"2024-09-12T01:55:08.598063+0000","last_clean":"2024-09-12T01:55:08.598063+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:55:08.598063+0000","last_undegraded":"2024-09-12T01:55:08.598063+0000","last_fullsized":"2024-09-12T01:55:08.598063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.653668+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:55:15.653668+0000","last_peered":"2024-09-12T01:55:15.653668+0000","last_clean":"2024-09-12T01:55:15.653668+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:55:15.653668+0000","last_undegraded":"2024-09-12T01:55:15.653668+0000","last_fullsized":"2024-09-12T01:55:15.653668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.596967+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:55:08.596967+0000","last_peered":"2024-09-12T01:55:08.596967+0000","last_clean":"2024-09-12T01:55:08.596967+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:55:08.596967+0000","last_undegraded":"2024-09-12T01:55:08.596967+0000","last_fullsized":"2024-09-12T01:55:08.596967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.652917+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:55:15.652917+0000","last_peered":"2024-09-12T01:55:15.652917+0000","last_clean":"2024-09-12T01:55:15.652917+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:55:15.652917+0000","last_undegraded":"2024-09-12T01:55:15.652917+0000","last_fullsized":"2024-09-12T01:55:15.652917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.589164+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:55:08.589164+0000","last_peered":"2024-09-12T01:55:08.589164+0000","last_clean":"2024-09-12T01:55:08.589164+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:55:08.589164+0000","last_undegraded":"2024-09-12T01:55:08.589164+0000","last_fullsized":"2024-09-12T01:55:08.589164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597532+0000","last_change":"2024-09-12T01:55:05.543774+0000","last_active":"2024-09-12T01:55:08.597532+0000","last_peered":"2024-09-12T01:55:08.597532+0000","last_clean":"2024-09-12T01:55:08.597532+0000","last_became_active":"2024-09-12T01:55:05.543418+0000","last_became_peered":"2024-09-12T01:55:05.543418+0000","last_unstale":"2024-09-12T01:55:08.597532+0000","last_undegraded":"2024-09-12T01:55:08.597532+0000","last_fullsized":"2024-09-12T01:55:08.597532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.058102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592290+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:55:08.592290+0000","last_peered":"2024-09-12T01:55:08.592290+0000","last_clean":"2024-09-12T01:55:08.592290+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:55:08.592290+0000","last_undegraded":"2024-09-12T01:55:08.592290+0000","last_fullsized":"2024-09-12T01:55:08.592290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:15.654240+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:55:15.654240+0000","last_peered":"2024-09-12T01:55:15.654240+0000","last_clean":"2024-09-12T01:55:15.654240+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:55:15.654240+0000","last_undegraded":"2024-09-12T01:55:15.654240+0000","last_fullsized":"2024-09-12T01:55:15.654240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.600465+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:55:08.600465+0000","last_peered":"2024-09-12T01:55:08.600465+0000","last_clean":"2024-09-12T01:55:08.600465+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:55:08.600465+0000","last_undegraded":"2024-09-12T01:55:08.600465+0000","last_fullsized":"2024-09-12T01:55:08.600465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597896+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:55:08.597896+0000","last_peered":"2024-09-12T01:55:08.597896+0000","last_clean":"2024-09-12T01:55:08.597896+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:55:08.597896+0000","last_undegraded":"2024-09-12T01:55:08.597896+0000","last_fullsized":"2024-09-12T01:55:08.597896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.604021+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:55:08.604021+0000","last_peered":"2024-09-12T01:55:08.604021+0000","last_clean":"2024-09-12T01:55:08.604021+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:55:08.604021+0000","last_undegraded":"2024-09-12T01:55:08.604021+0000","last_fullsized":"2024-09-12T01:55:08.604021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.597413+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:55:08.597413+0000","last_peered":"2024-09-12T01:55:08.597413+0000","last_clean":"2024-09-12T01:55:08.597413+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:55:08.597413+0000","last_undegraded":"2024-09-12T01:55:08.597413+0000","last_fullsized":"2024-09-12T01:55:08.597413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.663297+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:55:16.663297+0000","last_peered":"2024-09-12T01:55:16.663297+0000","last_clean":"2024-09-12T01:55:16.663297+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:55:16.663297+0000","last_undegraded":"2024-09-12T01:55:16.663297+0000","last_fullsized":"2024-09-12T01:55:16.663297+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.598720+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:55:08.598720+0000","last_peered":"2024-09-12T01:55:08.598720+0000","last_clean":"2024-09-12T01:55:08.598720+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:55:08.598720+0000","last_undegraded":"2024-09-12T01:55:08.598720+0000","last_fullsized":"2024-09-12T01:55:08.598720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.602545+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:55:08.602545+0000","last_peered":"2024-09-12T01:55:08.602545+0000","last_clean":"2024-09-12T01:55:08.602545+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:55:08.602545+0000","last_undegraded":"2024-09-12T01:55:08.602545+0000","last_fullsized":"2024-09-12T01:55:08.602545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:08.592689+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:55:08.592689+0000","last_peered":"2024-09-12T01:55:08.592689+0000","last_clean":"2024-09-12T01:55:08.592689+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:55:08.592689+0000","last_undegraded":"2024-09-12T01:55:08.592689+0000","last_fullsized":"2024-09-12T01:55:08.592689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:55:16.663119+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:55:16.663119+0000","last_peered":"2024-09-12T01:55:16.663119+0000","last_clean":"2024-09-12T01:55:16.663119+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:55:16.663119+0000","last_undegraded":"2024-09-12T01:55:16.663119+0000","last_fullsized":"2024-09-12T01:55:16.663119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58448,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":129,"num_read_kb":125,"num_write":152,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":421398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1067324,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":888832,"data_stored":421634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234017,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":421554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495655,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":1013486,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659179,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":421023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1013170,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":880640,"data_stored":421460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":421334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444097,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":469361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":475261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":422294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:55:35.995 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:55:35.996 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T01:55:35.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:55:36.254 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.754+0000 7f663854e640 1 -- 172.21.15.39:0/120429290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630104fc0 msgr2=0x7f66301073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.754+0000 7f663854e640 1 --2- 172.21.15.39:0/120429290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630104fc0 0x7f66301073b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6624009900 tx=0x7f662402a410 comp rx=0 tx=0).stop 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 -- 172.21.15.39:0/120429290 shutdown_connections 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 --2- 172.21.15.39:0/120429290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f6630109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 --2- 172.21.15.39:0/120429290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630104fc0 0x7f66301073b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 --2- 172.21.15.39:0/120429290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630102690 0x7f6630104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 -- 172.21.15.39:0/120429290 >> 172.21.15.39:0/120429290 conn(0x7f66300fc290 msgr2=0x7f66300fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 -- 172.21.15.39:0/120429290 shutdown_connections 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 -- 172.21.15.39:0/120429290 wait complete. 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 Processor -- start 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.755+0000 7f663854e640 1 -- start start 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630104fc0 0x7f6630198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f663019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f663010d870 con 0x7f6630102690 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f663010d6f0 con 0x7f6630104fc0 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f663854e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f663010d9f0 con 0x7f66301078f0 2024-09-12T01:55:36.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52740/0 (socket says 172.21.15.39:52740) 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 -- 172.21.15.39:0/1490659643 learned_addr learned my addr 172.21.15.39:0/1490659643 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f6635ae9640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630104fc0 0x7f6630198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f6636aeb640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f663019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 -- 172.21.15.39:0/1490659643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 msgr2=0x7f663019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f663019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 -- 172.21.15.39:0/1490659643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630104fc0 msgr2=0x7f6630198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630104fc0 0x7f6630198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 -- 172.21.15.39:0/1490659643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663019fb00 con 0x7f6630102690 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f6636aeb640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f663019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f66362ea640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f662800c890 tx=0x7f662800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.756+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628004220 con 0x7f6630102690 2024-09-12T01:55:36.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.757+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663019fdf0 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.757+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66280043c0 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.757+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628004a00 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.757+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66301a0240 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.758+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66300fdd80 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.760+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f66280079b0 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.760+0000 7f662f7fe640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 0x7f66180a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.760+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f66280cf050 con 0x7f6630102690 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.760+0000 7f6635ae9640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 0x7f66180a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.761+0000 7f6635ae9640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 0x7f66180a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:36.764+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6628014030 con 0x7f6630102690 2024-09-12T01:55:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:36 smithi172 ceph-mon[35073]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-09-12T01:55:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:36 smithi172 ceph-mon[35073]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:37.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.006+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f663002d7c0 con 0x7f6630102690 2024-09-12T01:55:37.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:36 smithi039 ceph-mon[31204]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-09-12T01:55:37.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:36 smithi039 ceph-mon[31204]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:37.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.009+0000 7f662f7fe640 1 -- 172.21.15.39:0/1490659643 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f662809c000 con 0x7f6630102690 2024-09-12T01:55:37.010 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-09-12T01:55:37.010 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQAZSuJm6/2EABAAH5ykeFIX4ZmGNgc2IxwODg== 2024-09-12T01:55:37.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.011+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 msgr2=0x7f66180a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:37.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.011+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 0x7f66180a5100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6624005ab0 tx=0x7f6624000bc0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.011+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 msgr2=0x7f6630197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:37.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.011+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f662800c890 tx=0x7f662800cd50 comp rx=0 tx=0).stop 2024-09-12T01:55:37.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 shutdown_connections 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f66180a2c40 0x7f66180a5100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66301078f0 0x7f663019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6630104fc0 0x7f6630198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 --2- 172.21.15.39:0/1490659643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6630102690 0x7f6630197ed0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 >> 172.21.15.39:0/1490659643 conn(0x7f66300fc290 msgr2=0x7f6630102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 shutdown_connections 2024-09-12T01:55:37.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:37.012+0000 7f663854e640 1 -- 172.21.15.39:0/1490659643 wait complete. 2024-09-12T01:55:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:36 smithi044 ceph-mon[35259]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-09-12T01:55:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:36 smithi044 ceph-mon[35259]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:55:37.802 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:55:37.802 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T01:55:37.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:55:37.842 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:55:37.842 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:55:37.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T01:55:38.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:55:38.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:38.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:37 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:55:38.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:37 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:55:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:37 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:55:38.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:37 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1490659643' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 -- 172.21.15.39:0/2122397109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8106f10 msgr2=0x7f84f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 --2- 172.21.15.39:0/2122397109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8106f10 0x7f84f810ea90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009ca0 tx=0x7f84f002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 -- 172.21.15.39:0/2122397109 shutdown_connections 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 --2- 172.21.15.39:0/2122397109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8106f10 0x7f84f810ea90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 --2- 172.21.15.39:0/2122397109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8102790 0x7f84f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 --2- 172.21.15.39:0/2122397109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8101de0 0x7f84f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 -- 172.21.15.39:0/2122397109 >> 172.21.15.39:0/2122397109 conn(0x7f84f80fd8c0 msgr2=0x7f84f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 -- 172.21.15.39:0/2122397109 shutdown_connections 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.659+0000 7f84fdad0640 1 -- 172.21.15.39:0/2122397109 wait complete. 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.660+0000 7f84fdad0640 1 Processor -- start 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.660+0000 7f84fdad0640 1 -- start start 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.660+0000 7f84fdad0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.660+0000 7f84fdad0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8102790 0x7f84f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.660+0000 7f84fdad0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 0x7f84f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84fdad0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8111f70 con 0x7f84f8101de0 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84fdad0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84f8111df0 con 0x7f84f8102790 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84fdad0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84f81120f0 con 0x7f84f8106f10 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52770/0 (socket says 172.21.15.39:52770) 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 -- 172.21.15.39:0/3995482267 learned_addr learned my addr 172.21.15.39:0/3995482267 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f6ffd640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8102790 0x7f84f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f7fff640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 0x7f84f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 -- 172.21.15.39:0/3995482267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 msgr2=0x7f84f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 0x7f84f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 -- 172.21.15.39:0/3995482267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8102790 msgr2=0x7f84f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8102790 0x7f84f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 -- 172.21.15.39:0/3995482267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f81a6800 con 0x7f84f8101de0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f7fff640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 0x7f84f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f77fe640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f84e800d950 tx=0x7f84e800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8017070 con 0x7f84f8101de0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f81a6af0 con 0x7f84f8101de0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e800de80 con 0x7f84f8101de0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.661+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e800f620 con 0x7f84f8101de0 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.662+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f81a7030 con 0x7f84f8101de0 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.663+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f81021c0 con 0x7f84f8101de0 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.664+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f84e8009c30 con 0x7f84f8101de0 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.664+0000 7f84f4ff9640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 0x7f84e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.665+0000 7f84f6ffd640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 0x7f84e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.665+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f84e80cec90 con 0x7f84f8101de0 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.665+0000 7f84f6ffd640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 0x7f84e00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84f8075f80 tx=0x7f84ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.669+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84e809bc40 con 0x7f84f8101de0 2024-09-12T01:55:38.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.890+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f84f8075a20 con 0x7f84f8101de0 2024-09-12T01:55:38.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:38 smithi039 ceph-mon[31204]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T01:55:38.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.896+0000 7f84f4ff9640 1 -- 172.21.15.39:0/3995482267 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263196 (secure 0 0 0) 0x7f84e809b540 con 0x7f84f8101de0 2024-09-12T01:55:38.900 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.898+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 msgr2=0x7f84e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.898+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 0x7f84e00a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84f8075f80 tx=0x7f84ec00a2d0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.898+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 msgr2=0x7f84f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.898+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f84e800d950 tx=0x7f84e800dd50 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 shutdown_connections 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84e00a2c10 0x7f84e00a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84f8106f10 0x7f84f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f8102790 0x7f84f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 --2- 172.21.15.39:0/3995482267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84f8101de0 0x7f84f80744f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 >> 172.21.15.39:0/3995482267 conn(0x7f84f80fd8c0 msgr2=0x7f84f80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 shutdown_connections 2024-09-12T01:55:38.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:38.899+0000 7f84fdad0640 1 -- 172.21.15.39:0/3995482267 wait complete. 2024-09-12T01:55:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:38 smithi044 ceph-mon[35259]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T01:55:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:38 smithi172 ceph-mon[35073]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T01:55:39.566 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":571724551},{"type":"v1","addr":"172.21.15.39:6801","nonce":571724551}]},"active_addr":"172.21.15.39:6801/571724551","active_change":"2024-09-12T01:48:03.155672+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.39:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2597866499}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2590649112}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1825046745}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":494997534}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":818518922}]}]} 2024-09-12T01:55:39.572 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T01:55:39.572 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T01:55:39.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:39.835 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:39.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:39 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3995482267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:55:40.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:39 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3995482267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:55:40.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:39 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3995482267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:55:40.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- 172.21.15.39:0/1567844264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 msgr2=0x7fa3c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:40.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/1567844264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c4106e60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009930 tx=0x7fa3c002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- 172.21.15.39:0/1567844264 shutdown_connections 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/1567844264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/1567844264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 0x7fa3c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/1567844264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c4106e60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- 172.21.15.39:0/1567844264 >> 172.21.15.39:0/1567844264 conn(0x7fa3c40fc7a0 msgr2=0x7fa3c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- 172.21.15.39:0/1567844264 shutdown_connections 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- 172.21.15.39:0/1567844264 wait complete. 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 Processor -- start 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.292+0000 7fa3cb20b640 1 -- start start 2024-09-12T01:55:40.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 0x7fa3c4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4110e80 con 0x7fa3c4106a80 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4110d00 con 0x7fa3c4101420 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3cb20b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4111000 con 0x7fa3c4100a80 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52782/0 (socket says 172.21.15.39:52782) 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 -- 172.21.15.39:0/2066131567 learned_addr learned my addr 172.21.15.39:0/2066131567 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c8fa7640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 0x7fa3c4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3bbfff640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 -- 172.21.15.39:0/2066131567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 msgr2=0x7fa3c4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:40.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 0x7fa3c4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 -- 172.21.15.39:0/2066131567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 msgr2=0x7fa3c4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 -- 172.21.15.39:0/2066131567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c419d400 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3bbfff640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3c97a8640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00cad0 tx=0x7fa3bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.293+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00ae20 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.294+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3bc005020 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.294+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c419d6f0 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.294+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00f6f0 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.294+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c41a4fd0 con 0x7fa3c4106a80 2024-09-12T01:55:40.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.295+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c4100ee0 con 0x7fa3c4106a80 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.296+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa3bc0051d0 con 0x7fa3c4106a80 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.297+0000 7fa3b9ffb640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 0x7fa3ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.297+0000 7fa3c8fa7640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 0x7fa3ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.297+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa3bc0cefa0 con 0x7fa3c4106a80 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.297+0000 7fa3c8fa7640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 0x7fa3ac0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009900 tx=0x7fa3c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:40.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.301+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3bc014030 con 0x7fa3c4106a80 2024-09-12T01:55:40.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.478+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3c41a5290 con 0x7fa3c4106a80 2024-09-12T01:55:40.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.479+0000 7fa3b9ffb640 1 -- 172.21.15.39:0/2066131567 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22245 (secure 0 0 0) 0x7fa3bc09bf50 con 0x7fa3c4106a80 2024-09-12T01:55:40.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:40.481 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":80,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:55:08.326279+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 msgr2=0x7fa3ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 0x7fa3ac0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009900 tx=0x7fa3c00058d0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 msgr2=0x7fa3c419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00cad0 tx=0x7fa3bc00cf90 comp rx=0 tx=0).stop 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 shutdown_connections 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3c4106a80 0x7fa3c419cd20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3c4101420 0x7fa3c4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3ac0a2c90 0x7fa3ac0a5150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 --2- 172.21.15.39:0/2066131567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3c4100a80 0x7fa3c4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:40.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 >> 172.21.15.39:0/2066131567 conn(0x7fa3c40fc7a0 msgr2=0x7fa3c4104ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:40.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 shutdown_connections 2024-09-12T01:55:40.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:40.482+0000 7fa3cb20b640 1 -- 172.21.15.39:0/2066131567 wait complete. 2024-09-12T01:55:41.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:40 smithi039 ceph-mon[31204]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T01:55:41.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:40 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2066131567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:40 smithi044 ceph-mon[35259]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T01:55:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:40 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2066131567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:40 smithi172 ceph-mon[35073]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-12T01:55:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:40 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2066131567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:41.302 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T01:55:41.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:55:41.563 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:42.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/3460449227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8106a80 msgr2=0x7fbbb8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/3460449227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8106a80 0x7fbbb8106e60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009930 tx=0x7fbba802a420 comp rx=0 tx=0).stop 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/3460449227 shutdown_connections 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/3460449227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8101420 0x7fbbb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/3460449227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/3460449227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8106a80 0x7fbbb8106e60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/3460449227 >> 172.21.15.39:0/3460449227 conn(0x7fbbb80fc7a0 msgr2=0x7fbbb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/3460449227 shutdown_connections 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.020+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/3460449227 wait complete. 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 Processor -- start 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 -- start start 2024-09-12T01:55:42.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 0x7fbbb819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8110ea0 con 0x7fbbb8101420 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8110d20 con 0x7fbbb8106a80 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbbd5fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8111020 con 0x7fbbb8100a80 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbae7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbae7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52798/0 (socket says 172.21.15.39:52798) 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbae7fc640 1 -- 172.21.15.39:0/1659594359 learned_addr learned my addr 172.21.15.39:0/1659594359 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.021+0000 7fbbb77fe640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 0x7fbbb819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb6ffd640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 -- 172.21.15.39:0/1659594359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 msgr2=0x7fbbb81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 -- 172.21.15.39:0/1659594359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 msgr2=0x7fbbb819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 0x7fbbb819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 -- 172.21.15.39:0/1659594359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb819d480 con 0x7fbbb8101420 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb6ffd640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb77fe640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 0x7fbbb819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbae7fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c890 tx=0x7fbba000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0004220 con 0x7fbbb8101420 2024-09-12T01:55:42.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba00043c0 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb819d770 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00049e0 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.022+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb81a5050 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.023+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb8100ee0 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.024+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbba00079b0 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.025+0000 7fbbb4ff9640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 0x7fbba40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.025+0000 7fbbb6ffd640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 0x7fbba40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.025+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbba00cf0f0 con 0x7fbbb8101420 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.025+0000 7fbbb6ffd640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 0x7fbba40a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000c00 tx=0x7fbba8032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.029+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbba0014030 con 0x7fbbb8101420 2024-09-12T01:55:42.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.204+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbb81a53e0 con 0x7fbbb8101420 2024-09-12T01:55:42.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.206+0000 7fbbb4ff9640 1 -- 172.21.15.39:0/1659594359 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22245 (secure 0 0 0) 0x7fbba009c0a0 con 0x7fbbb8101420 2024-09-12T01:55:42.207 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:55:42.207 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":80,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:55:08.326279+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 msgr2=0x7fbba40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 0x7fbba40a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbba8000c00 tx=0x7fbba8032d50 comp rx=0 tx=0).stop 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 msgr2=0x7fbbb8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c890 tx=0x7fbba000cd50 comp rx=0 tx=0).stop 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 shutdown_connections 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb8106a80 0x7fbbb819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbb8101420 0x7fbbb8198a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbba40a2c90 0x7fbba40a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 --2- 172.21.15.39:0/1659594359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb8100a80 0x7fbbb81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 >> 172.21.15.39:0/1659594359 conn(0x7fbbb80fc7a0 msgr2=0x7fbbb806a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 shutdown_connections 2024-09-12T01:55:42.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:42.208+0000 7fbbbd5fc640 1 -- 172.21.15.39:0/1659594359 wait complete. 2024-09-12T01:55:42.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:42 smithi039 ceph-mon[31204]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-12T01:55:42.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:42 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1659594359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:43.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T01:55:43.026 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T01:55:43.026 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T01:55:43.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T01:55:43.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T01:55:43.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T01:55:43.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T01:55:43.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T01:55:43.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T01:55:43.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T01:55:43.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T01:55:43.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T01:55:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:42 smithi044 ceph-mon[35259]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-12T01:55:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:42 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1659594359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:42 smithi172 ceph-mon[35073]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-12T01:55:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:42 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1659594359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:43.744 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:43.777 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 -- 172.21.15.39:0/3932101390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64100a80 msgr2=0x7f7e64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 --2- 172.21.15.39:0/3932101390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64100a80 0x7f7e64100ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009930 tx=0x7f7e4c02a420 comp rx=0 tx=0).stop 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 -- 172.21.15.39:0/3932101390 shutdown_connections 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 --2- 172.21.15.39:0/3932101390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e64101420 0x7f7e6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 --2- 172.21.15.39:0/3932101390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64100a80 0x7f7e64100ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 --2- 172.21.15.39:0/3932101390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64106a80 0x7f7e64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 -- 172.21.15.39:0/3932101390 >> 172.21.15.39:0/3932101390 conn(0x7f7e640fc7a0 msgr2=0x7f7e640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 -- 172.21.15.39:0/3932101390 shutdown_connections 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.299+0000 7f7e6916f640 1 -- 172.21.15.39:0/3932101390 wait complete. 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.300+0000 7f7e6916f640 1 Processor -- start 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.300+0000 7f7e6916f640 1 -- start start 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.300+0000 7f7e6916f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64100a80 0x7f7e6419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 0x7f7e6419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e64106a80 0x7f7e6419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64110ea0 con 0x7f7e64101420 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64110d20 con 0x7f7e64100a80 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64111020 con 0x7f7e64106a80 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 0x7f7e6419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 0x7f7e6419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59516/0 (socket says 172.21.15.39:59516) 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 -- 172.21.15.39:0/4111166289 learned_addr learned my addr 172.21.15.39:0/4111166289 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e62d9d640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64100a80 0x7f7e6419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 -- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e64106a80 msgr2=0x7f7e6419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6359e640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e64106a80 0x7f7e6419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e64106a80 0x7f7e6419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 -- 172.21.15.39:0/4111166289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64100a80 msgr2=0x7f7e6419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64100a80 0x7f7e6419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6419f6e0 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e62d9d640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e64100a80 0x7f7e6419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6259c640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 0x7f7e6419ac70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009230 tx=0x7f7e4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c03f030 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6419f970 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c003ad0 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c035070 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.301+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641a72b0 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.302+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e6406b1b0 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.304+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7e4c042030 con 0x7f7e64101420 2024-09-12T01:55:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e5bfff640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e500a2c10 0x7f7e500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e62d9d640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e500a2c10 0x7f7e500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7e4c0ef930 con 0x7f7e64101420 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e5bfff640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] conn(0x7f7e500ac460 0x7f7e500ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e500aef30 con 0x7f7e500ac460 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c0efe10 con 0x7f7e64101420 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e62d9d640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e500a2c10 0x7f7e500a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e54005d00 tx=0x7f7e5400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.305+0000 7f7e6359e640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] conn(0x7f7e500ac460 0x7f7e500ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.306+0000 7f7e6359e640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] conn(0x7f7e500ac460 0x7f7e500ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.307+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== osd.5 v2:172.21.15.172:6808/104325530 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e500aef30 con 0x7f7e500ac460 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.320+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 --> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e641021c0 con 0x7f7e500ac460 2024-09-12T01:55:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e5bfff640 1 -- 172.21.15.39:0/4111166289 <== osd.5 v2:172.21.15.172:6808/104325530 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7e641021c0 con 0x7f7e500ac460 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] conn(0x7f7e500ac460 msgr2=0x7f7e500ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] conn(0x7f7e500ac460 0x7f7e500ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e500a2c10 msgr2=0x7f7e500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e500a2c10 0x7f7e500a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e54005d00 tx=0x7f7e5400b410 comp rx=0 tx=0).stop 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 msgr2=0x7f7e6419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6916f640 1 --2- 172.21.15.39:0/4111166289 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e64101420 0x7f7e6419ac70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009230 tx=0x7f7e4c004270 comp rx=0 tx=0).stop 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.321+0000 7f7e6359e640 1 -- 172.21.15.39:0/4111166289 reap_dead start 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.322+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 shutdown_connections 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.322+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 >> 172.21.15.39:0/4111166289 conn(0x7f7e640fc7a0 msgr2=0x7f7e6406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.322+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 shutdown_connections 2024-09-12T01:55:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:44.322+0000 7f7e6916f640 1 -- 172.21.15.39:0/4111166289 wait complete. 2024-09-12T01:55:44.549 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.550 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.550 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.550 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.551 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:45.074 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:44 smithi039 ceph-mon[31204]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T01:55:45.081 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:45.082 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:45.082 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:45.083 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:45.125 INFO:teuthology.orchestra.run.smithi039.stdout:146028888115 2024-09-12T01:55:45.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T01:55:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:44 smithi044 ceph-mon[35259]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T01:55:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:44 smithi172 ceph-mon[35073]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T01:55:46.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 -- 172.21.15.39:0/352181461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc106f10 msgr2=0x7f1ffc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 --2- 172.21.15.39:0/352181461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc106f10 0x7f1ffc10ea90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009ca0 tx=0x7f1ff402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 -- 172.21.15.39:0/352181461 shutdown_connections 2024-09-12T01:55:46.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 --2- 172.21.15.39:0/352181461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc106f10 0x7f1ffc10ea90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 --2- 172.21.15.39:0/352181461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc102790 0x7f1ffc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 --2- 172.21.15.39:0/352181461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 -- 172.21.15.39:0/352181461 >> 172.21.15.39:0/352181461 conn(0x7f1ffc0fd8c0 msgr2=0x7f1ffc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 -- 172.21.15.39:0/352181461 shutdown_connections 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.034+0000 7f200260c640 1 -- 172.21.15.39:0/352181461 wait complete. 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 Processor -- start 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 -- start start 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc102790 0x7f1ffc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc106f10 0x7f1ffc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc111f70 con 0x7f1ffc101de0 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc111df0 con 0x7f1ffc106f10 2024-09-12T01:55:46.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f200260c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc1120f0 con 0x7f1ffc102790 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59534/0 (socket says 172.21.15.39:59534) 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f1ffbfff640 1 -- 172.21.15.39:0/3193637483 learned_addr learned my addr 172.21.15.39:0/3193637483 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f1ff3fff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc102790 0x7f1ffc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f2000ba9640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc106f10 0x7f1ffc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.035+0000 7f1ffbfff640 1 -- 172.21.15.39:0/3193637483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc102790 msgr2=0x7f1ffc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ffbfff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc102790 0x7f1ffc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ffbfff640 1 -- 172.21.15.39:0/3193637483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc106f10 msgr2=0x7f1ffc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ffbfff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc106f10 0x7f1ffc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ffbfff640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc19d360 con 0x7f1ffc101de0 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f2000ba9640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc106f10 0x7f1ffc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ffbfff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1983b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00d770 tx=0x7f1fec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:46.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec017070 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fec005500 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc19d650 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec004e00 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.036+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc1a4f30 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.037+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ffc0fef00 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.038+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1fec004fa0 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff9ffb640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1fe80a2c90 0x7f1fe80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff3fff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1fe80a2c90 0x7f1fe80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f1fec0cf030 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff9ffb640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] conn(0x7f1fe80ac4e0 0x7f1fe80ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fec001d30 con 0x7f1fe80ac4e0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f1fec0cf420 con 0x7f1ffc101de0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f2000ba9640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] conn(0x7f1fe80ac4e0 0x7f1fe80ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:46.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.039+0000 7f1ff3fff640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1fe80a2c90 0x7f1fe80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0fe130 tx=0x7f1fe400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:46.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.040+0000 7f2000ba9640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] conn(0x7f1fe80ac4e0 0x7f1fe80ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:46.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.040+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== osd.6 v2:172.21.15.39:6818/3666498594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fec001d30 con 0x7f1fe80ac4e0 2024-09-12T01:55:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.054+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 --> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ffc1032c0 con 0x7f1fe80ac4e0 2024-09-12T01:55:46.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.054+0000 7f1ff9ffb640 1 -- 172.21.15.39:0/3193637483 <== osd.6 v2:172.21.15.39:6818/3666498594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ffc1032c0 con 0x7f1fe80ac4e0 2024-09-12T01:55:46.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] conn(0x7f1fe80ac4e0 msgr2=0x7f1fe80ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] conn(0x7f1fe80ac4e0 0x7f1fe80ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1fe80a2c90 msgr2=0x7f1fe80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1fe80a2c90 0x7f1fe80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0fe130 tx=0x7f1fe400c4a0 comp rx=0 tx=0).stop 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 msgr2=0x7f1ffc1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 --2- 172.21.15.39:0/3193637483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc101de0 0x7f1ffc1983b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00d770 tx=0x7f1fec00dc30 comp rx=0 tx=0).stop 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f2000ba9640 1 -- 172.21.15.39:0/3193637483 reap_dead start 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 shutdown_connections 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 >> 172.21.15.39:0/3193637483 conn(0x7f1ffc0fd8c0 msgr2=0x7f1ffc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 shutdown_connections 2024-09-12T01:55:46.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:46.055+0000 7f200260c640 1 -- 172.21.15.39:0/3193637483 wait complete. 2024-09-12T01:55:46.820 INFO:teuthology.orchestra.run.smithi039.stdout:176093659182 2024-09-12T01:55:46.821 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T01:55:47.039 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:46 smithi039 ceph-mon[31204]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T01:55:47.055 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:46 smithi172 ceph-mon[35073]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T01:55:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:46 smithi044 ceph-mon[35259]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T01:55:47.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 -- 172.21.15.39:0/1478514115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff988102d30 msgr2=0x7ff988103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/1478514115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff988102d30 0x7ff988103110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff980009cd0 tx=0x7ff98002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 -- 172.21.15.39:0/1478514115 shutdown_connections 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/1478514115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9881082a0 0x7ff98810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/1478514115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881036e0 0x7ff988107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/1478514115 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff988102d30 0x7ff988103110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 -- 172.21.15.39:0/1478514115 >> 172.21.15.39:0/1478514115 conn(0x7ff9880fc7d0 msgr2=0x7ff9880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 -- 172.21.15.39:0/1478514115 shutdown_connections 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.306+0000 7ff98c8fd640 1 -- 172.21.15.39:0/1478514115 wait complete. 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.307+0000 7ff98c8fd640 1 Processor -- start 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.307+0000 7ff98c8fd640 1 -- start start 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff988102d30 0x7ff988198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 0x7ff988198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881082a0 0x7ff98819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9881120a0 con 0x7ff9881036e0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff988111f20 con 0x7ff988102d30 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98c8fd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff988112220 con 0x7ff9881082a0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 0x7ff988198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 0x7ff988198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59546/0 (socket says 172.21.15.39:59546) 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 -- 172.21.15.39:0/3604392798 learned_addr learned my addr 172.21.15.39:0/3604392798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff98659c640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff988102d30 0x7ff988198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff986d9d640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881082a0 0x7ff98819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 -- 172.21.15.39:0/3604392798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881082a0 msgr2=0x7ff98819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881082a0 0x7ff98819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 -- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff988102d30 msgr2=0x7ff988198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff988102d30 0x7ff988198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98819d4e0 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff986d9d640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9881082a0 0x7ff98819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff985d9b640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 0x7ff988198a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff97000c8c0 tx=0x7ff97000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970007bb0 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.308+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff970007d50 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.309+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98819d7d0 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.309+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970018830 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.309+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9881a50b0 con 0x7ff9881036e0 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.309+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff988062900 con 0x7ff9881036e0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.311+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff9700189d0 con 0x7ff9881036e0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff97f7fe640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9740a2c10 0x7ff9740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff98659c640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9740a2c10 0x7ff9740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff9700cf540 con 0x7ff9881036e0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff97f7fe640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] conn(0x7ff9740ac460 0x7ff9740ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9740aef30 con 0x7ff9740ac460 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff9700cfa20 con 0x7ff9881036e0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff98659c640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9740a2c10 0x7ff9740a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff980006010 tx=0x7ff980009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.312+0000 7ff986d9d640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] conn(0x7ff9740ac460 0x7ff9740ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.313+0000 7ff986d9d640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] conn(0x7ff9740ac460 0x7ff9740ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.314+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== osd.1 v2:172.21.15.44:6800/2339719980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9740aef30 con 0x7ff9740ac460 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.327+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 --> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff988062d80 con 0x7ff9740ac460 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff97f7fe640 1 -- 172.21.15.39:0/3604392798 <== osd.1 v2:172.21.15.44:6800/2339719980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff988062d80 con 0x7ff9740ac460 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] conn(0x7ff9740ac460 msgr2=0x7ff9740ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] conn(0x7ff9740ac460 0x7ff9740ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9740a2c10 msgr2=0x7ff9740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9740a2c10 0x7ff9740a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff980006010 tx=0x7ff980009900 comp rx=0 tx=0).stop 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 msgr2=0x7ff988198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 --2- 172.21.15.39:0/3604392798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff9881036e0 0x7ff988198a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff97000c8c0 tx=0x7ff97000cd80 comp rx=0 tx=0).stop 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff986d9d640 1 -- 172.21.15.39:0/3604392798 reap_dead start 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 shutdown_connections 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 >> 172.21.15.39:0/3604392798 conn(0x7ff9880fc7d0 msgr2=0x7ff988105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 shutdown_connections 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:47.328+0000 7ff98c8fd640 1 -- 172.21.15.39:0/3604392798 wait complete. 2024-09-12T01:55:47.568 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2528473986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba8101df0 msgr2=0x7fcba81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2528473986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba8101df0 0x7fcba81021d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009900 tx=0x7fcba002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2528473986 shutdown_connections 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2528473986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcba8106f20 0x7fcba810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2528473986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcba81027a0 0x7fcba81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2528473986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba8101df0 0x7fcba81021d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.473+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2528473986 >> 172.21.15.39:0/2528473986 conn(0x7fcba80fd8f0 msgr2=0x7fcba80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.474+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2528473986 shutdown_connections 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.474+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2528473986 wait complete. 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.474+0000 7fcbad6a9640 1 Processor -- start 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.474+0000 7fcbad6a9640 1 -- start start 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcba8101df0 0x7fcba8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 0x7fcba81988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcba8106f20 0x7fcba819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8111f80 con 0x7fcba81027a0 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8111e00 con 0x7fcba8101df0 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcbad6a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcba8112100 con 0x7fcba8106f20 2024-09-12T01:55:48.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 0x7fcba81988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 0x7fcba81988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59560/0 (socket says 172.21.15.39:59560) 2024-09-12T01:55:48.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 -- 172.21.15.39:0/2737645276 learned_addr learned my addr 172.21.15.39:0/2737645276 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:48.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba6ffd640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcba8101df0 0x7fcba8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba77fe640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcba8106f20 0x7fcba819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 -- 172.21.15.39:0/2737645276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcba8106f20 msgr2=0x7fcba819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcba8106f20 0x7fcba819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 -- 172.21.15.39:0/2737645276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcba8101df0 msgr2=0x7fcba8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcba8101df0 0x7fcba8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba819d330 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.475+0000 7fcba67fc640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 0x7fcba81988c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c920 tx=0x7fcb9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.476+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90007c70 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.476+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba819d620 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.476+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb90007e10 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.476+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb90018890 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.476+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba81a4f00 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.477+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcba8062940 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.478+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcb90018a70 con 0x7fcba81027a0 2024-09-12T01:55:48.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.478+0000 7fcb9ffff640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcb940a2c10 0x7fcb940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcba6ffd640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcb940a2c10 0x7fcb940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcb900cf170 con 0x7fcba81027a0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcb9ffff640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] conn(0x7fcb940ac460 0x7fcb940ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb90012ec0 con 0x7fcb940ac460 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fcb900d6050 con 0x7fcba81027a0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcba77fe640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] conn(0x7fcb940ac460 0x7fcb940ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcba6ffd640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcb940a2c10 0x7fcb940a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.479+0000 7fcba77fe640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] conn(0x7fcb940ac460 0x7fcb940ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.480+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== osd.0 v2:172.21.15.39:6802/2221897702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb90012ec0 con 0x7fcb940ac460 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 --> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcba8062d40 con 0x7fcb940ac460 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcb9ffff640 1 -- 172.21.15.39:0/2737645276 <== osd.0 v2:172.21.15.39:6802/2221897702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcba8062d40 con 0x7fcb940ac460 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] conn(0x7fcb940ac460 msgr2=0x7fcb940ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] conn(0x7fcb940ac460 0x7fcb940ae880 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcb940a2c10 msgr2=0x7fcb940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcb940a2c10 0x7fcb940a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba00058d0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 msgr2=0x7fcba81988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 --2- 172.21.15.39:0/2737645276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcba81027a0 0x7fcba81988c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c920 tx=0x7fcb9000cde0 comp rx=0 tx=0).stop 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcba77fe640 1 -- 172.21.15.39:0/2737645276 reap_dead start 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 shutdown_connections 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 >> 172.21.15.39:0/2737645276 conn(0x7fcba80fd8f0 msgr2=0x7fcba80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 shutdown_connections 2024-09-12T01:55:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:48.494+0000 7fcbad6a9640 1 -- 172.21.15.39:0/2737645276 wait complete. 2024-09-12T01:55:49.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:48 smithi039 ceph-mon[31204]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:48 smithi044 ceph-mon[35259]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- 172.21.15.39:0/2672950030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f940010e480 msgr2=0x7f9400110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 --2- 172.21.15.39:0/2672950030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f940010e480 0x7f9400110870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009ca0 tx=0x7f93f802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- 172.21.15.39:0/2672950030 shutdown_connections 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 --2- 172.21.15.39:0/2672950030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f940010e480 0x7f9400110870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 --2- 172.21.15.39:0/2672950030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 0x7f940010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 --2- 172.21.15.39:0/2672950030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94001008d0 0x7f9400100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- 172.21.15.39:0/2672950030 >> 172.21.15.39:0/2672950030 conn(0x7f94000fc7a0 msgr2=0x7f94000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- 172.21.15.39:0/2672950030 shutdown_connections 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- 172.21.15.39:0/2672950030 wait complete. 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 Processor -- start 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.181+0000 7f9407eda640 1 -- start start 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 0x7f940019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 0x7f940019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f940010e480 0x7f940019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9400114160 con 0x7f94001008d0 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9400113fe0 con 0x7f940010e480 2024-09-12T01:55:49.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94001142e0 con 0x7f9400101280 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 0x7f940019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 0x7f940019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59578/0 (socket says 172.21.15.39:59578) 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 -- 172.21.15.39:0/2877921169 learned_addr learned my addr 172.21.15.39:0/2877921169 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405475640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 0x7f940019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 -- 172.21.15.39:0/2877921169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 msgr2=0x7f940019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 0x7f940019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 -- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f940010e480 msgr2=0x7f940019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f940010e480 0x7f940019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940019f610 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405475640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9400101280 0x7f940019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9405c76640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 0x7f940019a660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00d950 tx=0x7f93fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc017030 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93fc004020 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0047a0 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940019f900 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.182+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94001a71e0 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.183+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9400062980 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.185+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93fc0041d0 con 0x7f94001008d0 2024-09-12T01:55:49.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.185+0000 7f93f6ffd640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f93ec0a2c90 0x7f93ec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.185+0000 7f9405475640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f93ec0a2c90 0x7f93ec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.185+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f93fc0cf140 con 0x7f94001008d0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f93f6ffd640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] conn(0x7f93ec0ac4e0 0x7f93ec0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93ec0aefb0 con 0x7f93ec0ac4e0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f93fc0cf620 con 0x7f94001008d0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f9405475640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f93ec0a2c90 0x7f93ec0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f93f0005fd0 tx=0x7f93f00094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f9406477640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] conn(0x7f93ec0ac4e0 0x7f93ec0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.186+0000 7f9406477640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] conn(0x7f93ec0ac4e0 0x7f93ec0ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.187+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== osd.4 v2:172.21.15.44:6808/1948738957 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93ec0aefb0 con 0x7f93ec0ac4e0 2024-09-12T01:55:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.201+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 --> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9400062e50 con 0x7f93ec0ac4e0 2024-09-12T01:55:49.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.202+0000 7f93f6ffd640 1 -- 172.21.15.39:0/2877921169 <== osd.4 v2:172.21.15.44:6808/1948738957 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9400062e50 con 0x7f93ec0ac4e0 2024-09-12T01:55:49.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.202+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] conn(0x7f93ec0ac4e0 msgr2=0x7f93ec0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.202+0000 7f9407eda640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] conn(0x7f93ec0ac4e0 0x7f93ec0ae900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f93ec0a2c90 msgr2=0x7f93ec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f93ec0a2c90 0x7f93ec0a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f93f0005fd0 tx=0x7f93f00094d0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 msgr2=0x7f940019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 --2- 172.21.15.39:0/2877921169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94001008d0 0x7f940019a660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00d950 tx=0x7f93fc00de10 comp rx=0 tx=0).stop 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9406477640 1 -- 172.21.15.39:0/2877921169 reap_dead start 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 shutdown_connections 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 >> 172.21.15.39:0/2877921169 conn(0x7f94000fc7a0 msgr2=0x7f94000feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 shutdown_connections 2024-09-12T01:55:49.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.203+0000 7f9407eda640 1 -- 172.21.15.39:0/2877921169 wait complete. 2024-09-12T01:55:49.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:48 smithi172 ceph-mon[35073]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 -- 172.21.15.39:0/1860392748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c106a90 msgr2=0x7f4e2c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 --2- 172.21.15.39:0/1860392748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c106a90 0x7f4e2c106e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009930 tx=0x7f4e1c02a420 comp rx=0 tx=0).stop 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 -- 172.21.15.39:0/1860392748 shutdown_connections 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 --2- 172.21.15.39:0/1860392748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c101430 0x7f4e2c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 --2- 172.21.15.39:0/1860392748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c100a90 0x7f4e2c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 --2- 172.21.15.39:0/1860392748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c106a90 0x7f4e2c106e70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 -- 172.21.15.39:0/1860392748 >> 172.21.15.39:0/1860392748 conn(0x7f4e2c0fc7d0 msgr2=0x7f4e2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 -- 172.21.15.39:0/1860392748 shutdown_connections 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 -- 172.21.15.39:0/1860392748 wait complete. 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.645+0000 7f4e3151f640 1 Processor -- start 2024-09-12T01:55:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 -- start start 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 0x7f4e2c10e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c101430 0x7f4e2c10e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c106a90 0x7f4e2c10ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c111fb0 con 0x7f4e2c100a90 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c111e30 con 0x7f4e2c106a90 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e3151f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c112130 con 0x7f4e2c101430 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 0x7f4e2c10e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 0x7f4e2c10e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59594/0 (socket says 172.21.15.39:59594) 2024-09-12T01:55:49.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 -- 172.21.15.39:0/3210546665 learned_addr learned my addr 172.21.15.39:0/3210546665 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2a7fc640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c101430 0x7f4e2c10e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2b7fe640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c106a90 0x7f4e2c10ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 -- 172.21.15.39:0/3210546665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c101430 msgr2=0x7f4e2c10e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c101430 0x7f4e2c10e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 -- 172.21.15.39:0/3210546665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c106a90 msgr2=0x7f4e2c10ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c106a90 0x7f4e2c10ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c1a68d0 con 0x7f4e2c100a90 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2b7fe640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c106a90 0x7f4e2c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:49.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.646+0000 7f4e2affd640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 0x7f4e2c10e3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009a50 tx=0x7f4e1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c03f030 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c1a6b60 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e1c003ce0 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c035070 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c1a7040 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.647+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e2c062880 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.649+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4e1c042030 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.649+0000 7f4e13fff640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e140a2c10 0x7f4e140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e2a7fc640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e140a2c10 0x7f4e140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4e1c0efad0 con 0x7f4e2c100a90 2024-09-12T01:55:49.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e13fff640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] conn(0x7f4e140ac460 0x7f4e140ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e1c046e50 con 0x7f4e140ac460 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f4e1c0effb0 con 0x7f4e2c100a90 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e2b7fe640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] conn(0x7f4e140ac460 0x7f4e140ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e2a7fc640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e140a2c10 0x7f4e140a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e20005fd0 tx=0x7f4e20005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.650+0000 7f4e2b7fe640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] conn(0x7f4e140ac460 0x7f4e140ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:49.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.651+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== osd.3 v2:172.21.15.39:6810/3975673341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e1c046e50 con 0x7f4e140ac460 2024-09-12T01:55:49.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 --> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e2c062d00 con 0x7f4e140ac460 2024-09-12T01:55:49.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e13fff640 1 -- 172.21.15.39:0/3210546665 <== osd.3 v2:172.21.15.39:6810/3975673341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e2c062d00 con 0x7f4e140ac460 2024-09-12T01:55:49.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] conn(0x7f4e140ac460 msgr2=0x7f4e140ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] conn(0x7f4e140ac460 0x7f4e140ae880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:49.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e140a2c10 msgr2=0x7f4e140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4e140a2c10 0x7f4e140a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e20005fd0 tx=0x7f4e20005e20 comp rx=0 tx=0).stop 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 msgr2=0x7f4e2c10e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 --2- 172.21.15.39:0/3210546665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e2c100a90 0x7f4e2c10e3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009a50 tx=0x7f4e1c004270 comp rx=0 tx=0).stop 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e2b7fe640 1 -- 172.21.15.39:0/3210546665 reap_dead start 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 shutdown_connections 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.665+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 >> 172.21.15.39:0/3210546665 conn(0x7f4e2c0fc7d0 msgr2=0x7f4e2c0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.666+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 shutdown_connections 2024-09-12T01:55:49.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:49.666+0000 7f4e3151f640 1 -- 172.21.15.39:0/3210546665 wait complete. 2024-09-12T01:55:50.138 INFO:teuthology.orchestra.run.smithi039.stdout:55834574921 2024-09-12T01:55:50.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 -- 172.21.15.39:0/111439766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 msgr2=0x7fd348100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 --2- 172.21.15.39:0/111439766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348100ee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd334009930 tx=0x7fd33402a420 comp rx=0 tx=0).stop 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 -- 172.21.15.39:0/111439766 shutdown_connections 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 --2- 172.21.15.39:0/111439766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 0x7fd34810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 --2- 172.21.15.39:0/111439766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348100ee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 --2- 172.21.15.39:0/111439766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd348106a80 0x7fd348106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 -- 172.21.15.39:0/111439766 >> 172.21.15.39:0/111439766 conn(0x7fd3480fc7a0 msgr2=0x7fd3480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 -- 172.21.15.39:0/111439766 shutdown_connections 2024-09-12T01:55:50.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.754+0000 7fd34ee50640 1 -- 172.21.15.39:0/111439766 wait complete. 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 Processor -- start 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 -- start start 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 0x7fd348198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd348106a80 0x7fd34819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd348110ed0 con 0x7fd348100a80 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd348110d50 con 0x7fd348106a80 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34ee50640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd348111050 con 0x7fd348101420 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59632/0 (socket says 172.21.15.39:59632) 2024-09-12T01:55:50.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 -- 172.21.15.39:0/3888958158 learned_addr learned my addr 172.21.15.39:0/3888958158 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd347fff640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 0x7fd348198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34d3ed640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd348106a80 0x7fd34819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 -- 172.21.15.39:0/3888958158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 msgr2=0x7fd348198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 0x7fd348198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 -- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd348106a80 msgr2=0x7fd34819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd348106a80 0x7fd34819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.755+0000 7fd34cbec640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34819d3e0 con 0x7fd348100a80 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd347fff640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd348101420 0x7fd348198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd34cbec640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348198430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c890 tx=0x7fd33c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c004220 con 0x7fd348100a80 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd33c0043c0 con 0x7fd348100a80 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34819d6d0 con 0x7fd348100a80 2024-09-12T01:55:50.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.756+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00f450 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.757+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3481a4fb0 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.757+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd348062940 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.759+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd33c0079b0 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.759+0000 7fd345ffb640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3380a2c90 0x7fd3380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.759+0000 7fd347fff640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3380a2c90 0x7fd3380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.759+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd33c0ce8f0 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd345ffb640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] conn(0x7fd3380ac4e0 0x7fd3380ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3380aefb0 con 0x7fd3380ac4e0 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd33c0d32c0 con 0x7fd348100a80 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd347fff640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3380a2c90 0x7fd3380a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd334006010 tx=0x7fd334005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd34d3ed640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] conn(0x7fd3380ac4e0 0x7fd3380ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.760+0000 7fd34d3ed640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] conn(0x7fd3380ac4e0 0x7fd3380ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.761+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== osd.10 v2:172.21.15.44:6824/2721109342 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3380aefb0 con 0x7fd3380ac4e0 2024-09-12T01:55:50.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.775+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 --> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd348062dc0 con 0x7fd3380ac4e0 2024-09-12T01:55:50.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.776+0000 7fd345ffb640 1 -- 172.21.15.39:0/3888958158 <== osd.10 v2:172.21.15.44:6824/2721109342 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd348062dc0 con 0x7fd3380ac4e0 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] conn(0x7fd3380ac4e0 msgr2=0x7fd3380ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] conn(0x7fd3380ac4e0 0x7fd3380ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3380a2c90 msgr2=0x7fd3380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3380a2c90 0x7fd3380a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd334006010 tx=0x7fd334005a20 comp rx=0 tx=0).stop 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 msgr2=0x7fd348198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 --2- 172.21.15.39:0/3888958158 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd348100a80 0x7fd348198430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c890 tx=0x7fd33c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34d3ed640 1 -- 172.21.15.39:0/3888958158 reap_dead start 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 shutdown_connections 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 >> 172.21.15.39:0/3888958158 conn(0x7fd3480fc7a0 msgr2=0x7fd34806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:50.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 shutdown_connections 2024-09-12T01:55:50.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.777+0000 7fd34ee50640 1 -- 172.21.15.39:0/3888958158 wait complete. 2024-09-12T01:55:51.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:50 smithi039 ceph-mon[31204]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 -- 172.21.15.39:0/2378206780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 msgr2=0x7f8ebc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/2378206780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc1067e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009900 tx=0x7f8eac02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 -- 172.21.15.39:0/2378206780 shutdown_connections 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/2378206780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 0x7f8ebc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/2378206780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc1067e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/2378206780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ebc101de0 0x7f8ebc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 -- 172.21.15.39:0/2378206780 >> 172.21.15.39:0/2378206780 conn(0x7f8ebc0fd8c0 msgr2=0x7f8ebc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 -- 172.21.15.39:0/2378206780 shutdown_connections 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 -- 172.21.15.39:0/2378206780 wait complete. 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.112+0000 7f8ec3fba640 1 Processor -- start 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 -- start start 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ebc101de0 0x7f8ebc19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 0x7f8ebc19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc111f90 con 0x7f8ebc102790 2024-09-12T01:55:51.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc111e10 con 0x7f8ebc101de0 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec3fba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc112110 con 0x7f8ebc106f10 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc19ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59682/0 (socket says 172.21.15.39:59682) 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 -- 172.21.15.39:0/4255231420 learned_addr learned my addr 172.21.15.39:0/4255231420 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec2557640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 0x7f8ebc19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1d56640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ebc101de0 0x7f8ebc19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 -- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 msgr2=0x7f8ebc19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 0x7f8ebc19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 -- 172.21.15.39:0/4255231420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ebc101de0 msgr2=0x7f8ebc19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ebc101de0 0x7f8ebc19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc19f700 con 0x7f8ebc102790 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec2557640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ebc106f10 0x7f8ebc19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.113+0000 7f8ec1555640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc19ac90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8eac005ab0 tx=0x7f8eac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac03f030 con 0x7f8ebc102790 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eac003ce0 con 0x7f8ebc102790 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc19f990 con 0x7f8ebc102790 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac035070 con 0x7f8ebc102790 2024-09-12T01:55:51.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc1a72d0 con 0x7f8ebc102790 2024-09-12T01:55:51.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.114+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ebc075700 con 0x7f8ebc102790 2024-09-12T01:55:51.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.116+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8eac042030 con 0x7f8ebc102790 2024-09-12T01:55:51.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.116+0000 7f8eb2ffd640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8ea80a2c90 0x7f8ea80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8ec1d56640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8ea80a2c90 0x7f8ea80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8eac0efc10 con 0x7f8ebc102790 2024-09-12T01:55:51.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8eb2ffd640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] conn(0x7f8ea80ac4e0 0x7f8ea80ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8eac001d30 con 0x7f8ea80ac4e0 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8eac0f00f0 con 0x7f8ebc102790 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8ec2557640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] conn(0x7f8ea80ac4e0 0x7f8ea80ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.117+0000 7f8ec1d56640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8ea80a2c90 0x7f8ea80a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80058c0 tx=0x7f8eb800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.118+0000 7f8ec2557640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] conn(0x7f8ea80ac4e0 0x7f8ea80ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.118+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== osd.2 v2:172.21.15.172:6800/3618957048 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8eac001d30 con 0x7f8ea80ac4e0 2024-09-12T01:55:51.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.134+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 --> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ebc1032c0 con 0x7f8ea80ac4e0 2024-09-12T01:55:51.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.134+0000 7f8eb2ffd640 1 -- 172.21.15.39:0/4255231420 <== osd.2 v2:172.21.15.172:6800/3618957048 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ebc1032c0 con 0x7f8ea80ac4e0 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] conn(0x7f8ea80ac4e0 msgr2=0x7f8ea80ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] conn(0x7f8ea80ac4e0 0x7f8ea80ae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8ea80a2c90 msgr2=0x7f8ea80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8ea80a2c90 0x7f8ea80a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80058c0 tx=0x7f8eb800a4c0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 msgr2=0x7f8ebc19ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 --2- 172.21.15.39:0/4255231420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ebc102790 0x7f8ebc19ac90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8eac005ab0 tx=0x7f8eac0042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec2557640 1 -- 172.21.15.39:0/4255231420 reap_dead start 2024-09-12T01:55:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 shutdown_connections 2024-09-12T01:55:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 >> 172.21.15.39:0/4255231420 conn(0x7f8ebc0fd8c0 msgr2=0x7f8ebc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 shutdown_connections 2024-09-12T01:55:51.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.135+0000 7f8ec3fba640 1 -- 172.21.15.39:0/4255231420 wait complete. 2024-09-12T01:55:51.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:50 smithi044 ceph-mon[35259]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:50 smithi172 ceph-mon[35073]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:55:51.559 INFO:teuthology.orchestra.run.smithi039.stdout:34359738447 2024-09-12T01:55:51.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 -- 172.21.15.39:0/3443340630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 msgr2=0x7fbd541006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/3443340630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd541006d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009930 tx=0x7fbd5002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 -- 172.21.15.39:0/3443340630 shutdown_connections 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/3443340630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd54106f50 0x7fbd5410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/3443340630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 0x7fbd54106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/3443340630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd541006d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 -- 172.21.15.39:0/3443340630 >> 172.21.15.39:0/3443340630 conn(0x7fbd54077210 msgr2=0x7fbd540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 -- 172.21.15.39:0/3443340630 shutdown_connections 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.005+0000 7fbd5c73d640 1 -- 172.21.15.39:0/3443340630 wait complete. 2024-09-12T01:55:51.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 Processor -- start 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 -- start start 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd54198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 0x7fbd541989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd54106f50 0x7fbd5419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54111fa0 con 0x7fbd541002f0 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54111e20 con 0x7fbd54100ca0 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5c73d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd54112120 con 0x7fbd54106f50 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5a4d9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd54198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5a4d9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd54198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59658/0 (socket says 172.21.15.39:59658) 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.006+0000 7fbd5a4d9640 1 -- 172.21.15.39:0/1914659344 learned_addr learned my addr 172.21.15.39:0/1914659344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:51.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd59cd8640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 0x7fbd541989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 -- 172.21.15.39:0/1914659344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd54106f50 msgr2=0x7fbd5419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd54106f50 0x7fbd5419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 -- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 msgr2=0x7fbd541989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 0x7fbd541989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5419d410 con 0x7fbd541002f0 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd59cd8640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd54100ca0 0x7fbd541989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5a4d9640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd54198460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009230 tx=0x7fbd50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5003f030 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd50003ad0 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5419d6a0 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50035070 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.007+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd541a4fe0 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.008+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd54062980 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.009+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd50042030 con 0x7fbd541002f0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd4b7fe640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd400a2c90 0x7fbd400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd59cd8640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd400a2c90 0x7fbd400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbd500ef970 con 0x7fbd541002f0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd4b7fe640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] conn(0x7fbd400ac4e0 0x7fbd400ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd400aefb0 con 0x7fbd400ac4e0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fbd500efe50 con 0x7fbd541002f0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.010+0000 7fbd59cd8640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd400a2c90 0x7fbd400a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd44005d00 tx=0x7fbd44009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.011+0000 7fbd5acda640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] conn(0x7fbd400ac4e0 0x7fbd400ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.011+0000 7fbd5acda640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] conn(0x7fbd400ac4e0 0x7fbd400ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.012+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== osd.7 v2:172.21.15.44:6816/849440422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd400aefb0 con 0x7fbd400ac4e0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.026+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 --> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd54062db0 con 0x7fbd400ac4e0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd4b7fe640 1 -- 172.21.15.39:0/1914659344 <== osd.7 v2:172.21.15.44:6816/849440422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbd54062db0 con 0x7fbd400ac4e0 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] conn(0x7fbd400ac4e0 msgr2=0x7fbd400ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] conn(0x7fbd400ac4e0 0x7fbd400ae900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:51.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd400a2c90 msgr2=0x7fbd400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd400a2c90 0x7fbd400a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd44005d00 tx=0x7fbd44009550 comp rx=0 tx=0).stop 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 msgr2=0x7fbd54198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 --2- 172.21.15.39:0/1914659344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd541002f0 0x7fbd54198460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009230 tx=0x7fbd50004270 comp rx=0 tx=0).stop 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5acda640 1 -- 172.21.15.39:0/1914659344 reap_dead start 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 shutdown_connections 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 >> 172.21.15.39:0/1914659344 conn(0x7fbd54077210 msgr2=0x7fbd54105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 shutdown_connections 2024-09-12T01:55:51.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:51.027+0000 7fbd5c73d640 1 -- 172.21.15.39:0/1914659344 wait complete. 2024-09-12T01:55:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- 172.21.15.39:0/942266269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 msgr2=0x7f0d38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/942266269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38107b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009930 tx=0x7f0d2002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- 172.21.15.39:0/942266269 shutdown_connections 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/942266269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d381082a0 0x7f0d3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/942266269 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38107b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/942266269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 0x7f0d38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- 172.21.15.39:0/942266269 >> 172.21.15.39:0/942266269 conn(0x7f0d380fc7d0 msgr2=0x7f0d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- 172.21.15.39:0/942266269 shutdown_connections 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- 172.21.15.39:0/942266269 wait complete. 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 Processor -- start 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.637+0000 7f0d3caaa640 1 -- start start 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 0x7f0d38198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0d381120a0 con 0x7f0d381036e0 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38111f20 con 0x7f0d38102d30 2024-09-12T01:55:52.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3caaa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38112220 con 0x7f0d381082a0 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59610/0 (socket says 172.21.15.39:59610) 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 -- 172.21.15.39:0/2631104768 learned_addr learned my addr 172.21.15.39:0/2631104768 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d36d9d640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3659c640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 0x7f0d38198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 -- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d381082a0 msgr2=0x7f0d3819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 -- 172.21.15.39:0/2631104768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 msgr2=0x7f0d38198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 0x7f0d38198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3819d510 con 0x7f0d381036e0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d3659c640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d38102d30 0x7f0d38198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.638+0000 7f0d35d9b640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38198aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005940 tx=0x7f0d200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2003f030 con 0x7f0d381036e0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3819d7a0 con 0x7f0d381036e0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d20003ce0 con 0x7f0d381036e0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20035070 con 0x7f0d381036e0 2024-09-12T01:55:52.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d381a50e0 con 0x7f0d381036e0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.639+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d38062900 con 0x7f0d381036e0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.641+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0d20042030 con 0x7f0d381036e0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.641+0000 7f0d2f7fe640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d240a2c10 0x7f0d240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d3659c640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d240a2c10 0x7f0d240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0d200efc80 con 0x7f0d381036e0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d2f7fe640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] conn(0x7f0d240ac460 0x7f0d240ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d20001d30 con 0x7f0d240ac460 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0d200f0160 con 0x7f0d381036e0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d3659c640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d240a2c10 0x7f0d240a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d30008e00 tx=0x7f0d30008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.642+0000 7f0d36d9d640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] conn(0x7f0d240ac460 0x7f0d240ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.643+0000 7f0d36d9d640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] conn(0x7f0d240ac460 0x7f0d240ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.643+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== osd.8 v2:172.21.15.172:6816/586436553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d20001d30 con 0x7f0d240ac460 2024-09-12T01:55:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.657+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 --> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d38062d00 con 0x7f0d240ac460 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d2f7fe640 1 -- 172.21.15.39:0/2631104768 <== osd.8 v2:172.21.15.172:6816/586436553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0d38062d00 con 0x7f0d240ac460 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] conn(0x7f0d240ac460 msgr2=0x7f0d240ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] conn(0x7f0d240ac460 0x7f0d240ae880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d240a2c10 msgr2=0x7f0d240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0d240a2c10 0x7f0d240a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d30008e00 tx=0x7f0d30008350 comp rx=0 tx=0).stop 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 msgr2=0x7f0d38198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 --2- 172.21.15.39:0/2631104768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d381036e0 0x7f0d38198aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005940 tx=0x7f0d200042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d36d9d640 1 -- 172.21.15.39:0/2631104768 reap_dead start 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 shutdown_connections 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 >> 172.21.15.39:0/2631104768 conn(0x7f0d380fc7d0 msgr2=0x7f0d38105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 shutdown_connections 2024-09-12T01:55:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:50.658+0000 7f0d3caaa640 1 -- 172.21.15.39:0/2631104768 wait complete. 2024-09-12T01:55:53.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:52 smithi039 ceph-mon[31204]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:55:53.089 INFO:teuthology.orchestra.run.smithi039.stdout:231928234021 2024-09-12T01:55:53.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T01:55:53.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:52 smithi044 ceph-mon[35259]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:55:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:52 smithi172 ceph-mon[35073]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 -- 172.21.15.39:0/2333222186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 msgr2=0x7f8e1c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/2333222186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c107b80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009930 tx=0x7f8e0c02a420 comp rx=0 tx=0).stop 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 -- 172.21.15.39:0/2333222186 shutdown_connections 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/2333222186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c108290 0x7f8e1c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/2333222186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c107b80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/2333222186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c102d90 0x7f8e1c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 -- 172.21.15.39:0/2333222186 >> 172.21.15.39:0/2333222186 conn(0x7f8e1c0fc7d0 msgr2=0x7f8e1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 -- 172.21.15.39:0/2333222186 shutdown_connections 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.343+0000 7f8e23a8f640 1 -- 172.21.15.39:0/2333222186 wait complete. 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 Processor -- start 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 -- start start 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d90 0x7f8e1c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c108290 0x7f8e1c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c112090 con 0x7f8e1c103740 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c111f10 con 0x7f8e1c108290 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e23a8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c112210 con 0x7f8e1c102d90 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e2102a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e2102a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37874/0 (socket says 172.21.15.39:37874) 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e2102a640 1 -- 172.21.15.39:0/201689746 learned_addr learned my addr 172.21.15.39:0/201689746 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e2202c640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c108290 0x7f8e1c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.344+0000 7f8e2182b640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d90 0x7f8e1c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 -- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d90 msgr2=0x7f8e1c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d90 0x7f8e1c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 -- 172.21.15.39:0/201689746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c108290 msgr2=0x7f8e1c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c108290 0x7f8e1c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c19d530 con 0x7f8e1c103740 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e2102a640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c198ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005940 tx=0x7f8e0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c03f030 con 0x7f8e1c103740 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0c003ad0 con 0x7f8e1c103740 2024-09-12T01:55:53.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c19d7c0 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c035070 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.345+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c100920 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.346+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e1c062980 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.347+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8e0c042030 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e12ffd640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8e080a2c10 0x7f8e080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e2182b640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8e080a2c10 0x7f8e080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8e0c0efd00 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e12ffd640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] conn(0x7f8e080ac330 0x7f8e080ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e0c001d30 con 0x7f8e080ac330 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8e0c0f01e0 con 0x7f8e1c103740 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e2182b640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8e080a2c10 0x7f8e080a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009bd0 tx=0x7f8e18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.348+0000 7f8e2202c640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] conn(0x7f8e080ac330 0x7f8e080ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.349+0000 7f8e2202c640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] conn(0x7f8e080ac330 0x7f8e080ae750 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.350+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== osd.11 v2:172.21.15.172:6824/4178516458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e0c001d30 con 0x7f8e080ac330 2024-09-12T01:55:53.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.363+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 --> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e1c062d80 con 0x7f8e080ac330 2024-09-12T01:55:53.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e12ffd640 1 -- 172.21.15.39:0/201689746 <== osd.11 v2:172.21.15.172:6824/4178516458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8e1c062d80 con 0x7f8e080ac330 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] conn(0x7f8e080ac330 msgr2=0x7f8e080ae750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] conn(0x7f8e080ac330 0x7f8e080ae750 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8e080a2c10 msgr2=0x7f8e080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8e080a2c10 0x7f8e080a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009bd0 tx=0x7f8e18005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 msgr2=0x7f8e1c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e23a8f640 1 --2- 172.21.15.39:0/201689746 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103740 0x7f8e1c198ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005940 tx=0x7f8e0c004270 comp rx=0 tx=0).stop 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.364+0000 7f8e2202c640 1 -- 172.21.15.39:0/201689746 reap_dead start 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.365+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 shutdown_connections 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.365+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 >> 172.21.15.39:0/201689746 conn(0x7f8e1c0fc7d0 msgr2=0x7f8e1c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.365+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 shutdown_connections 2024-09-12T01:55:53.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:53.365+0000 7f8e23a8f640 1 -- 172.21.15.39:0/201689746 wait complete. 2024-09-12T01:55:54.435 INFO:teuthology.orchestra.run.smithi039.stdout:98784247871 2024-09-12T01:55:54.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 -- 172.21.15.39:0/817915137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c10e480 msgr2=0x7fae7c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 --2- 172.21.15.39:0/817915137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c10e480 0x7fae7c110870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae74009ca0 tx=0x7fae7402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 -- 172.21.15.39:0/817915137 shutdown_connections 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 --2- 172.21.15.39:0/817915137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c10e480 0x7fae7c110870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 --2- 172.21.15.39:0/817915137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae7c101280 0x7fae7c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 --2- 172.21.15.39:0/817915137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c1008d0 0x7fae7c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 -- 172.21.15.39:0/817915137 >> 172.21.15.39:0/817915137 conn(0x7fae7c0fc7a0 msgr2=0x7fae7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 -- 172.21.15.39:0/817915137 shutdown_connections 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.702+0000 7fae833ee640 1 -- 172.21.15.39:0/817915137 wait complete. 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 Processor -- start 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 -- start start 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae7c1008d0 0x7fae7c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 0x7fae7c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c10e480 0x7fae7c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c114160 con 0x7fae7c101280 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c113fe0 con 0x7fae7c1008d0 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae833ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c1142e0 con 0x7fae7c10e480 2024-09-12T01:55:54.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae80989640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 0x7fae7c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae80989640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 0x7fae7c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37904/0 (socket says 172.21.15.39:37904) 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.703+0000 7fae80989640 1 -- 172.21.15.39:0/2287127043 learned_addr learned my addr 172.21.15.39:0/2287127043 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae8198b640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c10e480 0x7fae7c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae8118a640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae7c1008d0 0x7fae7c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 -- 172.21.15.39:0/2287127043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c10e480 msgr2=0x7fae7c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c10e480 0x7fae7c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 -- 172.21.15.39:0/2287127043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae7c1008d0 msgr2=0x7fae7c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae7c1008d0 0x7fae7c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c19f5f0 con 0x7fae7c101280 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae8198b640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae7c10e480 0x7fae7c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae80989640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 0x7fae7c19ab80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e9f0 tx=0x7fae6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00cd80 con 0x7fae7c101280 2024-09-12T01:55:54.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c19f8e0 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae6c010910 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0188f0 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.704+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c1a71c0 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.705+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae7c062980 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.706+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fae6c010ac0 con 0x7fae7c101280 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae727fc640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae680a2c10 0x7fae680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae8118a640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae680a2c10 0x7fae680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fae6c0cf490 con 0x7fae7c101280 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae727fc640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] conn(0x7fae680ac460 0x7fae680ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae6c004470 con 0x7fae680ac460 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fae6c0d6050 con 0x7fae7c101280 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae8198b640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] conn(0x7fae680ac460 0x7fae680ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.707+0000 7fae8118a640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae680a2c10 0x7fae680a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fae78005fd0 tx=0x7fae78005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.708+0000 7fae8198b640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] conn(0x7fae680ac460 0x7fae680ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.708+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== osd.9 v2:172.21.15.39:6826/3100759551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae6c004470 con 0x7fae680ac460 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.722+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 --> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae7c062d80 con 0x7fae680ac460 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.722+0000 7fae727fc640 1 -- 172.21.15.39:0/2287127043 <== osd.9 v2:172.21.15.39:6826/3100759551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fae7c062d80 con 0x7fae680ac460 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] conn(0x7fae680ac460 msgr2=0x7fae680ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] conn(0x7fae680ac460 0x7fae680ae880 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae680a2c10 msgr2=0x7fae680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae680a2c10 0x7fae680a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fae78005fd0 tx=0x7fae78005850 comp rx=0 tx=0).stop 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 msgr2=0x7fae7c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 --2- 172.21.15.39:0/2287127043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae7c101280 0x7fae7c19ab80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae6c00e9f0 tx=0x7fae6c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae8198b640 1 -- 172.21.15.39:0/2287127043 reap_dead start 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 shutdown_connections 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 >> 172.21.15.39:0/2287127043 conn(0x7fae7c0fc7a0 msgr2=0x7fae7c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 shutdown_connections 2024-09-12T01:55:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:54.723+0000 7fae833ee640 1 -- 172.21.15.39:0/2287127043 wait complete. 2024-09-12T01:55:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:54 smithi039 ceph-mon[31204]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T01:55:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:54 smithi044 ceph-mon[35259]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T01:55:55.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:54 smithi172 ceph-mon[35073]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T01:55:55.396 INFO:teuthology.orchestra.run.smithi039.stdout:266287972385 2024-09-12T01:55:55.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T01:55:55.822 INFO:teuthology.orchestra.run.smithi039.stdout:197568495659 2024-09-12T01:55:55.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T01:55:56.250 INFO:teuthology.orchestra.run.smithi039.stdout:128849018937 2024-09-12T01:55:56.250 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T01:55:56.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:56 smithi039 ceph-mon[31204]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:55:56.994 INFO:teuthology.orchestra.run.smithi039.stdout:287762808860 2024-09-12T01:55:56.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T01:55:57.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:56 smithi044 ceph-mon[35259]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:55:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:56 smithi172 ceph-mon[35073]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:55:57.421 INFO:teuthology.orchestra.run.smithi039.stdout:73014444101 2024-09-12T01:55:57.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T01:55:57.496 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:57.497 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:57.986 INFO:teuthology.orchestra.run.smithi039.stdout:317827579927 2024-09-12T01:55:57.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T01:55:58.144 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.148 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.149 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.151 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.382 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.383 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.384 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:58.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 -- 172.21.15.39:0/3887266965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0100e20 msgr2=0x7f13f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 --2- 172.21.15.39:0/3887266965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0100e20 0x7f13f0101200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009900 tx=0x7f13ec02a480 comp rx=0 tx=0).stop 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 -- 172.21.15.39:0/3887266965 shutdown_connections 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 --2- 172.21.15.39:0/3887266965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 --2- 172.21.15.39:0/3887266965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0102570 0x7f13f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 --2- 172.21.15.39:0/3887266965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0100e20 0x7f13f0101200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 -- 172.21.15.39:0/3887266965 >> 172.21.15.39:0/3887266965 conn(0x7f13f00fc7d0 msgr2=0x7f13f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 -- 172.21.15.39:0/3887266965 shutdown_connections 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.623+0000 7f13f79b1640 1 -- 172.21.15.39:0/3887266965 wait complete. 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 Processor -- start 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 -- start start 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0100e20 0x7f13f0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f01a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f13f0110fa0 con 0x7f13f0102570 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13f0110e20 con 0x7f13f0100e20 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f79b1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13f0111120 con 0x7f13f0102ef0 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37908/0 (socket says 172.21.15.39:37908) 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 -- 172.21.15.39:0/601548800 learned_addr learned my addr 172.21.15.39:0/601548800 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f574d640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0100e20 0x7f13f0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f5f4e640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f01a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 -- 172.21.15.39:0/601548800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 msgr2=0x7f13f01a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f01a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 -- 172.21.15.39:0/601548800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0100e20 msgr2=0x7f13f0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0100e20 0x7f13f0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f4f4c640 1 -- 172.21.15.39:0/601548800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f01a48f0 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.624+0000 7f13f5f4e640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13f4f4c640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c920 tx=0x7f13e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0007c70 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f01a4ac0 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e0007e10 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0018890 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.625+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f01a4fd0 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.626+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f0101200 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.627+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13e0018a70 con 0x7f13f0102570 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.628+0000 7f13e67fc640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 0x7f13dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.628+0000 7f13f574d640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 0x7f13dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.628+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f13e00cf170 con 0x7f13f0102570 2024-09-12T01:55:58.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.628+0000 7f13f574d640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 0x7f13dc0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13ec000c00 tx=0x7f13ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.632+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13e0014030 con 0x7f13f0102570 2024-09-12T01:55:58.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.821+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f13f01a52c0 con 0x7f13f0102570 2024-09-12T01:55:58.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.821+0000 7f13e67fc640 1 -- 172.21.15.39:0/601548800 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13e009c120 con 0x7f13f0102570 2024-09-12T01:55:58.822 INFO:teuthology.orchestra.run.smithi039.stdout:176093659185 2024-09-12T01:55:58.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 msgr2=0x7f13dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 0x7f13dc0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13ec000c00 tx=0x7f13ec0058d0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 msgr2=0x7f13f0199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c920 tx=0x7f13e000cde0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 shutdown_connections 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f13dc0a2c10 0x7f13dc0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13f0102ef0 0x7f13f01a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13f0102570 0x7f13f0199870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 --2- 172.21.15.39:0/601548800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13f0100e20 0x7f13f0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 >> 172.21.15.39:0/601548800 conn(0x7f13f00fc7d0 msgr2=0x7f13f0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 shutdown_connections 2024-09-12T01:55:58.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:55:58.823+0000 7f13f79b1640 1 -- 172.21.15.39:0/601548800 wait complete. 2024-09-12T01:55:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:58 smithi039 ceph-mon[31204]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:55:59.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:55:58 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/601548800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:55:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:58 smithi044 ceph-mon[35259]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:55:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:55:58 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/601548800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:55:59.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:58 smithi172 ceph-mon[35073]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:55:59.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:55:58 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/601548800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:56:00.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 -- 172.21.15.39:0/2771657997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb388100480 msgr2=0x7fb388100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/2771657997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb388100480 0x7fb388100860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb378009900 tx=0x7fb37802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 -- 172.21.15.39:0/2771657997 shutdown_connections 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/2771657997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3881055b0 0x7fb38810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/2771657997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100e30 0x7fb388104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/2771657997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb388100480 0x7fb388100860 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 -- 172.21.15.39:0/2771657997 >> 172.21.15.39:0/2771657997 conn(0x7fb388077210 msgr2=0x7fb3880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 -- 172.21.15.39:0/2771657997 shutdown_connections 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.030+0000 7fb38d1b2640 1 -- 172.21.15.39:0/2771657997 wait complete. 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 Processor -- start 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 -- start start 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100480 0x7fb3881984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb388100e30 0x7fb3881989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb388111fb0 con 0x7fb3881055b0 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb388111e30 con 0x7fb388100480 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.031+0000 7fb38d1b2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb388112130 con 0x7fb388100e30 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37924/0 (socket says 172.21.15.39:37924) 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 -- 172.21.15.39:0/1177654661 learned_addr learned my addr 172.21.15.39:0/1177654661 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb386d9d640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100480 0x7fb3881984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38659c640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb388100e30 0x7fb3881989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 -- 172.21.15.39:0/1177654661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb388100e30 msgr2=0x7fb3881989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb388100e30 0x7fb3881989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 -- 172.21.15.39:0/1177654661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100480 msgr2=0x7fb3881984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100480 0x7fb3881984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 -- 172.21.15.39:0/1177654661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38819d460 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38759e640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b970 tx=0x7fb38000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380019070 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb38000cb40 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38819d750 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380007650 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.032+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3881a5030 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.033+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb388100860 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.035+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb38001c070 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.035+0000 7fb36ffff640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 0x7fb3700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.035+0000 7fb386d9d640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 0x7fb3700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.035+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb3800ceab0 con 0x7fb3881055b0 2024-09-12T01:56:00.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.036+0000 7fb386d9d640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 0x7fb3700a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb378009230 tx=0x7fb3780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.039+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb38009b420 con 0x7fb3881055b0 2024-09-12T01:56:00.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.221+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb388108200 con 0x7fb3881055b0 2024-09-12T01:56:00.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.222+0000 7fb36ffff640 1 -- 172.21.15.39:0/1177654661 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb38009f720 con 0x7fb3881055b0 2024-09-12T01:56:00.223 INFO:teuthology.orchestra.run.smithi039.stdout:231928234023 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 msgr2=0x7fb3700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 0x7fb3700a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb378009230 tx=0x7fb3780058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 msgr2=0x7fb38819cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb38000b970 tx=0x7fb38000be30 comp rx=0 tx=0).stop 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 shutdown_connections 2024-09-12T01:56:00.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3881055b0 0x7fb38819cd80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb3700a2c10 0x7fb3700a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb388100e30 0x7fb3881989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 --2- 172.21.15.39:0/1177654661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb388100480 0x7fb3881984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 >> 172.21.15.39:0/1177654661 conn(0x7fb388077210 msgr2=0x7fb388103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 shutdown_connections 2024-09-12T01:56:00.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.224+0000 7fb38d1b2640 1 -- 172.21.15.39:0/1177654661 wait complete. 2024-09-12T01:56:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 -- 172.21.15.39:0/941463026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394106f10 msgr2=0x7f439410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 --2- 172.21.15.39:0/941463026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394106f10 0x7f439410ea90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f438c009ca0 tx=0x7f438c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 -- 172.21.15.39:0/941463026 shutdown_connections 2024-09-12T01:56:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 --2- 172.21.15.39:0/941463026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394106f10 0x7f439410ea90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 --2- 172.21.15.39:0/941463026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102790 0x7f43941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 --2- 172.21.15.39:0/941463026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394101de0 0x7f43941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 -- 172.21.15.39:0/941463026 >> 172.21.15.39:0/941463026 conn(0x7f43940fd8c0 msgr2=0x7f43940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 -- 172.21.15.39:0/941463026 shutdown_connections 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.797+0000 7f43989a6640 1 -- 172.21.15.39:0/941463026 wait complete. 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 Processor -- start 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 -- start start 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394101de0 0x7f43941983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 0x7f439419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4394111f70 con 0x7f4394102790 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4394111df0 con 0x7f4394101de0 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f43989a6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43941120f0 con 0x7f4394106f10 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37948/0 (socket says 172.21.15.39:37948) 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 -- 172.21.15.39:0/625170765 learned_addr learned my addr 172.21.15.39:0/625170765 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4392d9d640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 0x7f439419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f439259c640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394101de0 0x7f43941983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 -- 172.21.15.39:0/625170765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 msgr2=0x7f439419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 0x7f439419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 -- 172.21.15.39:0/625170765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394101de0 msgr2=0x7f43941983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394101de0 0x7f43941983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4391d9b640 1 -- 172.21.15.39:0/625170765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439419d380 con 0x7f4394102790 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.798+0000 7f4392d9d640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 0x7f439419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f4391d9b640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f438800c890 tx=0x7f438800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388004220 con 0x7f4394102790 2024-09-12T01:56:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43880043c0 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439419d670 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43880049e0 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.799+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43941a4f50 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.800+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43941021c0 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.801+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f43880079b0 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.802+0000 7f43837fe640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 0x7f437c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.802+0000 7f439259c640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 0x7f437c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.802+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f43880cf070 con 0x7f4394102790 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.802+0000 7f439259c640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 0x7f437c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4384005fd0 tx=0x7f4384005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.806+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4388014030 con 0x7f4394102790 2024-09-12T01:56:00.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.984+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4394109bc0 con 0x7f4394102790 2024-09-12T01:56:00.985 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:00 smithi039 ceph-mon[31204]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:00.985 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1177654661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:56:00.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.984+0000 7f43837fe640 1 -- 172.21.15.39:0/625170765 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f438809c020 con 0x7f4394102790 2024-09-12T01:56:00.986 INFO:teuthology.orchestra.run.smithi039.stdout:55834574924 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.986+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 msgr2=0x7f437c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.986+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 0x7f437c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4384005fd0 tx=0x7f4384005850 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.986+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 msgr2=0x7f4394198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.986+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f438800c890 tx=0x7f438800cd50 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 shutdown_connections 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f437c0a2c90 0x7f437c0a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394106f10 0x7f439419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4394102790 0x7f4394198910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 --2- 172.21.15.39:0/625170765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394101de0 0x7f43941983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 >> 172.21.15.39:0/625170765 conn(0x7f43940fd8c0 msgr2=0x7f43940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 shutdown_connections 2024-09-12T01:56:00.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:00.987+0000 7f43989a6640 1 -- 172.21.15.39:0/625170765 wait complete. 2024-09-12T01:56:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:00 smithi044 ceph-mon[35259]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:00 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1177654661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:56:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:00 smithi172 ceph-mon[35073]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:00 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1177654661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:56:01.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 -- 172.21.15.39:0/3913132540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c102d40 msgr2=0x7f869c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 --2- 172.21.15.39:0/3913132540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c102d40 0x7f869c103120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8698009900 tx=0x7f869802a480 comp rx=0 tx=0).stop 2024-09-12T01:56:01.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 -- 172.21.15.39:0/3913132540 shutdown_connections 2024-09-12T01:56:01.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 --2- 172.21.15.39:0/3913132540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c10c170 0x7f869c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 --2- 172.21.15.39:0/3913132540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c103660 0x7f869c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 --2- 172.21.15.39:0/3913132540 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c102d40 0x7f869c103120 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 -- 172.21.15.39:0/3913132540 >> 172.21.15.39:0/3913132540 conn(0x7f869c0fc7a0 msgr2=0x7f869c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 -- 172.21.15.39:0/3913132540 shutdown_connections 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.460+0000 7f86a3554640 1 -- 172.21.15.39:0/3913132540 wait complete. 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 Processor -- start 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 -- start start 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 0x7f869c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c10c170 0x7f869c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f869c111f70 con 0x7f869c103660 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f869c111df0 con 0x7f869c102d40 2024-09-12T01:56:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a3554640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f869c1120f0 con 0x7f869c10c170 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37974/0 (socket says 172.21.15.39:37974) 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 -- 172.21.15.39:0/787933677 learned_addr learned my addr 172.21.15.39:0/787933677 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a1af1640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c10c170 0x7f869c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a12f0640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 0x7f869c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 -- 172.21.15.39:0/787933677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c10c170 msgr2=0x7f869c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c10c170 0x7f869c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 -- 172.21.15.39:0/787933677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 msgr2=0x7f869c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 0x7f869c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a0aef640 1 -- 172.21.15.39:0/787933677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c1aae20 con 0x7f869c103660 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.461+0000 7f86a12f0640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 0x7f869c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:01.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86a0aef640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f868c00d750 tx=0x7f868c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c017070 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f868c005020 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869c1aaff0 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c004d00 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.462+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869c1ab450 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.463+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869c06b070 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.464+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f868c009a30 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.465+0000 7f86927fc640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 0x7f86880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.465+0000 7f86a12f0640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 0x7f86880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.465+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f868c0cec30 con 0x7f869c103660 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.465+0000 7f86a12f0640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 0x7f86880a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.469+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f868c09bae0 con 0x7f869c103660 2024-09-12T01:56:01.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.650+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f869c02d7c0 con 0x7f869c103660 2024-09-12T01:56:01.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.651+0000 7f86927fc640 1 -- 172.21.15.39:0/787933677 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f868c09b3e0 con 0x7f869c103660 2024-09-12T01:56:01.652 INFO:teuthology.orchestra.run.smithi039.stdout:146028888118 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 msgr2=0x7f86880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 0x7f86880a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698032c70 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 msgr2=0x7f869c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f868c00d750 tx=0x7f868c00dc10 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 shutdown_connections 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f86880a2c10 0x7f86880a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f869c10c170 0x7f869c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f869c103660 0x7f869c100ee0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 --2- 172.21.15.39:0/787933677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f869c102d40 0x7f869c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 >> 172.21.15.39:0/787933677 conn(0x7f869c0fc7a0 msgr2=0x7f869c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 shutdown_connections 2024-09-12T01:56:01.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.653+0000 7f86a3554640 1 -- 172.21.15.39:0/787933677 wait complete. 2024-09-12T01:56:01.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 -- 172.21.15.39:0/250613142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c100e20 msgr2=0x7f188c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 --2- 172.21.15.39:0/250613142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c100e20 0x7f188c101200 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f187c009900 tx=0x7f187c02a480 comp rx=0 tx=0).stop 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 -- 172.21.15.39:0/250613142 shutdown_connections 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 --2- 172.21.15.39:0/250613142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102ef0 0x7f188c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 --2- 172.21.15.39:0/250613142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c102570 0x7f188c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 --2- 172.21.15.39:0/250613142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c100e20 0x7f188c101200 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 -- 172.21.15.39:0/250613142 >> 172.21.15.39:0/250613142 conn(0x7f188c0fc7d0 msgr2=0x7f188c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 -- 172.21.15.39:0/250613142 shutdown_connections 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.691+0000 7f1890959640 1 -- 172.21.15.39:0/250613142 wait complete. 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 Processor -- start 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 -- start start 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 0x7f188c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 0x7f188c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.692+0000 7f1890959640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f188c110f50 con 0x7f188c102ef0 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1890959640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f188c110dd0 con 0x7f188c102570 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1890959640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f188c1110d0 con 0x7f188c100e20 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38000/0 (socket says 172.21.15.39:38000) 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 -- 172.21.15.39:0/2949757088 learned_addr learned my addr 172.21.15.39:0/2949757088 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188a59c640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 0x7f188c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1889d9b640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 0x7f188c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 -- 172.21.15.39:0/2949757088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 msgr2=0x7f188c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 0x7f188c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 -- 172.21.15.39:0/2949757088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 msgr2=0x7f188c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 0x7f188c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 -- 172.21.15.39:0/2949757088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c19d510 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188a59c640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 0x7f188c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1889d9b640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 0x7f188c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f188ad9d640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f188400eb10 tx=0x7f188400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884004b20 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c19d800 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1884004cc0 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884010760 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.693+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c1a50e0 con 0x7f188c102ef0 2024-09-12T01:56:01.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.694+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c101200 con 0x7f188c102ef0 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.695+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1884005020 con 0x7f188c102ef0 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.696+0000 7f18837fe640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 0x7f18780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.696+0000 7f188a59c640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 0x7f18780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.696+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f18840cf7c0 con 0x7f188c102ef0 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.697+0000 7f188a59c640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 0x7f18780a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f187c005ab0 tx=0x7f187c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.700+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f188409c670 con 0x7f188c102ef0 2024-09-12T01:56:01.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.881+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f188c10a0a0 con 0x7f188c102ef0 2024-09-12T01:56:01.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.881+0000 7f18837fe640 1 -- 172.21.15.39:0/2949757088 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f188409bf70 con 0x7f188c102ef0 2024-09-12T01:56:01.882 INFO:teuthology.orchestra.run.smithi039.stdout:197568495661 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 msgr2=0x7f18780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 0x7f18780a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f187c005ab0 tx=0x7f187c005a20 comp rx=0 tx=0).stop 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 msgr2=0x7f188c19ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f188400eb10 tx=0x7f188400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 shutdown_connections 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f188c102ef0 0x7f188c19ce30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c102570 0x7f188c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f18780a2c90 0x7f18780a5150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 --2- 172.21.15.39:0/2949757088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f188c100e20 0x7f188c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 >> 172.21.15.39:0/2949757088 conn(0x7f188c0fc7d0 msgr2=0x7f188c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 shutdown_connections 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:01.883+0000 7f1890959640 1 -- 172.21.15.39:0/2949757088 wait complete. 2024-09-12T01:56:01.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/625170765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:56:01.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/787933677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:56:02.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/625170765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:56:02.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/787933677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:56:02.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/625170765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:56:02.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/787933677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:56:02.606 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495659 got 197568495661 for osd.7 2024-09-12T01:56:02.606 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:02 smithi039 ceph-mon[31204]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:03.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:02 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2949757088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:56:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:02 smithi044 ceph-mon[35259]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:02 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2949757088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:56:03.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:02 smithi172 ceph-mon[35073]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:03.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:02 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2949757088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:56:03.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574924 for osd.1 2024-09-12T01:56:03.563 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:04.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.070+0000 7f6e95c11640 1 -- 172.21.15.39:0/4106841427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 msgr2=0x7f6e90107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.070+0000 7f6e95c11640 1 --2- 172.21.15.39:0/4106841427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90107b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009930 tx=0x7f6e8002a420 comp rx=0 tx=0).stop 2024-09-12T01:56:04.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 -- 172.21.15.39:0/4106841427 shutdown_connections 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 --2- 172.21.15.39:0/4106841427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 0x7f6e9010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 --2- 172.21.15.39:0/4106841427 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90107b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 --2- 172.21.15.39:0/4106841427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 -- 172.21.15.39:0/4106841427 >> 172.21.15.39:0/4106841427 conn(0x7f6e900fc7d0 msgr2=0x7f6e900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 -- 172.21.15.39:0/4106841427 shutdown_connections 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 -- 172.21.15.39:0/4106841427 wait complete. 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 Processor -- start 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.071+0000 7f6e95c11640 1 -- start start 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 0x7f6e90101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e901120a0 con 0x7f6e901036e0 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90111f20 con 0x7f6e90102d30 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e95c11640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90112220 con 0x7f6e901082a0 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44034/0 (socket says 172.21.15.39:44034) 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8effd640 1 -- 172.21.15.39:0/779553267 learned_addr learned my addr 172.21.15.39:0/779553267 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8ffff640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 0x7f6e90101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 -- 172.21.15.39:0/779553267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 msgr2=0x7f6e90101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 0x7f6e90101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 -- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 msgr2=0x7f6e90100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 -- 172.21.15.39:0/779553267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e901a6b00 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8effd640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.072+0000 7f6e8f7fe640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90100990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9f0 tx=0x7f6e7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.073+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800cd80 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.073+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e780035f0 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.073+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e901a6df0 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.073+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78010690 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.073+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901a72a0 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.074+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90103110 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.075+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6e78003b30 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.075+0000 7f6e8cff9640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 0x7f6e7c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.076+0000 7f6e8effd640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 0x7f6e7c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.076+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f6e780cf520 con 0x7f6e90102d30 2024-09-12T01:56:04.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.076+0000 7f6e8effd640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 0x7f6e7c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c00 tx=0x7f6e800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:04.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.080+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e7809c2d0 con 0x7f6e90102d30 2024-09-12T01:56:04.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T01:56:04.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-12T01:56:04.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:03 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:04.171 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-12T01:56:04.172 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:03 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-12T01:56:04.189 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:03 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:56:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.268+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6e9010a300 con 0x7f6e90102d30 2024-09-12T01:56:04.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.268+0000 7f6e8cff9640 1 -- 172.21.15.39:0/779553267 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6e9010a300 con 0x7f6e90102d30 2024-09-12T01:56:04.268 INFO:teuthology.orchestra.run.smithi039.stdout:287762808862 2024-09-12T01:56:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 msgr2=0x7f6e7c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 0x7f6e7c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000c00 tx=0x7f6e800058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 msgr2=0x7f6e90100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90100990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9f0 tx=0x7f6e7800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 shutdown_connections 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e7c0a2c90 0x7f6e7c0a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e901082a0 0x7f6e90101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e901036e0 0x7f6e90100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 --2- 172.21.15.39:0/779553267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e90102d30 0x7f6e90100990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.270+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 >> 172.21.15.39:0/779553267 conn(0x7f6e900fc7d0 msgr2=0x7f6e90106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.271+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 shutdown_connections 2024-09-12T01:56:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.271+0000 7f6e95c11640 1 -- 172.21.15.39:0/779553267 wait complete. 2024-09-12T01:56:04.568 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659182 got 176093659185 for osd.6 2024-09-12T01:56:04.568 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:04.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 -- 172.21.15.39:0/4228949812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024100e20 msgr2=0x7f0024101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 --2- 172.21.15.39:0/4228949812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024100e20 0x7f0024101200 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a480 comp rx=0 tx=0).stop 2024-09-12T01:56:04.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 -- 172.21.15.39:0/4228949812 shutdown_connections 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 --2- 172.21.15.39:0/4228949812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102ef0 0x7f002410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 --2- 172.21.15.39:0/4228949812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024102570 0x7f00241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 --2- 172.21.15.39:0/4228949812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024100e20 0x7f0024101200 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 -- 172.21.15.39:0/4228949812 >> 172.21.15.39:0/4228949812 conn(0x7f00240fc7d0 msgr2=0x7f00240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 -- 172.21.15.39:0/4228949812 shutdown_connections 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.777+0000 7f0029574640 1 -- 172.21.15.39:0/4228949812 wait complete. 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 Processor -- start 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 -- start start 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024100e20 0x7f00240fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0024110fa0 con 0x7f0024102ef0 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0024110e20 con 0x7f0024102570 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0029574640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0024111120 con 0x7f0024100e20 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f00237fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f00227fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f0022ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024100e20 0x7f00240fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f00227fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49732/0 (socket says 172.21.15.39:49732) 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f00237fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44040/0 (socket says 172.21.15.39:44040) 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.778+0000 7f00227fc640 1 -- 172.21.15.39:0/2047943366 learned_addr learned my addr 172.21.15.39:0/2047943366 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:04.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 -- 172.21.15.39:0/2047943366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024100e20 msgr2=0x7f00240fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024100e20 0x7f00240fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 -- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 msgr2=0x7f00240fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 -- 172.21.15.39:0/2047943366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241a6930 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00237fe640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.779+0000 7f00227fc640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f001800c920 tx=0x7f001800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.782+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018007c70 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.782+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0018007e10 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.782+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241a6c20 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.782+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018018890 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.782+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a71b0 con 0x7f0024102570 2024-09-12T01:56:04.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.783+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0024101200 con 0x7f0024102570 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.784+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0018018a70 con 0x7f0024102570 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.785+0000 7f000bfff640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 0x7f000c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.785+0000 7f0022ffd640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 0x7f000c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.785+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f00180cf1e0 con 0x7f0024102570 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.785+0000 7f0022ffd640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 0x7f000c0a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0014000c00 tx=0x7f0014005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:04.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.789+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0018014030 con 0x7f0024102570 2024-09-12T01:56:04.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.975+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f002410a0a0 con 0x7f0024102570 2024-09-12T01:56:04.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.975+0000 7f000bfff640 1 -- 172.21.15.39:0/2047943366 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f001809bff0 con 0x7f0024102570 2024-09-12T01:56:04.975 INFO:teuthology.orchestra.run.smithi039.stdout:73014444103 2024-09-12T01:56:04.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 msgr2=0x7f000c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 0x7f000c0a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0014000c00 tx=0x7f0014005b50 comp rx=0 tx=0).stop 2024-09-12T01:56:04.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 msgr2=0x7f00240fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:04.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f001800c920 tx=0x7f001800cde0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 shutdown_connections 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024102ef0 0x7f00240fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024102570 0x7f00240fd1c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f000c0a2c90 0x7f000c0a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 --2- 172.21.15.39:0/2047943366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024100e20 0x7f00240fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 >> 172.21.15.39:0/2047943366 conn(0x7f00240fc7d0 msgr2=0x7f002406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 shutdown_connections 2024-09-12T01:56:04.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.977+0000 7f0029574640 1 -- 172.21.15.39:0/2047943366 wait complete. 2024-09-12T01:56:05.086 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:56:05.086 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1221524507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:56:05.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/779553267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:56:05.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:04 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:56:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T01:56:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T01:56:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1221524507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/779553267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:04 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T01:56:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1221524507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/779553267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.255 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:04 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 -- 172.21.15.39:0/2831010277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80106a80 msgr2=0x7efc80106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 --2- 172.21.15.39:0/2831010277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80106a80 0x7efc80106e60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009930 tx=0x7efc7c02a420 comp rx=0 tx=0).stop 2024-09-12T01:56:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 -- 172.21.15.39:0/2831010277 shutdown_connections 2024-09-12T01:56:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 --2- 172.21.15.39:0/2831010277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80101420 0x7efc8010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 --2- 172.21.15.39:0/2831010277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80100a80 0x7efc80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 --2- 172.21.15.39:0/2831010277 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80106a80 0x7efc80106e60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 -- 172.21.15.39:0/2831010277 >> 172.21.15.39:0/2831010277 conn(0x7efc800fc7a0 msgr2=0x7efc800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 -- 172.21.15.39:0/2831010277 shutdown_connections 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.398+0000 7efc8855c640 1 -- 172.21.15.39:0/2831010277 wait complete. 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 Processor -- start 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 -- start start 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80100a80 0x7efc8019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 0x7efc8019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110e80 con 0x7efc80101420 2024-09-12T01:56:05.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110d00 con 0x7efc80106a80 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc8855c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc80111000 con 0x7efc80100a80 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44070/0 (socket says 172.21.15.39:44070) 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 -- 172.21.15.39:0/3041257042 learned_addr learned my addr 172.21.15.39:0/3041257042 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc862f8640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80100a80 0x7efc8019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc86af9640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 0x7efc8019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 -- 172.21.15.39:0/3041257042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80100a80 msgr2=0x7efc8019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80100a80 0x7efc8019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 -- 172.21.15.39:0/3041257042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 msgr2=0x7efc8019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 0x7efc8019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc85af7640 1 -- 172.21.15.39:0/3041257042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8019f580 con 0x7efc80101420 2024-09-12T01:56:05.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.399+0000 7efc86af9640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 0x7efc8019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc85af7640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c920 tx=0x7efc7000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70007c70 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc70007e10 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc8019f870 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70018890 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.400+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc801a7150 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.401+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc80100ee0 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.402+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc70018a70 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.403+0000 7efc777fe640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 0x7efc6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.403+0000 7efc862f8640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 0x7efc6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.403+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efc700cf310 con 0x7efc80101420 2024-09-12T01:56:05.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.403+0000 7efc862f8640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 0x7efc6c0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009900 tx=0x7efc7c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.407+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc70014030 con 0x7efc80101420 2024-09-12T01:56:05.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.595+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efc801a7480 con 0x7efc80101420 2024-09-12T01:56:05.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.596+0000 7efc777fe640 1 -- 172.21.15.39:0/3041257042 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc7009c120 con 0x7efc80101420 2024-09-12T01:56:05.596 INFO:teuthology.orchestra.run.smithi039.stdout:98784247874 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 msgr2=0x7efc6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 0x7efc6c0a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009900 tx=0x7efc7c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 msgr2=0x7efc8019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c920 tx=0x7efc7000cde0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 shutdown_connections 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc80106a80 0x7efc8019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc80101420 0x7efc8019ab10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efc6c0a2c10 0x7efc6c0a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 --2- 172.21.15.39:0/3041257042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80100a80 0x7efc8019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 >> 172.21.15.39:0/3041257042 conn(0x7efc800fc7a0 msgr2=0x7efc8006a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 shutdown_connections 2024-09-12T01:56:05.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.598+0000 7efc8855c640 1 -- 172.21.15.39:0/3041257042 wait complete. 2024-09-12T01:56:06.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 -- 172.21.15.39:0/2241141935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8102790 msgr2=0x7f62f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/2241141935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8102790 0x7f62f81067e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009900 tx=0x7f62e802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:06.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 -- 172.21.15.39:0/2241141935 shutdown_connections 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/2241141935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8106f10 0x7f62f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/2241141935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8102790 0x7f62f81067e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/2241141935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8101de0 0x7f62f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.984+0000 7f62fdfaf640 1 -- 172.21.15.39:0/2241141935 >> 172.21.15.39:0/2241141935 conn(0x7f62f80fd8c0 msgr2=0x7f62f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 -- 172.21.15.39:0/2241141935 shutdown_connections 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 -- 172.21.15.39:0/2241141935 wait complete. 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 Processor -- start 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 -- start start 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8102790 0x7f62f81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.985+0000 7f62fdfaf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8106f10 0x7f62f819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62fdfaf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8111f70 con 0x7f62f8106f10 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62fdfaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8111df0 con 0x7f62f8101de0 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62fdfaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81120f0 con 0x7f62f8102790 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8106f10 0x7f62f819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8102790 0x7f62f81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49714/0 (socket says 172.21.15.39:49714) 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 -- 172.21.15.39:0/1221524507 learned_addr learned my addr 172.21.15.39:0/1221524507 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 -- 172.21.15.39:0/1221524507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8102790 msgr2=0x7f62f81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8102790 0x7f62f81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 -- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8106f10 msgr2=0x7f62f819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8106f10 0x7f62f819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 -- 172.21.15.39:0/1221524507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f819d460 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f77fe640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62e000d950 tx=0x7f62e000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0017070 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e0009c30 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f819d750 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.986+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e000f6b0 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.987+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a5030 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.988+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f81021c0 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.989+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f62e00109d0 con 0x7f62f8101de0 2024-09-12T01:56:06.039 INFO:teuthology.orchestra.run.smithi039.stdout:34359738450 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.991+0000 7f62f4ff9640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 0x7f62e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.991+0000 7f62f6ffd640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 0x7f62e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.991+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f62e00ceda0 con 0x7f62f8101de0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.991+0000 7f62f6ffd640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 0x7f62e40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009230 tx=0x7f62e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:03.995+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62e0009de0 con 0x7f62f8101de0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.173+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f62f8199810 con 0x7f62f8101de0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.174+0000 7f62f4ff9640 1 -- 172.21.15.39:0/1221524507 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62e009b560 con 0x7f62f8101de0 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 msgr2=0x7f62e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 0x7f62e40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009230 tx=0x7f62e80058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 msgr2=0x7f62f81984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62e000d950 tx=0x7f62e000de10 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 shutdown_connections 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62f8106f10 0x7f62f819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62e40a2c10 0x7f62e40a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8102790 0x7f62f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 --2- 172.21.15.39:0/1221524507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f8101de0 0x7f62f81984b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 >> 172.21.15.39:0/1221524507 conn(0x7f62f80fd8c0 msgr2=0x7f62f80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 shutdown_connections 2024-09-12T01:56:06.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:04.176+0000 7f62fdfaf640 1 -- 172.21.15.39:0/1221524507 wait complete. 2024-09-12T01:56:06.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:05 smithi039 ceph-mon[31204]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:06.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:05 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2047943366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:56:06.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:05 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3909772067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:56:06.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:05 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3041257042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:56:06.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:05 smithi044 ceph-mon[35259]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:06.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:05 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2047943366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:56:06.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:05 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3909772067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:56:06.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:05 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3041257042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:56:06.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:05 smithi172 ceph-mon[35073]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:56:06.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:05 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2047943366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:56:06.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:05 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3909772067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:56:06.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:05 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3041257042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:56:06.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234021 got 231928234023 for osd.8 2024-09-12T01:56:06.579 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 -- 172.21.15.39:0/2403329259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470106a90 msgr2=0x7fe470106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 --2- 172.21.15.39:0/2403329259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470106a90 0x7fe470106e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009930 tx=0x7fe46c02a420 comp rx=0 tx=0).stop 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 -- 172.21.15.39:0/2403329259 shutdown_connections 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 --2- 172.21.15.39:0/2403329259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470101430 0x7fe47010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 --2- 172.21.15.39:0/2403329259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470100a90 0x7fe470100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 --2- 172.21.15.39:0/2403329259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470106a90 0x7fe470106e70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 -- 172.21.15.39:0/2403329259 >> 172.21.15.39:0/2403329259 conn(0x7fe4700fc7d0 msgr2=0x7fe4700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.086+0000 7fe4775f3640 1 -- 172.21.15.39:0/2403329259 shutdown_connections 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.087+0000 7fe4775f3640 1 -- 172.21.15.39:0/2403329259 wait complete. 2024-09-12T01:56:06.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.087+0000 7fe4775f3640 1 Processor -- start 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.087+0000 7fe4775f3640 1 -- start start 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470100a90 0x7fe470198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470106a90 0x7fe47019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe470110e90 con 0x7fe470101430 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe470110d10 con 0x7fe470106a90 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4775f3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe470111010 con 0x7fe470100a90 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44060/0 (socket says 172.21.15.39:44060) 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 -- 172.21.15.39:0/3909772067 learned_addr learned my addr 172.21.15.39:0/3909772067 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe47538f640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470100a90 0x7fe470198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe475b90640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470106a90 0x7fe47019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 -- 172.21.15.39:0/3909772067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470100a90 msgr2=0x7fe470198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470100a90 0x7fe470198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 -- 172.21.15.39:0/3909772067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470106a90 msgr2=0x7fe47019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470106a90 0x7fe47019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 -- 172.21.15.39:0/3909772067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47019d400 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe474b8e640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe46000d950 tx=0x7fe46000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.088+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460017030 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.089+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47019d6f0 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.089+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe460004020 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.089+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600047a0 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.089+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4701a4fd0 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.090+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe470100ef0 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.091+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe4600041d0 con 0x7fe470101430 2024-09-12T01:56:06.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.091+0000 7fe4667fc640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 0x7fe45c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.091+0000 7fe47538f640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 0x7fe45c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stdout:266287972387 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.092+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe4600ceae0 con 0x7fe470101430 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.092+0000 7fe47538f640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 0x7fe45c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009900 tx=0x7fe46c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.095+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe46009b8f0 con 0x7fe470101430 2024-09-12T01:56:06.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.286+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe470109a80 con 0x7fe470101430 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.287+0000 7fe4667fc640 1 -- 172.21.15.39:0/3909772067 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe46009b1f0 con 0x7fe470101430 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 msgr2=0x7fe45c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 0x7fe45c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009900 tx=0x7fe46c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 msgr2=0x7fe470198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe46000d950 tx=0x7fe46000de10 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 shutdown_connections 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe470106a90 0x7fe47019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe470101430 0x7fe470198990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe45c0a2c10 0x7fe45c0a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 --2- 172.21.15.39:0/3909772067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe470100a90 0x7fe470198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 >> 172.21.15.39:0/3909772067 conn(0x7fe4700fc7d0 msgr2=0x7fe47006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 shutdown_connections 2024-09-12T01:56:06.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:05.289+0000 7fe4775f3640 1 -- 172.21.15.39:0/3909772067 wait complete. 2024-09-12T01:56:07.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:06 smithi039 ceph-mon[31204]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:56:07.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:06 smithi044 ceph-mon[35259]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:56:07.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:06 smithi172 ceph-mon[35073]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T01:56:07.299 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888115 got 146028888118 for osd.5 2024-09-12T01:56:07.299 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:07.863 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738450 for osd.0 2024-09-12T01:56:07.863 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:08.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 -- 172.21.15.39:0/3290645473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0101e10 msgr2=0x7f60d01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 --2- 172.21.15.39:0/3290645473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0101e10 0x7f60d01021f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009900 tx=0x7f60cc02a410 comp rx=0 tx=0).stop 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 -- 172.21.15.39:0/3290645473 shutdown_connections 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 --2- 172.21.15.39:0/3290645473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0106f40 0x7f60d010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 --2- 172.21.15.39:0/3290645473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 0x7f60d0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 --2- 172.21.15.39:0/3290645473 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0101e10 0x7f60d01021f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.051+0000 7f60d8423640 1 -- 172.21.15.39:0/3290645473 >> 172.21.15.39:0/3290645473 conn(0x7f60d00fd8d0 msgr2=0x7f60d00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- 172.21.15.39:0/3290645473 shutdown_connections 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- 172.21.15.39:0/3290645473 wait complete. 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 Processor -- start 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- start start 2024-09-12T01:56:08.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0101e10 0x7f60d0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 0x7f60d01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0111fc0 con 0x7f60d0106f40 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0111e40 con 0x7f60d01027c0 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d8423640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0112140 con 0x7f60d0101e10 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.052+0000 7f60d69c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44096/0 (socket says 172.21.15.39:44096) 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 -- 172.21.15.39:0/761861002 learned_addr learned my addr 172.21.15.39:0/761861002 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d59be640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 0x7f60d01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d61bf640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0101e10 0x7f60d0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 -- 172.21.15.39:0/761861002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0101e10 msgr2=0x7f60d0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0101e10 0x7f60d0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 -- 172.21.15.39:0/761861002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 msgr2=0x7f60d01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:08.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 0x7f60d01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 -- 172.21.15.39:0/761861002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d019d410 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d69c0640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60c800b970 tx=0x7f60c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8019070 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c800cb40 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d019d700 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8007650 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.053+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d01a4fe0 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.055+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d01021f0 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.056+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f60c801c070 con 0x7f60d0106f40 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.056+0000 7f60c77fe640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 0x7f60bc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.057+0000 7f60d61bf640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 0x7f60bc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:08.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.057+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f60c80ce650 con 0x7f60d0106f40 2024-09-12T01:56:08.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.057+0000 7f60d61bf640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 0x7f60bc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0096c0 tx=0x7f60cc031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:08.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.061+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60c809af20 con 0x7f60d0106f40 2024-09-12T01:56:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.238+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f60d0109b90 con 0x7f60d0106f40 2024-09-12T01:56:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.238+0000 7f60c77fe640 1 -- 172.21.15.39:0/761861002 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f60c809f220 con 0x7f60d0106f40 2024-09-12T01:56:08.238 INFO:teuthology.orchestra.run.smithi039.stdout:128849018941 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 msgr2=0x7f60bc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 0x7f60bc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0096c0 tx=0x7f60cc031490 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 msgr2=0x7f60d019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60c800b970 tx=0x7f60c800be30 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 shutdown_connections 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60d0106f40 0x7f60d019cd30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60d01027c0 0x7f60d01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60bc0a2c10 0x7f60bc0a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 --2- 172.21.15.39:0/761861002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d0101e10 0x7f60d0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 >> 172.21.15.39:0/761861002 conn(0x7f60d00fd8d0 msgr2=0x7f60d00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:08.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 shutdown_connections 2024-09-12T01:56:08.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:08.240+0000 7f60d8423640 1 -- 172.21.15.39:0/761861002 wait complete. 2024-09-12T01:56:08.521 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:08.534 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972385 got 266287972387 for osd.9 2024-09-12T01:56:08.534 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:08.944 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444101 got 73014444103 for osd.2 2024-09-12T01:56:08.945 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:09.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:08 smithi044 ceph-mon[35259]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:09.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:08 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/761861002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:56:09.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:08 smithi172 ceph-mon[35073]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:09.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:08 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/761861002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:56:09.310 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:08 smithi039 ceph-mon[31204]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:09.310 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:08 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/761861002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:56:09.340 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247871 got 98784247874 for osd.3 2024-09-12T01:56:09.340 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:10.237 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808860 got 287762808862 for osd.10 2024-09-12T01:56:10.237 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:10.658 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018937 got 128849018941 for osd.4 2024-09-12T01:56:10.658 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:10.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 -- 172.21.15.39:0/1081162276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 msgr2=0x7f435810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 --2- 172.21.15.39:0/1081162276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435810da40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ca0 tx=0x7f435002a950 comp rx=0 tx=0).stop 2024-09-12T01:56:10.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 -- 172.21.15.39:0/1081162276 shutdown_connections 2024-09-12T01:56:10.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 --2- 172.21.15.39:0/1081162276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435810da40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 --2- 172.21.15.39:0/1081162276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358102570 0x7f43581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 --2- 172.21.15.39:0/1081162276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358100e20 0x7f4358101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 -- 172.21.15.39:0/1081162276 >> 172.21.15.39:0/1081162276 conn(0x7f43580fc7d0 msgr2=0x7f43580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 -- 172.21.15.39:0/1081162276 shutdown_connections 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.847+0000 7f4360657640 1 -- 172.21.15.39:0/1081162276 wait complete. 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 Processor -- start 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 -- start start 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358100e20 0x7f43581984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358102570 0x7f4358198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4358110f80 con 0x7f4358102ef0 2024-09-12T01:56:10.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4358110e00 con 0x7f4358102570 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.848+0000 7f4360657640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4358111100 con 0x7f4358100e20 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435e3f3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358100e20 0x7f43581984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44114/0 (socket says 172.21.15.39:44114) 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 -- 172.21.15.39:0/1316102944 learned_addr learned my addr 172.21.15.39:0/1316102944 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435dbf2640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358102570 0x7f4358198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 -- 172.21.15.39:0/1316102944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358100e20 msgr2=0x7f43581984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358100e20 0x7f43581984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 -- 172.21.15.39:0/1316102944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358102570 msgr2=0x7f4358198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358102570 0x7f4358198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 -- 172.21.15.39:0/1316102944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435819d490 con 0x7f4358102ef0 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f435ebf4640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f435002ae70 tx=0x7f435002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:10.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350034040 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4350030920 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435819d720 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.849+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350045480 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.850+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43581a5060 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.851+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43581021b0 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.852+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4350037020 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.853+0000 7f434f7fe640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.853+0000 7f435e3f3640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.853+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f43500eff10 con 0x7f4358102ef0 2024-09-12T01:56:10.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.853+0000 7f435e3f3640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 0x7f43440a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f435400bbe0 tx=0x7f435400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:10.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:10.857+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43500bce30 con 0x7f4358102ef0 2024-09-12T01:56:11.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.046+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f435810a0a0 con 0x7f4358102ef0 2024-09-12T01:56:11.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.047+0000 7f434f7fe640 1 -- 172.21.15.39:0/1316102944 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f43500bc730 con 0x7f4358102ef0 2024-09-12T01:56:11.047 INFO:teuthology.orchestra.run.smithi039.stdout:317827579930 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 msgr2=0x7f43440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 0x7f43440a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f435400bbe0 tx=0x7f435400b390 comp rx=0 tx=0).stop 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 msgr2=0x7f435819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f435002ae70 tx=0x7f435002f5d0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 shutdown_connections 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4358102ef0 0x7f435819cdb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4358102570 0x7f4358198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 --2- 172.21.15.39:0/1316102944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4358100e20 0x7f43581984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 >> 172.21.15.39:0/1316102944 conn(0x7f43580fc7d0 msgr2=0x7f435806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 shutdown_connections 2024-09-12T01:56:11.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:11.049+0000 7f4360657640 1 -- 172.21.15.39:0/1316102944 wait complete. 2024-09-12T01:56:11.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:10 smithi044 ceph-mon[35259]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:11.184 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:10 smithi039 ceph-mon[31204]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:10 smithi172 ceph-mon[35073]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:11.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579927 got 317827579930 for osd.11 2024-09-12T01:56:11.973 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:11.974 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:56:11.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:56:12.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:11 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1316102944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:56:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:12.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:11 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1316102944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:56:12.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:11 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1316102944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:56:12.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.878+0000 7facc7dd6640 1 -- 172.21.15.39:0/3795231751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074eb0 msgr2=0x7facc0112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3795231751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074eb0 0x7facc0112650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7facb0009900 tx=0x7facb002a480 comp rx=0 tx=0).stop 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 -- 172.21.15.39:0/3795231751 shutdown_connections 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3795231751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 0x7facc0114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3795231751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074eb0 0x7facc0112650 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3795231751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074590 0x7facc0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 -- 172.21.15.39:0/3795231751 >> 172.21.15.39:0/3795231751 conn(0x7facc00fd8c0 msgr2=0x7facc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 -- 172.21.15.39:0/3795231751 shutdown_connections 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 -- 172.21.15.39:0/3795231751 wait complete. 2024-09-12T01:56:12.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 Processor -- start 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 -- start start 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.879+0000 7facc7dd6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074eb0 0x7facc01a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 0x7facc019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7facc0118560 con 0x7facc0074590 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7facc01183e0 con 0x7facc0074eb0 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facc01186e0 con 0x7facc0112b90 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36156/0 (socket says 172.21.15.39:36156) 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 -- 172.21.15.39:0/3715013281 learned_addr learned my addr 172.21.15.39:0/3715013281 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5371640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074eb0 0x7facc01a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc6373640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 0x7facc019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 -- 172.21.15.39:0/3715013281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 msgr2=0x7facc019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 0x7facc019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 -- 172.21.15.39:0/3715013281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074eb0 msgr2=0x7facc01a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074eb0 0x7facc01a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 -- 172.21.15.39:0/3715013281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc019f000 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc5b72640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c890 tx=0x7facbc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc004220 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc019f2f0 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facbc0043c0 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc004a00 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.880+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01ab5e0 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.882+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc0074970 con 0x7facc0074590 2024-09-12T01:56:12.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.883+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7facbc0079b0 con 0x7facc0074590 2024-09-12T01:56:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.883+0000 7facb6ffd640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 0x7facac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.884+0000 7facc5371640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 0x7facac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.884+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7facbc0cf270 con 0x7facc0074590 2024-09-12T01:56:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.884+0000 7facc5371640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 0x7facac0a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7facb0009230 tx=0x7facb00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:12.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:12.887+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facbc014030 con 0x7facc0074590 2024-09-12T01:56:13.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.073+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facc0062630 con 0x7facac0a2c10 2024-09-12T01:56:13.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:12 smithi039 ceph-mon[31204]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:13.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.079+0000 7facb6ffd640 1 -- 172.21.15.39:0/3715013281 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258904 (secure 0 0 0) 0x7facc0062630 con 0x7facac0a2c10 2024-09-12T01:56:13.082 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:13.083 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:56:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 msgr2=0x7facac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 0x7facac0a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7facb0009230 tx=0x7facb00058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 msgr2=0x7facc01a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c890 tx=0x7facbc00cd50 comp rx=0 tx=0).stop 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 shutdown_connections 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7facac0a2c10 0x7facac0a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc0112b90 0x7facc019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facc0074eb0 0x7facc01a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 --2- 172.21.15.39:0/3715013281 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7facc0074590 0x7facc01a4710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 >> 172.21.15.39:0/3715013281 conn(0x7facc00fd8c0 msgr2=0x7facc00ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 shutdown_connections 2024-09-12T01:56:13.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:13.084+0000 7facc7dd6640 1 -- 172.21.15.39:0/3715013281 wait complete. 2024-09-12T01:56:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:12 smithi172 ceph-mon[35073]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:13.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:12 smithi044 ceph-mon[35259]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 16 B/s, 1 objects/s recovering 2024-09-12T01:56:13.869 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-12T01:56:11.253228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655777,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":466,"num_read_kb":345,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360364,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581460,"statfs":{"total":1151940427776,"available":1151571415040,"internally_reserved":0,"allocated":11304960,"data_stored":7222251,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":24,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002328"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889635+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:04.889635+0000","last_peered":"2024-09-12T01:56:04.889635+0000","last_clean":"2024-09-12T01:56:04.889635+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:04.889635+0000","last_undegraded":"2024-09-12T01:56:04.889635+0000","last_fullsized":"2024-09-12T01:56:04.889635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890575+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:04.890575+0000","last_peered":"2024-09-12T01:56:04.890575+0000","last_clean":"2024-09-12T01:56:04.890575+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:04.890575+0000","last_undegraded":"2024-09-12T01:56:04.890575+0000","last_fullsized":"2024-09-12T01:56:04.890575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890672+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:04.890672+0000","last_peered":"2024-09-12T01:56:04.890672+0000","last_clean":"2024-09-12T01:56:04.890672+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:04.890672+0000","last_undegraded":"2024-09-12T01:56:04.890672+0000","last_fullsized":"2024-09-12T01:56:04.890672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887006+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:04.887006+0000","last_peered":"2024-09-12T01:56:04.887006+0000","last_clean":"2024-09-12T01:56:04.887006+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:04.887006+0000","last_undegraded":"2024-09-12T01:56:04.887006+0000","last_fullsized":"2024-09-12T01:56:04.887006+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890644+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:04.890644+0000","last_peered":"2024-09-12T01:56:04.890644+0000","last_clean":"2024-09-12T01:56:04.890644+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:04.890644+0000","last_undegraded":"2024-09-12T01:56:04.890644+0000","last_fullsized":"2024-09-12T01:56:04.890644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888372+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:04.888372+0000","last_peered":"2024-09-12T01:56:04.888372+0000","last_clean":"2024-09-12T01:56:04.888372+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:04.888372+0000","last_undegraded":"2024-09-12T01:56:04.888372+0000","last_fullsized":"2024-09-12T01:56:04.888372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187496+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:05.187496+0000","last_peered":"2024-09-12T01:56:05.187496+0000","last_clean":"2024-09-12T01:56:05.187496+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:05.187496+0000","last_undegraded":"2024-09-12T01:56:05.187496+0000","last_fullsized":"2024-09-12T01:56:05.187496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524736+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:05.524736+0000","last_peered":"2024-09-12T01:56:05.524736+0000","last_clean":"2024-09-12T01:56:05.524736+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:05.524736+0000","last_undegraded":"2024-09-12T01:56:05.524736+0000","last_fullsized":"2024-09-12T01:56:05.524736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524029+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:05.524029+0000","last_peered":"2024-09-12T01:56:05.524029+0000","last_clean":"2024-09-12T01:56:05.524029+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:05.524029+0000","last_undegraded":"2024-09-12T01:56:05.524029+0000","last_fullsized":"2024-09-12T01:56:05.524029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.893446+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:04.893446+0000","last_peered":"2024-09-12T01:56:04.893446+0000","last_clean":"2024-09-12T01:56:04.893446+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:04.893446+0000","last_undegraded":"2024-09-12T01:56:04.893446+0000","last_fullsized":"2024-09-12T01:56:04.893446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187613+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:05.187613+0000","last_peered":"2024-09-12T01:56:05.187613+0000","last_clean":"2024-09-12T01:56:05.187613+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:05.187613+0000","last_undegraded":"2024-09-12T01:56:05.187613+0000","last_fullsized":"2024-09-12T01:56:05.187613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.893418+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:04.893418+0000","last_peered":"2024-09-12T01:56:04.893418+0000","last_clean":"2024-09-12T01:56:04.893418+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:04.893418+0000","last_undegraded":"2024-09-12T01:56:04.893418+0000","last_fullsized":"2024-09-12T01:56:04.893418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888288+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:04.888288+0000","last_peered":"2024-09-12T01:56:04.888288+0000","last_clean":"2024-09-12T01:56:04.888288+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:04.888288+0000","last_undegraded":"2024-09-12T01:56:04.888288+0000","last_fullsized":"2024-09-12T01:56:04.888288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890868+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:04.890868+0000","last_peered":"2024-09-12T01:56:04.890868+0000","last_clean":"2024-09-12T01:56:04.890868+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:04.890868+0000","last_undegraded":"2024-09-12T01:56:04.890868+0000","last_fullsized":"2024-09-12T01:56:04.890868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890723+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:04.890723+0000","last_peered":"2024-09-12T01:56:04.890723+0000","last_clean":"2024-09-12T01:56:04.890723+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:04.890723+0000","last_undegraded":"2024-09-12T01:56:04.890723+0000","last_fullsized":"2024-09-12T01:56:04.890723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524140+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:05.524140+0000","last_peered":"2024-09-12T01:56:05.524140+0000","last_clean":"2024-09-12T01:56:05.524140+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:05.524140+0000","last_undegraded":"2024-09-12T01:56:05.524140+0000","last_fullsized":"2024-09-12T01:56:05.524140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889724+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:04.889724+0000","last_peered":"2024-09-12T01:56:04.889724+0000","last_clean":"2024-09-12T01:56:04.889724+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:04.889724+0000","last_undegraded":"2024-09-12T01:56:04.889724+0000","last_fullsized":"2024-09-12T01:56:04.889724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889384+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:04.889384+0000","last_peered":"2024-09-12T01:56:04.889384+0000","last_clean":"2024-09-12T01:56:04.889384+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:04.889384+0000","last_undegraded":"2024-09-12T01:56:04.889384+0000","last_fullsized":"2024-09-12T01:56:04.889384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887667+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:04.887667+0000","last_peered":"2024-09-12T01:56:04.887667+0000","last_clean":"2024-09-12T01:56:04.887667+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:04.887667+0000","last_undegraded":"2024-09-12T01:56:04.887667+0000","last_fullsized":"2024-09-12T01:56:04.887667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888999+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:04.888999+0000","last_peered":"2024-09-12T01:56:04.888999+0000","last_clean":"2024-09-12T01:56:04.888999+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:04.888999+0000","last_undegraded":"2024-09-12T01:56:04.888999+0000","last_fullsized":"2024-09-12T01:56:04.888999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888296+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:04.888296+0000","last_peered":"2024-09-12T01:56:04.888296+0000","last_clean":"2024-09-12T01:56:04.888296+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:04.888296+0000","last_undegraded":"2024-09-12T01:56:04.888296+0000","last_fullsized":"2024-09-12T01:56:04.888296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523762+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:05.523762+0000","last_peered":"2024-09-12T01:56:05.523762+0000","last_clean":"2024-09-12T01:56:05.523762+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:05.523762+0000","last_undegraded":"2024-09-12T01:56:05.523762+0000","last_fullsized":"2024-09-12T01:56:05.523762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890673+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:04.890673+0000","last_peered":"2024-09-12T01:56:04.890673+0000","last_clean":"2024-09-12T01:56:04.890673+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:04.890673+0000","last_undegraded":"2024-09-12T01:56:04.890673+0000","last_fullsized":"2024-09-12T01:56:04.890673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523980+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:05.523980+0000","last_peered":"2024-09-12T01:56:05.523980+0000","last_clean":"2024-09-12T01:56:05.523980+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:05.523980+0000","last_undegraded":"2024-09-12T01:56:05.523980+0000","last_fullsized":"2024-09-12T01:56:05.523980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892005+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:04.892005+0000","last_peered":"2024-09-12T01:56:04.892005+0000","last_clean":"2024-09-12T01:56:04.892005+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:04.892005+0000","last_undegraded":"2024-09-12T01:56:04.892005+0000","last_fullsized":"2024-09-12T01:56:04.892005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887824+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:04.887824+0000","last_peered":"2024-09-12T01:56:04.887824+0000","last_clean":"2024-09-12T01:56:04.887824+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:04.887824+0000","last_undegraded":"2024-09-12T01:56:04.887824+0000","last_fullsized":"2024-09-12T01:56:04.887824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889806+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:04.889806+0000","last_peered":"2024-09-12T01:56:04.889806+0000","last_clean":"2024-09-12T01:56:04.889806+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:04.889806+0000","last_undegraded":"2024-09-12T01:56:04.889806+0000","last_fullsized":"2024-09-12T01:56:04.889806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888161+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:04.888161+0000","last_peered":"2024-09-12T01:56:04.888161+0000","last_clean":"2024-09-12T01:56:04.888161+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:04.888161+0000","last_undegraded":"2024-09-12T01:56:04.888161+0000","last_fullsized":"2024-09-12T01:56:04.888161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890990+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:04.890990+0000","last_peered":"2024-09-12T01:56:04.890990+0000","last_clean":"2024-09-12T01:56:04.890990+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:04.890990+0000","last_undegraded":"2024-09-12T01:56:04.890990+0000","last_fullsized":"2024-09-12T01:56:04.890990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887393+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:04.887393+0000","last_peered":"2024-09-12T01:56:04.887393+0000","last_clean":"2024-09-12T01:56:04.887393+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:04.887393+0000","last_undegraded":"2024-09-12T01:56:04.887393+0000","last_fullsized":"2024-09-12T01:56:04.887393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887436+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:04.887436+0000","last_peered":"2024-09-12T01:56:04.887436+0000","last_clean":"2024-09-12T01:56:04.887436+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:04.887436+0000","last_undegraded":"2024-09-12T01:56:04.887436+0000","last_fullsized":"2024-09-12T01:56:04.887436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888750+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:04.888750+0000","last_peered":"2024-09-12T01:56:04.888750+0000","last_clean":"2024-09-12T01:56:04.888750+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:04.888750+0000","last_undegraded":"2024-09-12T01:56:04.888750+0000","last_fullsized":"2024-09-12T01:56:04.888750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890719+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:04.890719+0000","last_peered":"2024-09-12T01:56:04.890719+0000","last_clean":"2024-09-12T01:56:04.890719+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:04.890719+0000","last_undegraded":"2024-09-12T01:56:04.890719+0000","last_fullsized":"2024-09-12T01:56:04.890719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:07.747147+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:07.747147+0000","last_peered":"2024-09-12T01:56:07.747147+0000","last_clean":"2024-09-12T01:56:07.747147+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:07.747147+0000","last_undegraded":"2024-09-12T01:56:07.747147+0000","last_fullsized":"2024-09-12T01:56:07.747147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523789+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:05.523789+0000","last_peered":"2024-09-12T01:56:05.523789+0000","last_clean":"2024-09-12T01:56:05.523789+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:05.523789+0000","last_undegraded":"2024-09-12T01:56:05.523789+0000","last_fullsized":"2024-09-12T01:56:05.523789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890448+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:04.890448+0000","last_peered":"2024-09-12T01:56:04.890448+0000","last_clean":"2024-09-12T01:56:04.890448+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:04.890448+0000","last_undegraded":"2024-09-12T01:56:04.890448+0000","last_fullsized":"2024-09-12T01:56:04.890448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888847+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:04.888847+0000","last_peered":"2024-09-12T01:56:04.888847+0000","last_clean":"2024-09-12T01:56:04.888847+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:04.888847+0000","last_undegraded":"2024-09-12T01:56:04.888847+0000","last_fullsized":"2024-09-12T01:56:04.888847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:08.747578+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:08.747578+0000","last_peered":"2024-09-12T01:56:08.747578+0000","last_clean":"2024-09-12T01:56:08.747578+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:08.747578+0000","last_undegraded":"2024-09-12T01:56:08.747578+0000","last_fullsized":"2024-09-12T01:56:08.747578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523960+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:05.523960+0000","last_peered":"2024-09-12T01:56:05.523960+0000","last_clean":"2024-09-12T01:56:05.523960+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:05.523960+0000","last_undegraded":"2024-09-12T01:56:05.523960+0000","last_fullsized":"2024-09-12T01:56:05.523960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524535+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:05.524535+0000","last_peered":"2024-09-12T01:56:05.524535+0000","last_clean":"2024-09-12T01:56:05.524535+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:05.524535+0000","last_undegraded":"2024-09-12T01:56:05.524535+0000","last_fullsized":"2024-09-12T01:56:05.524535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523784+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:05.523784+0000","last_peered":"2024-09-12T01:56:05.523784+0000","last_clean":"2024-09-12T01:56:05.523784+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:05.523784+0000","last_undegraded":"2024-09-12T01:56:05.523784+0000","last_fullsized":"2024-09-12T01:56:05.523784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'29","reported_seq":166,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:09.748891+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:09.748891+0000","last_peered":"2024-09-12T01:56:09.748891+0000","last_clean":"2024-09-12T01:56:09.748891+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:09.748891+0000","last_undegraded":"2024-09-12T01:56:09.748891+0000","last_fullsized":"2024-09-12T01:56:09.748891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61172,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":116,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890723+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:04.890723+0000","last_peered":"2024-09-12T01:56:04.890723+0000","last_clean":"2024-09-12T01:56:04.890723+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:04.890723+0000","last_undegraded":"2024-09-12T01:56:04.890723+0000","last_fullsized":"2024-09-12T01:56:04.890723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887839+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:04.887839+0000","last_peered":"2024-09-12T01:56:04.887839+0000","last_clean":"2024-09-12T01:56:04.887839+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:04.887839+0000","last_undegraded":"2024-09-12T01:56:04.887839+0000","last_fullsized":"2024-09-12T01:56:04.887839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187685+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:05.187685+0000","last_peered":"2024-09-12T01:56:05.187685+0000","last_clean":"2024-09-12T01:56:05.187685+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:05.187685+0000","last_undegraded":"2024-09-12T01:56:05.187685+0000","last_fullsized":"2024-09-12T01:56:05.187685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:08.769173+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:08.769173+0000","last_peered":"2024-09-12T01:56:08.769173+0000","last_clean":"2024-09-12T01:56:08.769173+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:08.769173+0000","last_undegraded":"2024-09-12T01:56:08.769173+0000","last_fullsized":"2024-09-12T01:56:08.769173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187458+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:05.187458+0000","last_peered":"2024-09-12T01:56:05.187458+0000","last_clean":"2024-09-12T01:56:05.187458+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:05.187458+0000","last_undegraded":"2024-09-12T01:56:05.187458+0000","last_fullsized":"2024-09-12T01:56:05.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523665+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:05.523665+0000","last_peered":"2024-09-12T01:56:05.523665+0000","last_clean":"2024-09-12T01:56:05.523665+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:05.523665+0000","last_undegraded":"2024-09-12T01:56:05.523665+0000","last_fullsized":"2024-09-12T01:56:05.523665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889241+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:04.889241+0000","last_peered":"2024-09-12T01:56:04.889241+0000","last_clean":"2024-09-12T01:56:04.889241+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:04.889241+0000","last_undegraded":"2024-09-12T01:56:04.889241+0000","last_fullsized":"2024-09-12T01:56:04.889241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187859+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:05.187859+0000","last_peered":"2024-09-12T01:56:05.187859+0000","last_clean":"2024-09-12T01:56:05.187859+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:05.187859+0000","last_undegraded":"2024-09-12T01:56:05.187859+0000","last_fullsized":"2024-09-12T01:56:05.187859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187592+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:05.187592+0000","last_peered":"2024-09-12T01:56:05.187592+0000","last_clean":"2024-09-12T01:56:05.187592+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:05.187592+0000","last_undegraded":"2024-09-12T01:56:05.187592+0000","last_fullsized":"2024-09-12T01:56:05.187592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187806+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:05.187806+0000","last_peered":"2024-09-12T01:56:05.187806+0000","last_clean":"2024-09-12T01:56:05.187806+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:05.187806+0000","last_undegraded":"2024-09-12T01:56:05.187806+0000","last_fullsized":"2024-09-12T01:56:05.187806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187585+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187585+0000","last_peered":"2024-09-12T01:56:05.187585+0000","last_clean":"2024-09-12T01:56:05.187585+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187585+0000","last_undegraded":"2024-09-12T01:56:05.187585+0000","last_fullsized":"2024-09-12T01:56:05.187585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891661+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:04.891661+0000","last_peered":"2024-09-12T01:56:04.891661+0000","last_clean":"2024-09-12T01:56:04.891661+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:04.891661+0000","last_undegraded":"2024-09-12T01:56:04.891661+0000","last_fullsized":"2024-09-12T01:56:04.891661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887682+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:04.887682+0000","last_peered":"2024-09-12T01:56:04.887682+0000","last_clean":"2024-09-12T01:56:04.887682+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:04.887682+0000","last_undegraded":"2024-09-12T01:56:04.887682+0000","last_fullsized":"2024-09-12T01:56:04.887682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":75,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887926+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:04.887926+0000","last_peered":"2024-09-12T01:56:04.887926+0000","last_clean":"2024-09-12T01:56:04.887926+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:04.887926+0000","last_undegraded":"2024-09-12T01:56:04.887926+0000","last_fullsized":"2024-09-12T01:56:04.887926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524003+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:05.524003+0000","last_peered":"2024-09-12T01:56:05.524003+0000","last_clean":"2024-09-12T01:56:05.524003+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:05.524003+0000","last_undegraded":"2024-09-12T01:56:05.524003+0000","last_fullsized":"2024-09-12T01:56:05.524003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888616+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:04.888616+0000","last_peered":"2024-09-12T01:56:04.888616+0000","last_clean":"2024-09-12T01:56:04.888616+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:04.888616+0000","last_undegraded":"2024-09-12T01:56:04.888616+0000","last_fullsized":"2024-09-12T01:56:04.888616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888469+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:04.888469+0000","last_peered":"2024-09-12T01:56:04.888469+0000","last_clean":"2024-09-12T01:56:04.888469+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:04.888469+0000","last_undegraded":"2024-09-12T01:56:04.888469+0000","last_fullsized":"2024-09-12T01:56:04.888469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888243+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:04.888243+0000","last_peered":"2024-09-12T01:56:04.888243+0000","last_clean":"2024-09-12T01:56:04.888243+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:04.888243+0000","last_undegraded":"2024-09-12T01:56:04.888243+0000","last_fullsized":"2024-09-12T01:56:04.888243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889593+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:04.889593+0000","last_peered":"2024-09-12T01:56:04.889593+0000","last_clean":"2024-09-12T01:56:04.889593+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:04.889593+0000","last_undegraded":"2024-09-12T01:56:04.889593+0000","last_fullsized":"2024-09-12T01:56:04.889593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892111+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:04.892111+0000","last_peered":"2024-09-12T01:56:04.892111+0000","last_clean":"2024-09-12T01:56:04.892111+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:04.892111+0000","last_undegraded":"2024-09-12T01:56:04.892111+0000","last_fullsized":"2024-09-12T01:56:04.892111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890784+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:04.890784+0000","last_peered":"2024-09-12T01:56:04.890784+0000","last_clean":"2024-09-12T01:56:04.890784+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:04.890784+0000","last_undegraded":"2024-09-12T01:56:04.890784+0000","last_fullsized":"2024-09-12T01:56:04.890784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889957+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:04.889957+0000","last_peered":"2024-09-12T01:56:04.889957+0000","last_clean":"2024-09-12T01:56:04.889957+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:04.889957+0000","last_undegraded":"2024-09-12T01:56:04.889957+0000","last_fullsized":"2024-09-12T01:56:04.889957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888863+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:04.888863+0000","last_peered":"2024-09-12T01:56:04.888863+0000","last_clean":"2024-09-12T01:56:04.888863+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:04.888863+0000","last_undegraded":"2024-09-12T01:56:04.888863+0000","last_fullsized":"2024-09-12T01:56:04.888863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891026+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:04.891026+0000","last_peered":"2024-09-12T01:56:04.891026+0000","last_clean":"2024-09-12T01:56:04.891026+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:04.891026+0000","last_undegraded":"2024-09-12T01:56:04.891026+0000","last_fullsized":"2024-09-12T01:56:04.891026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187596+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:05.187596+0000","last_peered":"2024-09-12T01:56:05.187596+0000","last_clean":"2024-09-12T01:56:05.187596+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:05.187596+0000","last_undegraded":"2024-09-12T01:56:05.187596+0000","last_fullsized":"2024-09-12T01:56:05.187596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523787+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:05.523787+0000","last_peered":"2024-09-12T01:56:05.523787+0000","last_clean":"2024-09-12T01:56:05.523787+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:05.523787+0000","last_undegraded":"2024-09-12T01:56:05.523787+0000","last_fullsized":"2024-09-12T01:56:05.523787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523788+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:05.523788+0000","last_peered":"2024-09-12T01:56:05.523788+0000","last_clean":"2024-09-12T01:56:05.523788+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:05.523788+0000","last_undegraded":"2024-09-12T01:56:05.523788+0000","last_fullsized":"2024-09-12T01:56:05.523788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891065+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:04.891065+0000","last_peered":"2024-09-12T01:56:04.891065+0000","last_clean":"2024-09-12T01:56:04.891065+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:04.891065+0000","last_undegraded":"2024-09-12T01:56:04.891065+0000","last_fullsized":"2024-09-12T01:56:04.891065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892076+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:04.892076+0000","last_peered":"2024-09-12T01:56:04.892076+0000","last_clean":"2024-09-12T01:56:04.892076+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:04.892076+0000","last_undegraded":"2024-09-12T01:56:04.892076+0000","last_fullsized":"2024-09-12T01:56:04.892076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65175,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":340,"num_read_kb":236,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1091145,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234025,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":962560,"data_stored":1030580,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888120,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":974848,"data_stored":1030264,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":500713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":499194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:13.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:56:14.144 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 -- 172.21.15.39:0/3211929703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8101de0 msgr2=0x7feed81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3211929703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8101de0 0x7feed81021c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 -- 172.21.15.39:0/3211929703 shutdown_connections 2024-09-12T01:56:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3211929703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8106f10 0x7feed810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3211929703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8102790 0x7feed81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3211929703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8101de0 0x7feed81021c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 -- 172.21.15.39:0/3211929703 >> 172.21.15.39:0/3211929703 conn(0x7feed80fd8c0 msgr2=0x7feed80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 -- 172.21.15.39:0/3211929703 shutdown_connections 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.664+0000 7feedd1e3640 1 -- 172.21.15.39:0/3211929703 wait complete. 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 Processor -- start 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 -- start start 2024-09-12T01:56:14.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8101de0 0x7feed81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 0x7feed819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feed8111f70 con 0x7feed8102790 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed8111df0 con 0x7feed8106f10 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feedd1e3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feed81120f0 con 0x7feed8101de0 2024-09-12T01:56:14.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.665+0000 7feed659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36164/0 (socket says 172.21.15.39:36164) 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 -- 172.21.15.39:0/3274134910 learned_addr learned my addr 172.21.15.39:0/3274134910 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed759e640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 0x7feed819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed6d9d640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8101de0 0x7feed81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 -- 172.21.15.39:0/3274134910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8101de0 msgr2=0x7feed81983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8101de0 0x7feed81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 -- 172.21.15.39:0/3274134910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 msgr2=0x7feed819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 0x7feed819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 -- 172.21.15.39:0/3274134910 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed819d380 con 0x7feed8102790 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed759e640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 0x7feed819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feed659c640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d950 tx=0x7feecc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc017070 con 0x7feed8102790 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed819d670 con 0x7feed8102790 2024-09-12T01:56:14.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feecc009c30 con 0x7feed8102790 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc020060 con 0x7feed8102790 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.666+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81a4f50 con 0x7feed8102790 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.667+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed81021c0 con 0x7feed8102790 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.668+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feecc0109d0 con 0x7feed8102790 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.669+0000 7feebffff640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 0x7feec00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:14.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.669+0000 7feed6d9d640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 0x7feec00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.669+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feecc0cf250 con 0x7feed8102790 2024-09-12T01:56:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.670+0000 7feed6d9d640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 0x7feec00a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feec80096c0 tx=0x7feec8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:14.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.673+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feecc009de0 con 0x7feed8102790 2024-09-12T01:56:14.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.845+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feed8062630 con 0x7feec00a2c10 2024-09-12T01:56:14.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.852+0000 7feebffff640 1 -- 172.21.15.39:0/3274134910 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258880 (secure 0 0 0) 0x7feed8062630 con 0x7feec00a2c10 2024-09-12T01:56:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:14.855 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:56:14.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 msgr2=0x7feec00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 0x7feec00a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feec80096c0 tx=0x7feec8000bc0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 msgr2=0x7feed8198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d950 tx=0x7feecc00de10 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 shutdown_connections 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8106f10 0x7feed819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feed8102790 0x7feed8198910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feec00a2c10 0x7feec00a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 --2- 172.21.15.39:0/3274134910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed8101de0 0x7feed81983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 >> 172.21.15.39:0/3274134910 conn(0x7feed80fd8c0 msgr2=0x7feed80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 shutdown_connections 2024-09-12T01:56:14.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:14.855+0000 7feedd1e3640 1 -- 172.21.15.39:0/3274134910 wait complete. 2024-09-12T01:56:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:15.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 14 B/s, 1 objects/s recovering 2024-09-12T01:56:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:15.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 14 B/s, 1 objects/s recovering 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s; 14 B/s, 1 objects/s recovering 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:56:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:56:15.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:56:15.562 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-12T01:56:13.253710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655777,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":471,"num_read_kb":350,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360364,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581460,"statfs":{"total":1151940427776,"available":1151571415040,"internally_reserved":0,"allocated":11304960,"data_stored":7222251,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.369572"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889635+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:04.889635+0000","last_peered":"2024-09-12T01:56:04.889635+0000","last_clean":"2024-09-12T01:56:04.889635+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:04.889635+0000","last_undegraded":"2024-09-12T01:56:04.889635+0000","last_fullsized":"2024-09-12T01:56:04.889635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890575+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:04.890575+0000","last_peered":"2024-09-12T01:56:04.890575+0000","last_clean":"2024-09-12T01:56:04.890575+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:04.890575+0000","last_undegraded":"2024-09-12T01:56:04.890575+0000","last_fullsized":"2024-09-12T01:56:04.890575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890672+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:04.890672+0000","last_peered":"2024-09-12T01:56:04.890672+0000","last_clean":"2024-09-12T01:56:04.890672+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:04.890672+0000","last_undegraded":"2024-09-12T01:56:04.890672+0000","last_fullsized":"2024-09-12T01:56:04.890672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887006+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:04.887006+0000","last_peered":"2024-09-12T01:56:04.887006+0000","last_clean":"2024-09-12T01:56:04.887006+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:04.887006+0000","last_undegraded":"2024-09-12T01:56:04.887006+0000","last_fullsized":"2024-09-12T01:56:04.887006+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890644+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:04.890644+0000","last_peered":"2024-09-12T01:56:04.890644+0000","last_clean":"2024-09-12T01:56:04.890644+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:04.890644+0000","last_undegraded":"2024-09-12T01:56:04.890644+0000","last_fullsized":"2024-09-12T01:56:04.890644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888372+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:04.888372+0000","last_peered":"2024-09-12T01:56:04.888372+0000","last_clean":"2024-09-12T01:56:04.888372+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:04.888372+0000","last_undegraded":"2024-09-12T01:56:04.888372+0000","last_fullsized":"2024-09-12T01:56:04.888372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187496+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:05.187496+0000","last_peered":"2024-09-12T01:56:05.187496+0000","last_clean":"2024-09-12T01:56:05.187496+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:05.187496+0000","last_undegraded":"2024-09-12T01:56:05.187496+0000","last_fullsized":"2024-09-12T01:56:05.187496+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524736+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:05.524736+0000","last_peered":"2024-09-12T01:56:05.524736+0000","last_clean":"2024-09-12T01:56:05.524736+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:05.524736+0000","last_undegraded":"2024-09-12T01:56:05.524736+0000","last_fullsized":"2024-09-12T01:56:05.524736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524029+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:05.524029+0000","last_peered":"2024-09-12T01:56:05.524029+0000","last_clean":"2024-09-12T01:56:05.524029+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:05.524029+0000","last_undegraded":"2024-09-12T01:56:05.524029+0000","last_fullsized":"2024-09-12T01:56:05.524029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.893446+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:04.893446+0000","last_peered":"2024-09-12T01:56:04.893446+0000","last_clean":"2024-09-12T01:56:04.893446+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:04.893446+0000","last_undegraded":"2024-09-12T01:56:04.893446+0000","last_fullsized":"2024-09-12T01:56:04.893446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187613+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:05.187613+0000","last_peered":"2024-09-12T01:56:05.187613+0000","last_clean":"2024-09-12T01:56:05.187613+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:05.187613+0000","last_undegraded":"2024-09-12T01:56:05.187613+0000","last_fullsized":"2024-09-12T01:56:05.187613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.893418+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:04.893418+0000","last_peered":"2024-09-12T01:56:04.893418+0000","last_clean":"2024-09-12T01:56:04.893418+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:04.893418+0000","last_undegraded":"2024-09-12T01:56:04.893418+0000","last_fullsized":"2024-09-12T01:56:04.893418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888288+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:04.888288+0000","last_peered":"2024-09-12T01:56:04.888288+0000","last_clean":"2024-09-12T01:56:04.888288+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:04.888288+0000","last_undegraded":"2024-09-12T01:56:04.888288+0000","last_fullsized":"2024-09-12T01:56:04.888288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890868+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:04.890868+0000","last_peered":"2024-09-12T01:56:04.890868+0000","last_clean":"2024-09-12T01:56:04.890868+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:04.890868+0000","last_undegraded":"2024-09-12T01:56:04.890868+0000","last_fullsized":"2024-09-12T01:56:04.890868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890723+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:04.890723+0000","last_peered":"2024-09-12T01:56:04.890723+0000","last_clean":"2024-09-12T01:56:04.890723+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:04.890723+0000","last_undegraded":"2024-09-12T01:56:04.890723+0000","last_fullsized":"2024-09-12T01:56:04.890723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524140+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:05.524140+0000","last_peered":"2024-09-12T01:56:05.524140+0000","last_clean":"2024-09-12T01:56:05.524140+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:05.524140+0000","last_undegraded":"2024-09-12T01:56:05.524140+0000","last_fullsized":"2024-09-12T01:56:05.524140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889724+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:04.889724+0000","last_peered":"2024-09-12T01:56:04.889724+0000","last_clean":"2024-09-12T01:56:04.889724+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:04.889724+0000","last_undegraded":"2024-09-12T01:56:04.889724+0000","last_fullsized":"2024-09-12T01:56:04.889724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889384+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:04.889384+0000","last_peered":"2024-09-12T01:56:04.889384+0000","last_clean":"2024-09-12T01:56:04.889384+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:04.889384+0000","last_undegraded":"2024-09-12T01:56:04.889384+0000","last_fullsized":"2024-09-12T01:56:04.889384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887667+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:04.887667+0000","last_peered":"2024-09-12T01:56:04.887667+0000","last_clean":"2024-09-12T01:56:04.887667+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:04.887667+0000","last_undegraded":"2024-09-12T01:56:04.887667+0000","last_fullsized":"2024-09-12T01:56:04.887667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888999+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:04.888999+0000","last_peered":"2024-09-12T01:56:04.888999+0000","last_clean":"2024-09-12T01:56:04.888999+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:04.888999+0000","last_undegraded":"2024-09-12T01:56:04.888999+0000","last_fullsized":"2024-09-12T01:56:04.888999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888296+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:04.888296+0000","last_peered":"2024-09-12T01:56:04.888296+0000","last_clean":"2024-09-12T01:56:04.888296+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:04.888296+0000","last_undegraded":"2024-09-12T01:56:04.888296+0000","last_fullsized":"2024-09-12T01:56:04.888296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523762+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:05.523762+0000","last_peered":"2024-09-12T01:56:05.523762+0000","last_clean":"2024-09-12T01:56:05.523762+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:05.523762+0000","last_undegraded":"2024-09-12T01:56:05.523762+0000","last_fullsized":"2024-09-12T01:56:05.523762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890673+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:04.890673+0000","last_peered":"2024-09-12T01:56:04.890673+0000","last_clean":"2024-09-12T01:56:04.890673+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:04.890673+0000","last_undegraded":"2024-09-12T01:56:04.890673+0000","last_fullsized":"2024-09-12T01:56:04.890673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523980+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:05.523980+0000","last_peered":"2024-09-12T01:56:05.523980+0000","last_clean":"2024-09-12T01:56:05.523980+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:05.523980+0000","last_undegraded":"2024-09-12T01:56:05.523980+0000","last_fullsized":"2024-09-12T01:56:05.523980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892005+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:04.892005+0000","last_peered":"2024-09-12T01:56:04.892005+0000","last_clean":"2024-09-12T01:56:04.892005+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:04.892005+0000","last_undegraded":"2024-09-12T01:56:04.892005+0000","last_fullsized":"2024-09-12T01:56:04.892005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887824+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:04.887824+0000","last_peered":"2024-09-12T01:56:04.887824+0000","last_clean":"2024-09-12T01:56:04.887824+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:04.887824+0000","last_undegraded":"2024-09-12T01:56:04.887824+0000","last_fullsized":"2024-09-12T01:56:04.887824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889806+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:04.889806+0000","last_peered":"2024-09-12T01:56:04.889806+0000","last_clean":"2024-09-12T01:56:04.889806+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:04.889806+0000","last_undegraded":"2024-09-12T01:56:04.889806+0000","last_fullsized":"2024-09-12T01:56:04.889806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888161+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:04.888161+0000","last_peered":"2024-09-12T01:56:04.888161+0000","last_clean":"2024-09-12T01:56:04.888161+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:04.888161+0000","last_undegraded":"2024-09-12T01:56:04.888161+0000","last_fullsized":"2024-09-12T01:56:04.888161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890990+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:04.890990+0000","last_peered":"2024-09-12T01:56:04.890990+0000","last_clean":"2024-09-12T01:56:04.890990+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:04.890990+0000","last_undegraded":"2024-09-12T01:56:04.890990+0000","last_fullsized":"2024-09-12T01:56:04.890990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887393+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:04.887393+0000","last_peered":"2024-09-12T01:56:04.887393+0000","last_clean":"2024-09-12T01:56:04.887393+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:04.887393+0000","last_undegraded":"2024-09-12T01:56:04.887393+0000","last_fullsized":"2024-09-12T01:56:04.887393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887436+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:04.887436+0000","last_peered":"2024-09-12T01:56:04.887436+0000","last_clean":"2024-09-12T01:56:04.887436+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:04.887436+0000","last_undegraded":"2024-09-12T01:56:04.887436+0000","last_fullsized":"2024-09-12T01:56:04.887436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888750+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:04.888750+0000","last_peered":"2024-09-12T01:56:04.888750+0000","last_clean":"2024-09-12T01:56:04.888750+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:04.888750+0000","last_undegraded":"2024-09-12T01:56:04.888750+0000","last_fullsized":"2024-09-12T01:56:04.888750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890719+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:04.890719+0000","last_peered":"2024-09-12T01:56:04.890719+0000","last_clean":"2024-09-12T01:56:04.890719+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:04.890719+0000","last_undegraded":"2024-09-12T01:56:04.890719+0000","last_fullsized":"2024-09-12T01:56:04.890719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:07.747147+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:07.747147+0000","last_peered":"2024-09-12T01:56:07.747147+0000","last_clean":"2024-09-12T01:56:07.747147+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:07.747147+0000","last_undegraded":"2024-09-12T01:56:07.747147+0000","last_fullsized":"2024-09-12T01:56:07.747147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523789+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:05.523789+0000","last_peered":"2024-09-12T01:56:05.523789+0000","last_clean":"2024-09-12T01:56:05.523789+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:05.523789+0000","last_undegraded":"2024-09-12T01:56:05.523789+0000","last_fullsized":"2024-09-12T01:56:05.523789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890448+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:04.890448+0000","last_peered":"2024-09-12T01:56:04.890448+0000","last_clean":"2024-09-12T01:56:04.890448+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:04.890448+0000","last_undegraded":"2024-09-12T01:56:04.890448+0000","last_fullsized":"2024-09-12T01:56:04.890448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888847+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:04.888847+0000","last_peered":"2024-09-12T01:56:04.888847+0000","last_clean":"2024-09-12T01:56:04.888847+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:04.888847+0000","last_undegraded":"2024-09-12T01:56:04.888847+0000","last_fullsized":"2024-09-12T01:56:04.888847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:08.747578+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:08.747578+0000","last_peered":"2024-09-12T01:56:08.747578+0000","last_clean":"2024-09-12T01:56:08.747578+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:08.747578+0000","last_undegraded":"2024-09-12T01:56:08.747578+0000","last_fullsized":"2024-09-12T01:56:08.747578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523960+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:05.523960+0000","last_peered":"2024-09-12T01:56:05.523960+0000","last_clean":"2024-09-12T01:56:05.523960+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:05.523960+0000","last_undegraded":"2024-09-12T01:56:05.523960+0000","last_fullsized":"2024-09-12T01:56:05.523960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524535+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:05.524535+0000","last_peered":"2024-09-12T01:56:05.524535+0000","last_clean":"2024-09-12T01:56:05.524535+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:05.524535+0000","last_undegraded":"2024-09-12T01:56:05.524535+0000","last_fullsized":"2024-09-12T01:56:05.524535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523784+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:05.523784+0000","last_peered":"2024-09-12T01:56:05.523784+0000","last_clean":"2024-09-12T01:56:05.523784+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:05.523784+0000","last_undegraded":"2024-09-12T01:56:05.523784+0000","last_fullsized":"2024-09-12T01:56:05.523784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'29","reported_seq":166,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:09.748891+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:09.748891+0000","last_peered":"2024-09-12T01:56:09.748891+0000","last_clean":"2024-09-12T01:56:09.748891+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:09.748891+0000","last_undegraded":"2024-09-12T01:56:09.748891+0000","last_fullsized":"2024-09-12T01:56:09.748891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61172,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":116,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890723+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:04.890723+0000","last_peered":"2024-09-12T01:56:04.890723+0000","last_clean":"2024-09-12T01:56:04.890723+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:04.890723+0000","last_undegraded":"2024-09-12T01:56:04.890723+0000","last_fullsized":"2024-09-12T01:56:04.890723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887839+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:04.887839+0000","last_peered":"2024-09-12T01:56:04.887839+0000","last_clean":"2024-09-12T01:56:04.887839+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:04.887839+0000","last_undegraded":"2024-09-12T01:56:04.887839+0000","last_fullsized":"2024-09-12T01:56:04.887839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187685+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:05.187685+0000","last_peered":"2024-09-12T01:56:05.187685+0000","last_clean":"2024-09-12T01:56:05.187685+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:05.187685+0000","last_undegraded":"2024-09-12T01:56:05.187685+0000","last_fullsized":"2024-09-12T01:56:05.187685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:08.769173+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:08.769173+0000","last_peered":"2024-09-12T01:56:08.769173+0000","last_clean":"2024-09-12T01:56:08.769173+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:08.769173+0000","last_undegraded":"2024-09-12T01:56:08.769173+0000","last_fullsized":"2024-09-12T01:56:08.769173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187458+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:05.187458+0000","last_peered":"2024-09-12T01:56:05.187458+0000","last_clean":"2024-09-12T01:56:05.187458+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:05.187458+0000","last_undegraded":"2024-09-12T01:56:05.187458+0000","last_fullsized":"2024-09-12T01:56:05.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523665+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:05.523665+0000","last_peered":"2024-09-12T01:56:05.523665+0000","last_clean":"2024-09-12T01:56:05.523665+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:05.523665+0000","last_undegraded":"2024-09-12T01:56:05.523665+0000","last_fullsized":"2024-09-12T01:56:05.523665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889241+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:04.889241+0000","last_peered":"2024-09-12T01:56:04.889241+0000","last_clean":"2024-09-12T01:56:04.889241+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:04.889241+0000","last_undegraded":"2024-09-12T01:56:04.889241+0000","last_fullsized":"2024-09-12T01:56:04.889241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187859+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:05.187859+0000","last_peered":"2024-09-12T01:56:05.187859+0000","last_clean":"2024-09-12T01:56:05.187859+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:05.187859+0000","last_undegraded":"2024-09-12T01:56:05.187859+0000","last_fullsized":"2024-09-12T01:56:05.187859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187592+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:05.187592+0000","last_peered":"2024-09-12T01:56:05.187592+0000","last_clean":"2024-09-12T01:56:05.187592+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:05.187592+0000","last_undegraded":"2024-09-12T01:56:05.187592+0000","last_fullsized":"2024-09-12T01:56:05.187592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187806+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:05.187806+0000","last_peered":"2024-09-12T01:56:05.187806+0000","last_clean":"2024-09-12T01:56:05.187806+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:05.187806+0000","last_undegraded":"2024-09-12T01:56:05.187806+0000","last_fullsized":"2024-09-12T01:56:05.187806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":335,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187585+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187585+0000","last_peered":"2024-09-12T01:56:05.187585+0000","last_clean":"2024-09-12T01:56:05.187585+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187585+0000","last_undegraded":"2024-09-12T01:56:05.187585+0000","last_fullsized":"2024-09-12T01:56:05.187585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891661+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:04.891661+0000","last_peered":"2024-09-12T01:56:04.891661+0000","last_clean":"2024-09-12T01:56:04.891661+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:04.891661+0000","last_undegraded":"2024-09-12T01:56:04.891661+0000","last_fullsized":"2024-09-12T01:56:04.891661+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887682+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:04.887682+0000","last_peered":"2024-09-12T01:56:04.887682+0000","last_clean":"2024-09-12T01:56:04.887682+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:04.887682+0000","last_undegraded":"2024-09-12T01:56:04.887682+0000","last_fullsized":"2024-09-12T01:56:04.887682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:09.770346+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:09.770346+0000","last_peered":"2024-09-12T01:56:09.770346+0000","last_clean":"2024-09-12T01:56:09.770346+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:09.770346+0000","last_undegraded":"2024-09-12T01:56:09.770346+0000","last_fullsized":"2024-09-12T01:56:09.770346+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524003+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:05.524003+0000","last_peered":"2024-09-12T01:56:05.524003+0000","last_clean":"2024-09-12T01:56:05.524003+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:05.524003+0000","last_undegraded":"2024-09-12T01:56:05.524003+0000","last_fullsized":"2024-09-12T01:56:05.524003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888616+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:04.888616+0000","last_peered":"2024-09-12T01:56:04.888616+0000","last_clean":"2024-09-12T01:56:04.888616+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:04.888616+0000","last_undegraded":"2024-09-12T01:56:04.888616+0000","last_fullsized":"2024-09-12T01:56:04.888616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888469+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:04.888469+0000","last_peered":"2024-09-12T01:56:04.888469+0000","last_clean":"2024-09-12T01:56:04.888469+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:04.888469+0000","last_undegraded":"2024-09-12T01:56:04.888469+0000","last_fullsized":"2024-09-12T01:56:04.888469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888243+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:04.888243+0000","last_peered":"2024-09-12T01:56:04.888243+0000","last_clean":"2024-09-12T01:56:04.888243+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:04.888243+0000","last_undegraded":"2024-09-12T01:56:04.888243+0000","last_fullsized":"2024-09-12T01:56:04.888243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'10","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889593+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:04.889593+0000","last_peered":"2024-09-12T01:56:04.889593+0000","last_clean":"2024-09-12T01:56:04.889593+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:04.889593+0000","last_undegraded":"2024-09-12T01:56:04.889593+0000","last_fullsized":"2024-09-12T01:56:04.889593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892111+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:04.892111+0000","last_peered":"2024-09-12T01:56:04.892111+0000","last_clean":"2024-09-12T01:56:04.892111+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:04.892111+0000","last_undegraded":"2024-09-12T01:56:04.892111+0000","last_fullsized":"2024-09-12T01:56:04.892111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890784+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:04.890784+0000","last_peered":"2024-09-12T01:56:04.890784+0000","last_clean":"2024-09-12T01:56:04.890784+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:04.890784+0000","last_undegraded":"2024-09-12T01:56:04.890784+0000","last_fullsized":"2024-09-12T01:56:04.890784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889957+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:04.889957+0000","last_peered":"2024-09-12T01:56:04.889957+0000","last_clean":"2024-09-12T01:56:04.889957+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:04.889957+0000","last_undegraded":"2024-09-12T01:56:04.889957+0000","last_fullsized":"2024-09-12T01:56:04.889957+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888863+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:04.888863+0000","last_peered":"2024-09-12T01:56:04.888863+0000","last_clean":"2024-09-12T01:56:04.888863+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:04.888863+0000","last_undegraded":"2024-09-12T01:56:04.888863+0000","last_fullsized":"2024-09-12T01:56:04.888863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891026+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:04.891026+0000","last_peered":"2024-09-12T01:56:04.891026+0000","last_clean":"2024-09-12T01:56:04.891026+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:04.891026+0000","last_undegraded":"2024-09-12T01:56:04.891026+0000","last_fullsized":"2024-09-12T01:56:04.891026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187596+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:05.187596+0000","last_peered":"2024-09-12T01:56:05.187596+0000","last_clean":"2024-09-12T01:56:05.187596+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:05.187596+0000","last_undegraded":"2024-09-12T01:56:05.187596+0000","last_fullsized":"2024-09-12T01:56:05.187596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523787+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:05.523787+0000","last_peered":"2024-09-12T01:56:05.523787+0000","last_clean":"2024-09-12T01:56:05.523787+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:05.523787+0000","last_undegraded":"2024-09-12T01:56:05.523787+0000","last_fullsized":"2024-09-12T01:56:05.523787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523788+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:05.523788+0000","last_peered":"2024-09-12T01:56:05.523788+0000","last_clean":"2024-09-12T01:56:05.523788+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:05.523788+0000","last_undegraded":"2024-09-12T01:56:05.523788+0000","last_fullsized":"2024-09-12T01:56:05.523788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891065+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:04.891065+0000","last_peered":"2024-09-12T01:56:04.891065+0000","last_clean":"2024-09-12T01:56:04.891065+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:04.891065+0000","last_undegraded":"2024-09-12T01:56:04.891065+0000","last_fullsized":"2024-09-12T01:56:04.891065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892076+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:04.892076+0000","last_peered":"2024-09-12T01:56:04.892076+0000","last_clean":"2024-09-12T01:56:04.892076+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:04.892076+0000","last_undegraded":"2024-09-12T01:56:04.892076+0000","last_fullsized":"2024-09-12T01:56:04.892076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65175,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":345,"num_read_kb":241,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1091145,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234026,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":962560,"data_stored":1030580,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888120,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":974848,"data_stored":1030264,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247876,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":500713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":499194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:15.567 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:56:15.567 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:56:15.567 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:56:15.567 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T01:56:15.827 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:16.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:15 smithi039 ceph-mon[31204]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:16.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:15 smithi044 ceph-mon[35259]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:16.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:15 smithi172 ceph-mon[35073]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 -- 172.21.15.39:0/1699015672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0100680 msgr2=0x7f4ff0100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1699015672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0100680 0x7f4ff0100ae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc02a410 comp rx=0 tx=0).stop 2024-09-12T01:56:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 -- 172.21.15.39:0/1699015672 shutdown_connections 2024-09-12T01:56:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1699015672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 0x7f4ff010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1699015672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0100680 0x7f4ff0100ae0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1699015672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0105220 0x7f4ff0105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 -- 172.21.15.39:0/1699015672 >> 172.21.15.39:0/1699015672 conn(0x7f4ff0077210 msgr2=0x7f4ff0077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 -- 172.21.15.39:0/1699015672 shutdown_connections 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.344+0000 7f4ff7198640 1 -- 172.21.15.39:0/1699015672 wait complete. 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 Processor -- start 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 -- start start 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0100680 0x7f4ff0101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 0x7f4ff0102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff010fe90 con 0x7f4ff0105220 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff010fd10 con 0x7f4ff0100680 2024-09-12T01:56:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff7198640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0110010 con 0x7f4ff0101020 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff5735640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff5735640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36180/0 (socket says 172.21.15.39:36180) 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff4f34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0100680 0x7f4ff0101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.345+0000 7f4ff5735640 1 -- 172.21.15.39:0/1773576166 learned_addr learned my addr 172.21.15.39:0/1773576166 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4feffff640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 0x7f4ff0102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 -- 172.21.15.39:0/1773576166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 msgr2=0x7f4ff0102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 0x7f4ff0102480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 -- 172.21.15.39:0/1773576166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0100680 msgr2=0x7f4ff0101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0100680 0x7f4ff0101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 -- 172.21.15.39:0/1773576166 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff01a6990 con 0x7f4ff0105220 2024-09-12T01:56:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff5735640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800cce0 tx=0x7f4fe800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800f450 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff01a6c80 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe800fad0 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8018c10 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.346+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff01a7190 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.347+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0100ae0 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.348+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4fe800f5f0 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.349+0000 7f4fedffb640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.350+0000 7f4ff4f34640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.350+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4fe80cf800 con 0x7f4ff0105220 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.350+0000 7f4ff4f34640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400bc60 tx=0x7f4fe400b490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:16.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.354+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fe8014030 con 0x7f4ff0105220 2024-09-12T01:56:16.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.566+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4ff010a6e0 con 0x7f4ff0105220 2024-09-12T01:56:16.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.566+0000 7f4fedffb640 1 -- 172.21.15.39:0/1773576166 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4fe809c610 con 0x7f4ff0105220 2024-09-12T01:56:16.567 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:16.567 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:56:16.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 msgr2=0x7f4fe00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400bc60 tx=0x7f4fe400b490 comp rx=0 tx=0).stop 2024-09-12T01:56:16.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 msgr2=0x7f4ff01029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:16.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800cce0 tx=0x7f4fe800a620 comp rx=0 tx=0).stop 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 shutdown_connections 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ff0105220 0x7f4ff01029c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4fe00a2c10 0x7f4fe00a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff0101020 0x7f4ff0102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 --2- 172.21.15.39:0/1773576166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff0100680 0x7f4ff0101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 >> 172.21.15.39:0/1773576166 conn(0x7f4ff0077210 msgr2=0x7f4ff00ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 shutdown_connections 2024-09-12T01:56:16.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:16.569+0000 7f4ff7198640 1 -- 172.21.15.39:0/1773576166 wait complete. 2024-09-12T01:56:17.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:16 smithi172 ceph-mon[35073]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T01:56:17.155 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:16 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1773576166' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:56:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:16 smithi039 ceph-mon[31204]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T01:56:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:16 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1773576166' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:56:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:16 smithi044 ceph-mon[35259]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s; 12 B/s, 1 objects/s recovering 2024-09-12T01:56:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:16 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1773576166' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:56:17.275 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:56:17.275 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:17.534 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- 172.21.15.39:0/3659669476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154106f10 msgr2=0x7f615410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 --2- 172.21.15.39:0/3659669476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154106f10 0x7f615410ea90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f614c009ca0 tx=0x7f614c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- 172.21.15.39:0/3659669476 shutdown_connections 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 --2- 172.21.15.39:0/3659669476 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154106f10 0x7f615410ea90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 --2- 172.21.15.39:0/3659669476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154102790 0x7f61541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 --2- 172.21.15.39:0/3659669476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- 172.21.15.39:0/3659669476 >> 172.21.15.39:0/3659669476 conn(0x7f61540fd8c0 msgr2=0x7f61540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- 172.21.15.39:0/3659669476 shutdown_connections 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- 172.21.15.39:0/3659669476 wait complete. 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 Processor -- start 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.018+0000 7f615bb4d640 1 -- start start 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:18.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154106f10 0x7f6154074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6154111f70 con 0x7f6154102790 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6154111df0 con 0x7f6154106f10 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61541120f0 con 0x7f6154101de0 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36208/0 (socket says 172.21.15.39:36208) 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 -- 172.21.15.39:0/1242646508 learned_addr learned my addr 172.21.15.39:0/1242646508 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615a0ea640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154106f10 0x7f6154074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61598e9640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:18.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 -- 172.21.15.39:0/1242646508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 msgr2=0x7f61540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 -- 172.21.15.39:0/1242646508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154106f10 msgr2=0x7f6154074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154106f10 0x7f6154074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 -- 172.21.15.39:0/1242646508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61541a67f0 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61598e9640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f61590e8640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f614800d950 tx=0x7f614800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148017070 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6148009c30 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61541a6ae0 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800f6b0 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.019+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61541a7070 con 0x7f6154102790 2024-09-12T01:56:18.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.020+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61541021c0 con 0x7f6154102790 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.022+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f61480109d0 con 0x7f6154102790 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.022+0000 7f6146ffd640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 0x7f61400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.023+0000 7f61598e9640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 0x7f61400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.023+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61480cece0 con 0x7f6154102790 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.023+0000 7f61598e9640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 0x7f61400a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f615000baa0 tx=0x7f6150005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:18.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.027+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6148009de0 con 0x7f6154102790 2024-09-12T01:56:18.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.237+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6154075a20 con 0x7f6154102790 2024-09-12T01:56:18.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.238+0000 7f6146ffd640 1 -- 172.21.15.39:0/1242646508 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7f614809baf0 con 0x7f6154102790 2024-09-12T01:56:18.238 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:18.239 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:56:18.239 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 msgr2=0x7f61400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 0x7f61400a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f615000baa0 tx=0x7f6150005d90 comp rx=0 tx=0).stop 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 msgr2=0x7f6154074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f614800d950 tx=0x7f614800de10 comp rx=0 tx=0).stop 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 shutdown_connections 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.240+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6154106f10 0x7f6154074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6154102790 0x7f6154074a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f61400a2c90 0x7f61400a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 --2- 172.21.15.39:0/1242646508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6154101de0 0x7f61540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 >> 172.21.15.39:0/1242646508 conn(0x7f61540fd8c0 msgr2=0x7f61540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 shutdown_connections 2024-09-12T01:56:18.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:18.241+0000 7f615bb4d640 1 -- 172.21.15.39:0/1242646508 wait complete. 2024-09-12T01:56:18.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:18 smithi039 ceph-mon[31204]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T01:56:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:18 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1242646508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:18 smithi044 ceph-mon[35259]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T01:56:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:18 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1242646508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:18 smithi172 ceph-mon[35073]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-12T01:56:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:18 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1242646508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 -- 172.21.15.39:0/1592087509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc100a60 msgr2=0x7fcddc100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1592087509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc100a60 0x7fcddc100ec0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009930 tx=0x7fcdd002a420 comp rx=0 tx=0).stop 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 -- 172.21.15.39:0/1592087509 shutdown_connections 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1592087509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc101400 0x7fcddc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1592087509 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc100a60 0x7fcddc100ec0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1592087509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc106a60 0x7fcddc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 -- 172.21.15.39:0/1592087509 >> 172.21.15.39:0/1592087509 conn(0x7fcddc0fc780 msgr2=0x7fcddc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 -- 172.21.15.39:0/1592087509 shutdown_connections 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.636+0000 7fcde0e35640 1 -- 172.21.15.39:0/1592087509 wait complete. 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 Processor -- start 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 -- start start 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc100a60 0x7fcddc198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc106a60 0x7fcddc19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc110f00 con 0x7fcddc101400 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc110d80 con 0x7fcddc106a60 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcde0e35640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc111080 con 0x7fcddc100a60 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36236/0 (socket says 172.21.15.39:36236) 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 -- 172.21.15.39:0/1432373595 learned_addr learned my addr 172.21.15.39:0/1432373595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdda59c640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc100a60 0x7fcddc198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcddad9d640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc106a60 0x7fcddc19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 -- 172.21.15.39:0/1432373595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc100a60 msgr2=0x7fcddc198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc100a60 0x7fcddc198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 -- 172.21.15.39:0/1432373595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc106a60 msgr2=0x7fcddc19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc106a60 0x7fcddc19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 -- 172.21.15.39:0/1432373595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcddc19d5b0 con 0x7fcddc101400 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.637+0000 7fcdd9d9b640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009a50 tx=0x7fcdd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.638+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd003f030 con 0x7fcddc101400 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.638+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdd0003ad0 con 0x7fcddc101400 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.638+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcddc19d840 con 0x7fcddc101400 2024-09-12T01:56:19.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.638+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0035070 con 0x7fcddc101400 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.638+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcddc1a5180 con 0x7fcddc101400 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.639+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcddc100f40 con 0x7fcddc101400 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.641+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcdd0042030 con 0x7fcddc101400 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.641+0000 7fcdcb7fe640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 0x7fcdc40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.641+0000 7fcdda59c640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 0x7fcdc40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.641+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcdd00efd20 con 0x7fcddc101400 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.642+0000 7fcdda59c640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 0x7fcdc40a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009990 tx=0x7fcdd4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:19.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.644+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdd00bcb30 con 0x7fcddc101400 2024-09-12T01:56:19.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.858+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcddc199960 con 0x7fcddc101400 2024-09-12T01:56:19.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.859+0000 7fcdcb7fe640 1 -- 172.21.15.39:0/1432373595 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7fcddc199960 con 0x7fcddc101400 2024-09-12T01:56:19.859 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:19.859 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:56:19.859 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 msgr2=0x7fcdc40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 0x7fcdc40a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009990 tx=0x7fcdd4009110 comp rx=0 tx=0).stop 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 msgr2=0x7fcddc198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009a50 tx=0x7fcdd0004270 comp rx=0 tx=0).stop 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 shutdown_connections 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcddc106a60 0x7fcddc19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcddc101400 0x7fcddc198b40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcdc40a2c90 0x7fcdc40a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 --2- 172.21.15.39:0/1432373595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcddc100a60 0x7fcddc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:19.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 >> 172.21.15.39:0/1432373595 conn(0x7fcddc0fc780 msgr2=0x7fcddc06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:19.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 shutdown_connections 2024-09-12T01:56:19.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:19.861+0000 7fcde0e35640 1 -- 172.21.15.39:0/1432373595 wait complete. 2024-09-12T01:56:20.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:19 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1432373595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:20.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:19 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1432373595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:20.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:19 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1432373595' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:20.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:56:20.781 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:21.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:20 smithi039 ceph-mon[31204]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:21.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:20 smithi044 ceph-mon[35259]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:20 smithi172 ceph-mon[35073]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:21.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 -- 172.21.15.39:0/342152360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102570 msgr2=0x7f760c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 --2- 172.21.15.39:0/342152360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102570 0x7f760c1029b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7600009900 tx=0x7f760002a480 comp rx=0 tx=0).stop 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 -- 172.21.15.39:0/342152360 shutdown_connections 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 --2- 172.21.15.39:0/342152360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c102ef0 0x7f760c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 --2- 172.21.15.39:0/342152360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102570 0x7f760c1029b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 --2- 172.21.15.39:0/342152360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c100e20 0x7f760c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 -- 172.21.15.39:0/342152360 >> 172.21.15.39:0/342152360 conn(0x7f760c0fc7d0 msgr2=0x7f760c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 -- 172.21.15.39:0/342152360 shutdown_connections 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.292+0000 7f7610ff3640 1 -- 172.21.15.39:0/342152360 wait complete. 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 Processor -- start 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 -- start start 2024-09-12T01:56:21.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 0x7f760c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c102570 0x7f760c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f760c110f80 con 0x7f760c102ef0 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f760c110e00 con 0x7f760c100e20 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7610ff3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f760c111100 con 0x7f760c102570 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36252/0 (socket says 172.21.15.39:36252) 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 -- 172.21.15.39:0/3043291639 learned_addr learned my addr 172.21.15.39:0/3043291639 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760a59c640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 0x7f760c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f7609d9b640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c102570 0x7f760c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 -- 172.21.15.39:0/3043291639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c102570 msgr2=0x7f760c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c102570 0x7f760c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 -- 172.21.15.39:0/3043291639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 msgr2=0x7f760c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 0x7f760c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760ad9d640 1 -- 172.21.15.39:0/3043291639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c19d470 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.293+0000 7f760a59c640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 0x7f760c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f760ad9d640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f760400eb10 tx=0x7f760400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604004b20 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7604004cc0 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760c19d760 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604010760 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.294+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760c1a5040 con 0x7f760c102ef0 2024-09-12T01:56:21.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.295+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760c101200 con 0x7f760c102ef0 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.296+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7604005020 con 0x7f760c102ef0 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.297+0000 7f75fb7fe640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 0x7f75f40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.297+0000 7f760a59c640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 0x7f75f40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.297+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76040cf860 con 0x7f760c102ef0 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.297+0000 7f760a59c640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 0x7f75f40a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0058c0 tx=0x7f75fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:21.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.301+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f760409c670 con 0x7f760c102ef0 2024-09-12T01:56:21.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.476+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f760c1a5210 con 0x7f760c102ef0 2024-09-12T01:56:21.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.477+0000 7f75fb7fe640 1 -- 172.21.15.39:0/3043291639 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22679 (secure 0 0 0) 0x7f760409bf70 con 0x7f760c102ef0 2024-09-12T01:56:21.477 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:21.478 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":82,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:56:04.883161+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.479+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 msgr2=0x7f75f40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.479+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 0x7f75f40a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0058c0 tx=0x7f75fc005850 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.479+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 msgr2=0x7f760c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.479+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f760400eb10 tx=0x7f760400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 shutdown_connections 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f760c102ef0 0x7f760c19cd90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f75f40a2c90 0x7f75f40a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c102570 0x7f760c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 --2- 172.21.15.39:0/3043291639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f760c100e20 0x7f760c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:21.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 >> 172.21.15.39:0/3043291639 conn(0x7f760c0fc7d0 msgr2=0x7f760c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 shutdown_connections 2024-09-12T01:56:21.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:21.480+0000 7f7610ff3640 1 -- 172.21.15.39:0/3043291639 wait complete. 2024-09-12T01:56:22.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:22.172 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:21 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3043291639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:22.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:21 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3043291639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:22.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:21 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3043291639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:22.404 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 -- 172.21.15.39:0/3515184867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102570 msgr2=0x7f41b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 --2- 172.21.15.39:0/3515184867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102570 0x7f41b01029b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009900 tx=0x7f41a002a480 comp rx=0 tx=0).stop 2024-09-12T01:56:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 -- 172.21.15.39:0/3515184867 shutdown_connections 2024-09-12T01:56:22.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 --2- 172.21.15.39:0/3515184867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0102ef0 0x7f41b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 --2- 172.21.15.39:0/3515184867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102570 0x7f41b01029b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 --2- 172.21.15.39:0/3515184867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0100e20 0x7f41b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 -- 172.21.15.39:0/3515184867 >> 172.21.15.39:0/3515184867 conn(0x7f41b00fc7d0 msgr2=0x7f41b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 -- 172.21.15.39:0/3515184867 shutdown_connections 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.926+0000 7f41b78ae640 1 -- 172.21.15.39:0/3515184867 wait complete. 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 Processor -- start 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 -- start start 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0100e20 0x7f41b0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0102570 0x7f41b0199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0110fd0 con 0x7f41b0102ef0 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0110e50 con 0x7f41b0100e20 2024-09-12T01:56:22.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b78ae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0111150 con 0x7f41b0102570 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b564a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0100e20 0x7f41b0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47172/0 (socket says 172.21.15.39:47172) 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 -- 172.21.15.39:0/4160483629 learned_addr learned my addr 172.21.15.39:0/4160483629 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b4e49640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0102570 0x7f41b0199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 -- 172.21.15.39:0/4160483629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0102570 msgr2=0x7f41b0199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0102570 0x7f41b0199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 -- 172.21.15.39:0/4160483629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0100e20 msgr2=0x7f41b0199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0100e20 0x7f41b0199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.927+0000 7f41b5e4b640 1 -- 172.21.15.39:0/4160483629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b01a4900 con 0x7f41b0102ef0 2024-09-12T01:56:22.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41b5e4b640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009fd0 tx=0x7f41a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a8017070 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41a8003e50 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b01a4ad0 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a80106c0 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.928+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b01a4fe0 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.929+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b0101200 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.930+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f41a8003970 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.931+0000 7f41a67fc640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 0x7f419c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.931+0000 7f41b564a640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 0x7f419c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.931+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f41a80cedb0 con 0x7f41b0102ef0 2024-09-12T01:56:22.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.931+0000 7f41b564a640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 0x7f419c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41ac005fd0 tx=0x7f41ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:22.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:22.935+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41a809b570 con 0x7f41b0102ef0 2024-09-12T01:56:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.145+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41b0109090 con 0x7f41b0102ef0 2024-09-12T01:56:23.145 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:22 smithi039 ceph-mon[31204]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:23.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.145+0000 7f41a67fc640 1 -- 172.21.15.39:0/4160483629 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7f41a809f870 con 0x7f41b0102ef0 2024-09-12T01:56:23.146 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:23.146 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:56:23.146 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 msgr2=0x7f419c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 0x7f419c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41ac005fd0 tx=0x7f41ac00b390 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 msgr2=0x7f41b01a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009fd0 tx=0x7f41a800b260 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 shutdown_connections 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41b0102ef0 0x7f41b01a43c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f419c0a2c90 0x7f419c0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b0102570 0x7f41b0199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 --2- 172.21.15.39:0/4160483629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41b0100e20 0x7f41b0199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:23.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 >> 172.21.15.39:0/4160483629 conn(0x7f41b00fc7d0 msgr2=0x7f41b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 shutdown_connections 2024-09-12T01:56:23.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:23.148+0000 7f41b78ae640 1 -- 172.21.15.39:0/4160483629 wait complete. 2024-09-12T01:56:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:22 smithi044 ceph-mon[35259]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:23.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:22 smithi172 ceph-mon[35073]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:23.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:55:08.326488+0000', 'modified': '2024-09-12T01:55:19.410760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24503, 'mds_1': 24467, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1679490719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1679490719}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1679490719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/4061596538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4061596538}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 4061596538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/2267029874', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2267029874}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2267029874}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/3543698961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3543698961}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3543698961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/3549353612', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 3549353612}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 3549353612}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/321221291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 321221291}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 321221291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24503, 'qdb_cluster': [24463, 24467, 24503]} 2024-09-12T01:56:23.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T01:56:23.778 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:56:24.076 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:24.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:23 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4160483629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:24.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:23 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4160483629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:24.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:23 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4160483629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.543+0000 7f5f8444f640 1 -- 172.21.15.39:0/3311956588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c101de0 msgr2=0x7f5f7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.543+0000 7f5f8444f640 1 --2- 172.21.15.39:0/3311956588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c101de0 0x7f5f7c1021c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009900 tx=0x7f5f7802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 -- 172.21.15.39:0/3311956588 shutdown_connections 2024-09-12T01:56:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 --2- 172.21.15.39:0/3311956588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 0x7f5f7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 --2- 172.21.15.39:0/3311956588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c102790 0x7f5f7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 --2- 172.21.15.39:0/3311956588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c101de0 0x7f5f7c1021c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 -- 172.21.15.39:0/3311956588 >> 172.21.15.39:0/3311956588 conn(0x7f5f7c0fd8c0 msgr2=0x7f5f7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 -- 172.21.15.39:0/3311956588 shutdown_connections 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 -- 172.21.15.39:0/3311956588 wait complete. 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 Processor -- start 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.544+0000 7f5f8444f640 1 -- start start 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 0x7f5f7c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 0x7f5f7c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c111f70 con 0x7f5f7c102790 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c111df0 con 0x7f5f7c106f10 2024-09-12T01:56:24.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f8444f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c1120f0 con 0x7f5f7c101de0 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47178/0 (socket says 172.21.15.39:47178) 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 -- 172.21.15.39:0/2055902736 learned_addr learned my addr 172.21.15.39:0/2055902736 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f829ec640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 0x7f5f7c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f821eb640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 0x7f5f7c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 -- 172.21.15.39:0/2055902736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 msgr2=0x7f5f7c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 0x7f5f7c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 -- 172.21.15.39:0/2055902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 msgr2=0x7f5f7c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 0x7f5f7c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 -- 172.21.15.39:0/2055902736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c19d3c0 con 0x7f5f7c102790 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f821eb640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 0x7f5f7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f819ea640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00d770 tx=0x7f5f6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.545+0000 7f5f737fe640 1 -- 172.21.15.39:0/2055902736 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c017070 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.546+0000 7f5f737fe640 1 -- 172.21.15.39:0/2055902736 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f6c005500 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.546+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c19d6b0 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.546+0000 7f5f737fe640 1 -- 172.21.15.39:0/2055902736 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c004e00 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.546+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a4f90 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.548+0000 7f5f737fe640 1 -- 172.21.15.39:0/2055902736 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f6c004fa0 con 0x7f5f7c102790 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.548+0000 7f5f86828740 1 Processor -- start 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.548+0000 7f5f86828740 1 -- start start 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f737fe640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 0x7f5f680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eefdbb0 0x564f2eefffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564f2ee59090 con 0x564f2eefdbb0 2024-09-12T01:56:24.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f2ee00a70 con 0x564f2eef29d0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f86828740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f2ee55050 con 0x564f2eef32f0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f829ec640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 0x7f5f680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f737fe640 1 -- 172.21.15.39:0/2055902736 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5f6c0cec40 con 0x7f5f7c102790 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50050/0 (socket says 172.21.15.39:50050) 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 -- 172.21.15.39:0/438257846 learned_addr learned my addr 172.21.15.39:0/438257846 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f829ec640 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eefdbb0 0x564f2eefffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f819ea640 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 -- 172.21.15.39:0/438257846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 msgr2=0x564f2eefd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 -- 172.21.15.39:0/438257846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eefdbb0 msgr2=0x564f2eefffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eefdbb0 0x564f2eefffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 -- 172.21.15.39:0/438257846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2ee0d130 con 0x564f2eef29d0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f829ec640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 0x7f5f680a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005fd0 tx=0x7f5f74009e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.549+0000 7f5f821eb640 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031550 tx=0x7f5f78032c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90699b51c9043b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.550+0000 7f5f70dea640 1 -- 172.21.15.39:0/438257846 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7803f070 con 0x564f2eef29d0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.550+0000 7f5f70dea640 1 -- 172.21.15.39:0/438257846 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78032e20 con 0x564f2eef29d0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.550+0000 7f5f70dea640 1 -- 172.21.15.39:0/438257846 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78035070 con 0x564f2eef29d0 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.550+0000 7f5f86828740 1 -- 172.21.15.39:0/438257846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 msgr2=0x564f2eef2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.550+0000 7f5f86828740 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f78031550 tx=0x7f5f78032c30 comp rx=0 tx=0).stop 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- 172.21.15.39:0/438257846 shutdown_connections 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eefdbb0 0x564f2eefffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- 172.21.15.39:0/438257846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2eef2db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- 172.21.15.39:0/438257846 >> 172.21.15.39:0/438257846 conn(0x564f2eeeef60 msgr2=0x564f2eeef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- 172.21.15.39:0/438257846 shutdown_connections 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- 172.21.15.39:0/438257846 wait complete. 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- start start 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 Processor -- start 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef29d0 0x564f2eefd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef04b90 con 0x564f2eef32f0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f2ee13f20 con 0x564f2eefdbb0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef04d10 con 0x564f2eef29d0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f86828740 10 client.0 _ll_register_callbacks cb 0x564f2eddd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.551+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47194/0 (socket says 172.21.15.39:47194) 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 -- 172.21.15.39:0/3049685789 learned_addr learned my addr 172.21.15.39:0/3049685789 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f829ec640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f821eb640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef29d0 0x564f2eefd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 -- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef29d0 msgr2=0x564f2eefd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef29d0 0x564f2eefd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 -- 172.21.15.39:0/3049685789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 msgr2=0x564f2eefabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 -- 172.21.15.39:0/3049685789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2ebca2b0 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f819ea640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c09b2e0 tx=0x7f5f6c004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefb3ff4e65e409f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c020040 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5f6c0cc850 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78032e20 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5f6c0a3fc0 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f86828740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f2ef10400 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.552+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78032e20 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5f6c0bf120 con 0x564f2eef32f0 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:24.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 20 client.14982 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef12a70 0x564f2ef13ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 4 client.14982 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f2ee66600 con 0x564f2ef12a70 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f821eb640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef12a70 0x564f2ef13ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f821eb640 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef12a70 0x564f2ef13ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a51f0bf41e1a0718 server_cookie=dfce20deac6b1385 in_seq=0 out_seq=0 2024-09-12T01:56:24.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.553+0000 7f5f65ffb640 10 client.14982 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f65ffb640 1 -- 172.21.15.39:0/3049685789 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f2ee66600 con 0x564f2ef12a70 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f65ffb640 10 client.14982 handle_command_reply: tid=0 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 client.14982 shutdown 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 msgr2=0x564f2eefa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c09b2e0 tx=0x7f5f6c004800 comp rx=0 tx=0).stop 2024-09-12T01:56:24.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 shutdown_connections 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef12a70 0x564f2ef13ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2eefa6a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f65ffb640 0 client.14982 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 --2- 172.21.15.39:0/3049685789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef29d0 0x564f2eefd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.554+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 >> 172.21.15.39:0/3049685789 conn(0x564f2eeeef60 msgr2=0x564f2eef4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.555+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 shutdown_connections 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.555+0000 7f5f86828740 1 -- 172.21.15.39:0/3049685789 wait complete. 2024-09-12T01:56:24.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.555+0000 7f5f86828740 20 client.14982 trim_cache size 0 max 16384 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 Processor -- start 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 -- start start 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef12220 con 0x564f2eef29d0 2024-09-12T01:56:24.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef128f0 con 0x564f2eefdbb0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.572+0000 7f5f86828740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef12fc0 con 0x564f2eef32f0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47206/0 (socket says 172.21.15.39:47206) 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 -- 172.21.15.39:0/4132065962 learned_addr learned my addr 172.21.15.39:0/4132065962 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f829ec640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f819ea640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 -- 172.21.15.39:0/4132065962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 msgr2=0x564f2eefa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 -- 172.21.15.39:0/4132065962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 msgr2=0x564f2eefaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 -- 172.21.15.39:0/4132065962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2eef3120 con 0x564f2eef29d0 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f819ea640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:24.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f821eb640 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005c40 tx=0x7f5f78005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6a2c0a4b3be266 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f67fff640 1 -- 172.21.15.39:0/4132065962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78051070 con 0x564f2eef29d0 2024-09-12T01:56:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f67fff640 1 -- 172.21.15.39:0/4132065962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78005290 con 0x564f2eef29d0 2024-09-12T01:56:24.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.573+0000 7f5f67fff640 1 -- 172.21.15.39:0/4132065962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7803f070 con 0x564f2eef29d0 2024-09-12T01:56:24.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- 172.21.15.39:0/4132065962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 msgr2=0x564f2ef13ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005c40 tx=0x7f5f78005b50 comp rx=0 tx=0).stop 2024-09-12T01:56:24.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- 172.21.15.39:0/4132065962 shutdown_connections 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eefdbb0 0x564f2eefaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eef32f0 0x564f2eefa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 --2- 172.21.15.39:0/4132065962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef29d0 0x564f2ef13ee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- 172.21.15.39:0/4132065962 >> 172.21.15.39:0/4132065962 conn(0x564f2eeeef60 msgr2=0x564f2eee9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- 172.21.15.39:0/4132065962 shutdown_connections 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- 172.21.15.39:0/4132065962 wait complete. 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 -- start start 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.574+0000 7f5f86828740 1 Processor -- start 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2ef17290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 0x564f2ef7b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef13d60 con 0x564f2eef32f0 2024-09-12T01:56:24.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef13690 con 0x564f2eef29d0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f2ef14430 con 0x564f2eefdbb0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 10 client.0 _ll_register_callbacks cb 0x7f5f6c00de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47222/0 (socket says 172.21.15.39:47222) 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 -- 172.21.15.39:0/555989260 learned_addr learned my addr 172.21.15.39:0/555989260 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f821eb640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2ef17290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f829ec640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 0x564f2ef7b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 -- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 msgr2=0x564f2ef7b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 0x564f2ef7b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 -- 172.21.15.39:0/555989260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 msgr2=0x564f2ef17290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2ef17290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 -- 172.21.15.39:0/555989260 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2ef180c0 con 0x564f2eef32f0 2024-09-12T01:56:24.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f829ec640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 0x564f2ef7b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f819ea640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0cc680 tx=0x7f5f6c0056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6230f4896f4a7790 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c020050 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5f6c009cc0 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.575+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78005290 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5f6c09acb0 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 10 client.14988 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f2ef7c750 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f78005290 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5f6c0bb2b0 con 0x564f2eef32f0 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 10 client.14988 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:56:24.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 20 client.14988 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef812e0 0x564f2ef7fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 4 client.14988 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "status"}) -- 0x564f2ee60b10 con 0x564f2ef812e0 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.576+0000 7f5f821eb640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef812e0 0x564f2ef7fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f821eb640 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef812e0 0x564f2ef7fff0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46fb1f260588c264 server_cookie=1fead0dae2c0d2b2 in_seq=0 out_seq=0 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f65ffb640 10 client.14988 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f65ffb640 1 -- 172.21.15.39:0/555989260 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564f2ee60b10 con 0x564f2ef812e0 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f65ffb640 10 client.14988 handle_command_reply: tid=0 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 client.14988 shutdown 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 msgr2=0x564f2ef177d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0cc680 tx=0x7f5f6c0056b0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 shutdown_connections 2024-09-12T01:56:24.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x564f2ef812e0 0x564f2ef7fff0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f2eefdbb0 0x564f2ef7b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564f2eef32f0 0x564f2ef177d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f65ffb640 0 client.14988 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 --2- 172.21.15.39:0/555989260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564f2eef29d0 0x564f2ef17290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 >> 172.21.15.39:0/555989260 conn(0x564f2eeeef60 msgr2=0x564f2eeef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 shutdown_connections 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 1 -- 172.21.15.39:0/555989260 wait complete. 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.577+0000 7f5f86828740 20 client.14988 trim_cache size 0 max 16384 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:24.583 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24463, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 67.923554197000001, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 95.919275912000003 2024-09-12T01:56:24.584 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 msgr2=0x7f5f680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 0x7f5f680a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005fd0 tx=0x7f5f74009e90 comp rx=0 tx=0).stop 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 msgr2=0x7f5f7c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00d770 tx=0x7f5f6c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 shutdown_connections 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f7c106f10 0x7f5f7c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f7c102790 0x7f5f7c198950 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5f680a2c10 0x7f5f680a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 --2- 172.21.15.39:0/2055902736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101de0 0x7f5f7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 >> 172.21.15.39:0/2055902736 conn(0x7f5f7c0fd8c0 msgr2=0x7f5f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 shutdown_connections 2024-09-12T01:56:24.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:24.578+0000 7f5f8444f640 1 -- 172.21.15.39:0/2055902736 wait complete. 2024-09-12T01:56:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:24 smithi172 ceph-mon[35073]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:25.285 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:24 smithi039 ceph-mon[31204]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:25.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:56:25.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:24 smithi044 ceph-mon[35259]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:25.577 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 -- 172.21.15.39:0/406216567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 msgr2=0x7f2af4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 --2- 172.21.15.39:0/406216567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af4100ee0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009930 tx=0x7f2ae802a420 comp rx=0 tx=0).stop 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 -- 172.21.15.39:0/406216567 shutdown_connections 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 --2- 172.21.15.39:0/406216567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 0x7f2af410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 --2- 172.21.15.39:0/406216567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af4100ee0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 --2- 172.21.15.39:0/406216567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 0x7f2af4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 -- 172.21.15.39:0/406216567 >> 172.21.15.39:0/406216567 conn(0x7f2af40fc7a0 msgr2=0x7f2af40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 -- 172.21.15.39:0/406216567 shutdown_connections 2024-09-12T01:56:26.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.072+0000 7f2af9a65640 1 -- 172.21.15.39:0/406216567 wait complete. 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 Processor -- start 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 -- start start 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 0x7f2af419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 0x7f2af419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4110ea0 con 0x7f2af4100a80 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4110d20 con 0x7f2af4101420 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af9a65640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4111020 con 0x7f2af4106a80 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47234/0 (socket says 172.21.15.39:47234) 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af37fe640 1 -- 172.21.15.39:0/3125369042 learned_addr learned my addr 172.21.15.39:0/3125369042 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 0x7f2af419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.073+0000 7f2af3fff640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 0x7f2af419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 -- 172.21.15.39:0/3125369042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 msgr2=0x7f2af419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 0x7f2af419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 -- 172.21.15.39:0/3125369042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 msgr2=0x7f2af419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 0x7f2af419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 -- 172.21.15.39:0/3125369042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af419f690 con 0x7f2af4100a80 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af37fe640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400b4a0 tx=0x7f2ae400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af0ff9640 1 -- 172.21.15.39:0/3125369042 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4014070 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af0ff9640 1 -- 172.21.15.39:0/3125369042 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae4010af0 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af419f980 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af0ff9640 1 -- 172.21.15.39:0/3125369042 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4017d10 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.074+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af41a7260 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.076+0000 7f2af0ff9640 1 -- 172.21.15.39:0/3125369042 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2ae4017070 con 0x7f2af4100a80 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 Processor -- start 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 -- start start 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512969d0 0x557f51296db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f511fd090 con 0x557f512a1bb0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557f511a4a70 con 0x557f512972f0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557f511f9050 con 0x557f512969d0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512969d0 0x557f51296db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47238/0 (socket says 172.21.15.39:47238) 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af2ffd640 1 -- 172.21.15.39:0/1385055881 learned_addr learned my addr 172.21.15.39:0/1385055881 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af0ff9640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 0x7f2adc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.077+0000 7f2af3fff640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 0x7f2adc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 -- 172.21.15.39:0/1385055881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512969d0 msgr2=0x557f51296db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512969d0 0x557f51296db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 -- 172.21.15.39:0/1385055881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 msgr2=0x557f512a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af0ff9640 1 -- 172.21.15.39:0/3125369042 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ae40ce440 con 0x7f2af4100a80 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 -- 172.21.15.39:0/1385055881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f511b1130 con 0x557f512a1bb0 2024-09-12T01:56:26.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ae802a940 tx=0x7f2ae80316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41887aba4841f195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2af3fff640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 0x7f2adc0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00afd0 tx=0x7f2aec004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2ad9ffb640 1 -- 172.21.15.39:0/1385055881 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8040070 con 0x557f512a1bb0 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2ad9ffb640 1 -- 172.21.15.39:0/1385055881 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae8005020 con 0x557f512a1bb0 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.078+0000 7f2ad9ffb640 1 -- 172.21.15.39:0/1385055881 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8035040 con 0x557f512a1bb0 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1385055881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 msgr2=0x557f512a3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ae802a940 tx=0x7f2ae80316e0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1385055881 shutdown_connections 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f512a3fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1385055881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512969d0 0x557f51296db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1385055881 >> 172.21.15.39:0/1385055881 conn(0x557f51292f60 msgr2=0x557f51293340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1385055881 shutdown_connections 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1385055881 wait complete. 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 -- start start 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.079+0000 7f2afbe3e740 1 Processor -- start 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512969d0 0x557f512a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f5129e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f512a4780 con 0x557f512a1bb0 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557f511b7f20 con 0x557f512969d0 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557f512a4900 con 0x557f512972f0 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2afbe3e740 10 client.0 _ll_register_callbacks cb 0x557f51181030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47244/0 (socket says 172.21.15.39:47244) 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 -- 172.21.15.39:0/1682653283 learned_addr learned my addr 172.21.15.39:0/1682653283 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f5129e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512969d0 0x557f512a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 -- 172.21.15.39:0/1682653283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 msgr2=0x557f5129e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f5129e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 -- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512969d0 msgr2=0x557f512a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512969d0 0x557f512a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.080+0000 7f2af3fff640 1 -- 172.21.15.39:0/1682653283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f50f6e2b0 con 0x557f512a1bb0 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2af3fff640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00f6c0 tx=0x7f2aec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b810334582d271 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2ad2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:26.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec019070 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2aec004d20 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae8005020 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2aec01f640 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2afbe3e740 10 client.15000 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.081+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f512b0060 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae8005020 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2aec005460 con 0x557f512a1bb0 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 10 client.15000 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 10 client.15000 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:56:26.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 20 client.15000 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f512b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 4 client.15000 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f5120a600 con 0x557f512b26f0 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.082+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f512b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.083+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f512b3b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=788fc2b6ea33b1cf server_cookie=87f745fe564d8c6e in_seq=0 out_seq=0 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.083+0000 7f2ad2ffd640 10 client.15000 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.083+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1682653283 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f5120a600 con 0x557f512b26f0 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.083+0000 7f2ad2ffd640 10 client.15000 handle_command_reply: tid=0 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.083+0000 7f2afbe3e740 1 client.15000 shutdown 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 msgr2=0x557f5129ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00f6c0 tx=0x7f2aec004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 shutdown_connections 2024-09-12T01:56:26.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f512b3b60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512a1bb0 0x557f5129ec60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f5129e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2ad2ffd640 0 client.15000 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1682653283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512969d0 0x557f512a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 >> 172.21.15.39:0/1682653283 conn(0x557f51292f60 msgr2=0x557f51298c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 shutdown_connections 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1682653283 wait complete. 2024-09-12T01:56:26.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.084+0000 7f2afbe3e740 20 client.15000 trim_cache size 0 max 16384 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 Processor -- start 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 -- start start 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512a1bb0 0x557f5129e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f512b1ea0 con 0x557f512969d0 2024-09-12T01:56:26.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557f512b2570 con 0x557f512972f0 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557f512b2c40 con 0x557f512a1bb0 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47248/0 (socket says 172.21.15.39:47248) 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 -- 172.21.15.39:0/999161684 learned_addr learned my addr 172.21.15.39:0/999161684 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 -- 172.21.15.39:0/999161684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512a1bb0 msgr2=0x557f5129e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af3fff640 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512a1bb0 0x557f5129e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512a1bb0 0x557f5129e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 -- 172.21.15.39:0/999161684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 msgr2=0x557f512a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.102+0000 7f2af37fe640 1 -- 172.21.15.39:0/999161684 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f51292d90 con 0x557f512969d0 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2af37fe640 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4097170 tx=0x7f2ae4096e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e0ff5283b15850 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2ad97fa640 1 -- 172.21.15.39:0/999161684 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae401e040 con 0x557f512969d0 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2ad97fa640 1 -- 172.21.15.39:0/999161684 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae40a38d0 con 0x557f512969d0 2024-09-12T01:56:26.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2ad97fa640 1 -- 172.21.15.39:0/999161684 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4017460 con 0x557f512969d0 2024-09-12T01:56:26.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 -- 172.21.15.39:0/999161684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 msgr2=0x557f5129dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4097170 tx=0x7f2ae4096e90 comp rx=0 tx=0).stop 2024-09-12T01:56:26.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 -- 172.21.15.39:0/999161684 shutdown_connections 2024-09-12T01:56:26.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512a1bb0 0x557f5129e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512972f0 0x557f512a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/999161684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f5129dfe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 -- 172.21.15.39:0/999161684 >> 172.21.15.39:0/999161684 conn(0x557f51292f60 msgr2=0x557f5129cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.103+0000 7f2afbe3e740 1 -- 172.21.15.39:0/999161684 shutdown_connections 2024-09-12T01:56:26.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 -- 172.21.15.39:0/999161684 wait complete. 2024-09-12T01:56:26.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 -- start start 2024-09-12T01:56:26.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 Processor -- start 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f512b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512a1bb0 0x557f5131adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557f512b39e0 con 0x557f512969d0 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557f512b3310 con 0x557f512a1bb0 2024-09-12T01:56:26.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557f512b40b0 con 0x557f512972f0 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2afbe3e740 10 client.0 _ll_register_callbacks cb 0x7f2aec013e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.104+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47262/0 (socket says 172.21.15.39:47262) 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 -- 172.21.15.39:0/1401321841 learned_addr learned my addr 172.21.15.39:0/1401321841 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af3fff640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512a1bb0 0x557f5131adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f512b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 -- 172.21.15.39:0/1401321841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 msgr2=0x557f512b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f512b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 -- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512a1bb0 msgr2=0x557f5131adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512a1bb0 0x557f5131adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 -- 172.21.15.39:0/1401321841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5131b430 con 0x557f512969d0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2af37fe640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40cc380 tx=0x7f2ae40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ce62e392462e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2ad2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae401e070 con 0x557f512969d0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ae4010ca0 con 0x557f512969d0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae40a38d0 con 0x557f512969d0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ae4097380 con 0x557f512969d0 2024-09-12T01:56:26.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2afbe3e740 10 client.15006 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.105+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f5131c710 con 0x557f512969d0 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae40a38d0 con 0x557f512969d0 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2ae4079b80 con 0x557f512969d0 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 10 client.15006 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 10 client.15006 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 20 client.15006 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:26.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f5131fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 4 client.15006 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "status"}) -- 0x557f51204b10 con 0x557f512b26f0 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f5131fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2af2ffd640 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f5131fa00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9332502c4b9454e5 server_cookie=4c5a8d8e689e2b9c in_seq=0 out_seq=0 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.106+0000 7f2ad2ffd640 10 client.15006 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2ad2ffd640 1 -- 172.21.15.39:0/1401321841 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557f51204b10 con 0x557f512b26f0 2024-09-12T01:56:26.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2ad2ffd640 10 client.15006 handle_command_reply: tid=0 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 client.15006 shutdown 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 msgr2=0x557f512b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40cc380 tx=0x7f2ae40047d0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 shutdown_connections 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x557f512b26f0 0x557f5131fa00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557f512a1bb0 0x557f5131adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f512972f0 0x557f512b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 --2- 172.21.15.39:0/1401321841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557f512969d0 0x557f512b7360 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 >> 172.21.15.39:0/1401321841 conn(0x557f51292f60 msgr2=0x557f5129cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2ad2ffd640 0 client.15006 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 shutdown_connections 2024-09-12T01:56:26.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 1 -- 172.21.15.39:0/1401321841 wait complete. 2024-09-12T01:56:26.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.107+0000 7f2afbe3e740 20 client.15006 trim_cache size 0 max 16384 2024-09-12T01:56:26.122 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:26.122 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:26.122 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24467, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 70.465336530000002, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 100.03569386300001 2024-09-12T01:56:26.123 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:26.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 msgr2=0x7f2adc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 0x7f2adc0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00afd0 tx=0x7f2aec004ab0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 msgr2=0x7f2af419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400b4a0 tx=0x7f2ae400b960 comp rx=0 tx=0).stop 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 shutdown_connections 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2adc0a2c10 0x7f2adc0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2af4106a80 0x7f2af419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2af4101420 0x7f2af419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 --2- 172.21.15.39:0/3125369042 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2af4100a80 0x7f2af419a6e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 >> 172.21.15.39:0/3125369042 conn(0x7f2af40fc7a0 msgr2=0x7f2af406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 shutdown_connections 2024-09-12T01:56:26.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:26.108+0000 7f2af9a65640 1 -- 172.21.15.39:0/3125369042 wait complete. 2024-09-12T01:56:26.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:56:27.119 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:26 smithi039 ceph-mon[31204]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T01:56:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:26 smithi172 ceph-mon[35073]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T01:56:27.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:26 smithi044 ceph-mon[35259]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 -- 172.21.15.39:0/2630341870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 msgr2=0x7f6110104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 --2- 172.21.15.39:0/2630341870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f6110104e80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f610400aa10 tx=0x7f610402b720 comp rx=0 tx=0).stop 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 -- 172.21.15.39:0/2630341870 shutdown_connections 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 --2- 172.21.15.39:0/2630341870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 0x7f611010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 --2- 172.21.15.39:0/2630341870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f6110104e80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 --2- 172.21.15.39:0/2630341870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 0x7f6110100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 -- 172.21.15.39:0/2630341870 >> 172.21.15.39:0/2630341870 conn(0x7f6110077210 msgr2=0x7f61100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 -- 172.21.15.39:0/2630341870 shutdown_connections 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.627+0000 7f61169d3640 1 -- 172.21.15.39:0/2630341870 wait complete. 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 Processor -- start 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 -- start start 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 0x7f6110196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 0x7f611019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f611010fd60 con 0x7f6110100e30 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f611010fbe0 con 0x7f61101055b0 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f61169d3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f611010fee0 con 0x7f6110100480 2024-09-12T01:56:27.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47290/0 (socket says 172.21.15.39:47290) 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f610f7fe640 1 -- 172.21.15.39:0/1354641866 learned_addr learned my addr 172.21.15.39:0/1354641866 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.628+0000 7f6114f70640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 0x7f611019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610ffff640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 0x7f6110196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 -- 172.21.15.39:0/1354641866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 msgr2=0x7f6110196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 0x7f6110196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 -- 172.21.15.39:0/1354641866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 msgr2=0x7f611019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 0x7f611019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 -- 172.21.15.39:0/1354641866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611019b230 con 0x7f6110100e30 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6104006010 tx=0x7f61040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610d7fa640 1 -- 172.21.15.39:0/1354641866 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104040070 con 0x7f6110100e30 2024-09-12T01:56:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611019b4c0 con 0x7f6110100e30 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610d7fa640 1 -- 172.21.15.39:0/1354641866 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f610403c460 con 0x7f6110100e30 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f610d7fa640 1 -- 172.21.15.39:0/1354641866 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104036030 con 0x7f6110100e30 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.629+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61101a2e00 con 0x7f6110100e30 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.631+0000 7f610d7fa640 1 -- 172.21.15.39:0/1354641866 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6104043070 con 0x7f6110100e30 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 Processor -- start 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 -- start start 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fd5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1fe2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629a1f3c090 con 0x5629a1fd62f0 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ee3a70 con 0x5629a1fe0bb0 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6118dac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629a1f38050 con 0x5629a1fd59d0 2024-09-12T01:56:27.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47296/0 (socket says 172.21.15.39:47296) 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 -- 172.21.15.39:0/1728738397 learned_addr learned my addr 172.21.15.39:0/1728738397 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1fe2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f6114f70640 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fd5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610d7fa640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 0x7f60f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 -- 172.21.15.39:0/1728738397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 msgr2=0x5629a1fd5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fd5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 -- 172.21.15.39:0/1728738397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 msgr2=0x5629a1fe2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1fe2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.632+0000 7f610ffff640 1 -- 172.21.15.39:0/1728738397 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a1ef0130 con 0x5629a1fd62f0 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f6114f70640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 0x7f60f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f610d7fa640 1 -- 172.21.15.39:0/1354641866 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61040f0d10 con 0x7f6110100e30 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f610ffff640 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f610000cc60 tx=0x7f610000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f366c7eff5d012 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f60f67fc640 1 -- 172.21.15.39:0/1728738397 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100014070 con 0x5629a1fd62f0 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f60f67fc640 1 -- 172.21.15.39:0/1728738397 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61000047a0 con 0x5629a1fd62f0 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.633+0000 7f60f67fc640 1 -- 172.21.15.39:0/1728738397 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100010790 con 0x5629a1fd62f0 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- 172.21.15.39:0/1728738397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 msgr2=0x5629a1fe0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6114f70640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 0x7f60f80a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6108005fd0 tx=0x7f6108004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f610000cc60 tx=0x7f610000e720 comp rx=0 tx=0).stop 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- 172.21.15.39:0/1728738397 shutdown_connections 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1fe2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fe0670 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 --2- 172.21.15.39:0/1728738397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fd5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- 172.21.15.39:0/1728738397 >> 172.21.15.39:0/1728738397 conn(0x5629a1fd1f60 msgr2=0x5629a1fd2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- 172.21.15.39:0/1728738397 shutdown_connections 2024-09-12T01:56:27.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- 172.21.15.39:0/1728738397 wait complete. 2024-09-12T01:56:27.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 -- start start 2024-09-12T01:56:27.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.634+0000 7f6118dac740 1 Processor -- start 2024-09-12T01:56:27.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd62f0 0x5629a1fdd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fe0bb0 0x5629a1fdde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629a1fe5870 con 0x5629a1fd59d0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ef6f20 con 0x5629a1fd62f0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629a1fe59f0 con 0x5629a1fe0bb0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 10 client.0 _ll_register_callbacks cb 0x5629a1ec0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47312/0 (socket says 172.21.15.39:47312) 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 -- 172.21.15.39:0/252527407 learned_addr learned my addr 172.21.15.39:0/252527407 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610f7fe640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd62f0 0x5629a1fdd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 -- 172.21.15.39:0/252527407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fe0bb0 msgr2=0x5629a1fdde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fe0bb0 0x5629a1fdde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 -- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd62f0 msgr2=0x5629a1fdd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd62f0 0x5629a1fdd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 -- 172.21.15.39:0/252527407 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a1cad2b0 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f610ffff640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f610000ec20 tx=0x7f6100010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7b5c64dbf2d040 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f60ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100014070 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6100004030 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.635+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61000047a0 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6100004230 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 10 client.15018 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629a1ff12c0 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61000047a0 con 0x5629a1fd59d0 2024-09-12T01:56:27.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6100023420 con 0x5629a1fd59d0 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 10 client.15018 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 10 client.15018 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 20 client.15018 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a1ff3770 0x5629a1ff4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 4 client.15018 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.636+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a1f49600 con 0x5629a1ff3770 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.637+0000 7f610f7fe640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a1ff3770 0x5629a1ff4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.637+0000 7f610f7fe640 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a1ff3770 0x5629a1ff4be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c572b38ac50b208e server_cookie=38e5ed8f9b07d7a4 in_seq=0 out_seq=0 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.637+0000 7f60ef7fe640 10 client.15018 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f60ef7fe640 1 -- 172.21.15.39:0/252527407 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629a1f49600 con 0x5629a1ff3770 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f60ef7fe640 10 client.15018 handle_command_reply: tid=0 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 client.15018 shutdown 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 msgr2=0x5629a1fe0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f610000ec20 tx=0x7f6100010b80 comp rx=0 tx=0).stop 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 shutdown_connections 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a1ff3770 0x5629a1ff4be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fe0bb0 0x5629a1fdde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd62f0 0x5629a1fdd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f60ef7fe640 0 client.15018 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 --2- 172.21.15.39:0/252527407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd59d0 0x5629a1fe0530 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 >> 172.21.15.39:0/252527407 conn(0x5629a1fd1f60 msgr2=0x5629a1fd7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 shutdown_connections 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 1 -- 172.21.15.39:0/252527407 wait complete. 2024-09-12T01:56:27.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.638+0000 7f6118dac740 20 client.15018 trim_cache size 0 max 16384 2024-09-12T01:56:27.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 Processor -- start 2024-09-12T01:56:27.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 -- start start 2024-09-12T01:56:27.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd59d0 0x5629a1ff4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd62f0 0x5629a1ff2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff2f20 con 0x5629a1fe0bb0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff35f0 con 0x5629a1fd59d0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.656+0000 7f6118dac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff3cc0 con 0x5629a1fd62f0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47314/0 (socket says 172.21.15.39:47314) 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 -- 172.21.15.39:0/2042868299 learned_addr learned my addr 172.21.15.39:0/2042868299 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f610f7fe640 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd62f0 0x5629a1ff2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f610ffff640 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd59d0 0x5629a1ff4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 -- 172.21.15.39:0/2042868299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd62f0 msgr2=0x5629a1ff2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd62f0 0x5629a1ff2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 -- 172.21.15.39:0/2042868299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd59d0 msgr2=0x5629a1ff4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd59d0 0x5629a1ff4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 -- 172.21.15.39:0/2042868299 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a1fd5800 con 0x5629a1fe0bb0 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f6114f70640 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f61080092f0 tx=0x7f6108014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b7b581b0ffcfdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f60f5ffb640 1 -- 172.21.15.39:0/2042868299 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610801c6d0 con 0x5629a1fe0bb0 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f60f5ffb640 1 -- 172.21.15.39:0/2042868299 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f610801cd50 con 0x5629a1fe0bb0 2024-09-12T01:56:27.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.657+0000 7f60f5ffb640 1 -- 172.21.15.39:0/2042868299 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080253f0 con 0x5629a1fe0bb0 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- 172.21.15.39:0/2042868299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 msgr2=0x5629a1fd8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f61080092f0 tx=0x7f6108014070 comp rx=0 tx=0).stop 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- 172.21.15.39:0/2042868299 shutdown_connections 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fe0bb0 0x5629a1fd8e30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd62f0 0x5629a1ff2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 --2- 172.21.15.39:0/2042868299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fd59d0 0x5629a1ff4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- 172.21.15.39:0/2042868299 >> 172.21.15.39:0/2042868299 conn(0x5629a1fd1f60 msgr2=0x5629a1fd2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- 172.21.15.39:0/2042868299 shutdown_connections 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- 172.21.15.39:0/2042868299 wait complete. 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.658+0000 7f6118dac740 1 -- start start 2024-09-12T01:56:27.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 Processor -- start 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fda290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1ffbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff4a60 con 0x5629a1fd62f0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff4390 con 0x5629a1fe0bb0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629a1ff5130 con 0x5629a1fd59d0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6118dac740 10 client.0 _ll_register_callbacks cb 0x7f610000cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47322/0 (socket says 172.21.15.39:47322) 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 -- 172.21.15.39:0/1003876828 learned_addr learned my addr 172.21.15.39:0/1003876828 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f6114f70640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1ffbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610ffff640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fda290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 -- 172.21.15.39:0/1003876828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 msgr2=0x5629a1fda290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fda290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 -- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 msgr2=0x5629a1ffbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1ffbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 -- 172.21.15.39:0/1003876828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a1ffc4e0 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f610f7fe640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f61040ee700 tx=0x7f610402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2853085b2547a7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.659+0000 7f60ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610404a040 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61040b9a90 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f610801cd50 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f61040a6070 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 10 client.15024 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629a1ffd780 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f610801cd50 con 0x5629a1fd62f0 2024-09-12T01:56:27.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f61040eece0 con 0x5629a1fd62f0 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 10 client.15024 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 20 client.15024 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a2062480 0x5629a2061190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 4 client.15024 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.660+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "status"}) -- 0x5629a1f43b10 con 0x5629a2062480 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f610ffff640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a2062480 0x5629a2061190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f60ef7fe640 10 client.15024 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f610ffff640 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a2062480 0x5629a2061190 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c78c13dc5fd58c server_cookie=63cd0d3547099eef in_seq=0 out_seq=0 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f60ef7fe640 1 -- 172.21.15.39:0/1003876828 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5629a1f43b10 con 0x5629a2062480 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f60ef7fe640 10 client.15024 handle_command_reply: tid=0 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 client.15024 shutdown 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 msgr2=0x5629a1fda7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f61040ee700 tx=0x7f610402b720 comp rx=0 tx=0).stop 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 shutdown_connections 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5629a2062480 0x5629a2061190 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f60ef7fe640 0 client.15024 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629a1fe0bb0 0x5629a1ffbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5629a1fd62f0 0x5629a1fda7d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 --2- 172.21.15.39:0/1003876828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629a1fd59d0 0x5629a1fda290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 >> 172.21.15.39:0/1003876828 conn(0x5629a1fd1f60 msgr2=0x5629a1fdd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 shutdown_connections 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.661+0000 7f6118dac740 1 -- 172.21.15.39:0/1003876828 wait complete. 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f6118dac740 20 client.15024 trim_cache size 0 max 16384 2024-09-12T01:56:27.668 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24503, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 79.075103760999994, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 89.858933836999995 2024-09-12T01:56:27.669 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 msgr2=0x7f60f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 0x7f60f80a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6108005fd0 tx=0x7f6108004a40 comp rx=0 tx=0).stop 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 msgr2=0x7f61101967c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6104006010 tx=0x7f61040042f0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 shutdown_connections 2024-09-12T01:56:27.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61101055b0 0x7f611019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6110100e30 0x7f61101967c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60f80a2c10 0x7f60f80a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 --2- 172.21.15.39:0/1354641866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6110100480 0x7f6110196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 >> 172.21.15.39:0/1354641866 conn(0x7f6110077210 msgr2=0x7f6110103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 shutdown_connections 2024-09-12T01:56:27.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:27.662+0000 7f61169d3640 1 -- 172.21.15.39:0/1354641866 wait complete. 2024-09-12T01:56:28.411 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T01:56:28.412 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:56:28.421 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T01:56:28.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T01:56:28.680 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:29.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:28 smithi039 ceph-mon[31204]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 -- 172.21.15.39:0/2401537065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c1037c0 msgr2=0x7f639c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 --2- 172.21.15.39:0/2401537065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c1037c0 0x7f639c10a050 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6394009ca0 tx=0x7f639402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 -- 172.21.15.39:0/2401537065 shutdown_connections 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 --2- 172.21.15.39:0/2401537065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c1037c0 0x7f639c10a050 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 --2- 172.21.15.39:0/2401537065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c102e00 0x7f639c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 --2- 172.21.15.39:0/2401537065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f639c101c00 0x7f639c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 -- 172.21.15.39:0/2401537065 >> 172.21.15.39:0/2401537065 conn(0x7f639c0fd390 msgr2=0x7f639c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 -- 172.21.15.39:0/2401537065 shutdown_connections 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.170+0000 7f63a23ac640 1 -- 172.21.15.39:0/2401537065 wait complete. 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 Processor -- start 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 -- start start 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f639c102e00 0x7f639c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 0x7f639c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f639c10d980 con 0x7f639c101c00 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f639c10d800 con 0x7f639c1037c0 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a23ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f639c10db00 con 0x7f639c102e00 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47332/0 (socket says 172.21.15.39:47332) 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 -- 172.21.15.39:0/539939259 learned_addr learned my addr 172.21.15.39:0/539939259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f63a0949640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 0x7f639c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 -- 172.21.15.39:0/539939259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f639c102e00 msgr2=0x7f639c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f639c102e00 0x7f639c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 -- 172.21.15.39:0/539939259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 msgr2=0x7f639c19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 0x7f639c19f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.171+0000 7f639bfff640 1 -- 172.21.15.39:0/539939259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c19fc50 con 0x7f639c101c00 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63a0949640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 0x7f639c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f639bfff640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f638c00b450 tx=0x7f638c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c015020 con 0x7f639c101c00 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f638c011d70 con 0x7f639c101c00 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639c19ff40 con 0x7f639c101c00 2024-09-12T01:56:29.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c00f340 con 0x7f639c101c00 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.172+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639c1a0470 con 0x7f639c101c00 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.173+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639c109000 con 0x7f639c101c00 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.174+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f638c018020 con 0x7f639c101c00 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.175+0000 7f63997fa640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 0x7f63840a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.175+0000 7f639b7fe640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 0x7f63840a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.175+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f638c0cefe0 con 0x7f639c101c00 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.175+0000 7f639b7fe640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 0x7f63840a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f639c199540 tx=0x7f6390006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:29.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.178+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f638c01f020 con 0x7f639c101c00 2024-09-12T01:56:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:28 smithi172 ceph-mon[35073]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:29.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.369+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f639c062630 con 0x7f63840a2c40 2024-09-12T01:56:29.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.370+0000 7f63997fa640 1 -- 172.21.15.39:0/539939259 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f639c062630 con 0x7f63840a2c40 2024-09-12T01:56:29.371 INFO:teuthology.orchestra.run.smithi039.stdout:Backend: cephadm 2024-09-12T01:56:29.371 INFO:teuthology.orchestra.run.smithi039.stdout:Available: Yes 2024-09-12T01:56:29.371 INFO:teuthology.orchestra.run.smithi039.stdout:Paused: No 2024-09-12T01:56:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 msgr2=0x7f63840a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 0x7f63840a5100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f639c199540 tx=0x7f6390006c90 comp rx=0 tx=0).stop 2024-09-12T01:56:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 msgr2=0x7f639c198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:29.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f638c00b450 tx=0x7f638c00b910 comp rx=0 tx=0).stop 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 shutdown_connections 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c1037c0 0x7f639c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f63840a2c40 0x7f63840a5100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f639c102e00 0x7f639c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 --2- 172.21.15.39:0/539939259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f639c101c00 0x7f639c198020 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 >> 172.21.15.39:0/539939259 conn(0x7f639c0fd390 msgr2=0x7f639c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 shutdown_connections 2024-09-12T01:56:29.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:29.372+0000 7f63a23ac640 1 -- 172.21.15.39:0/539939259 wait complete. 2024-09-12T01:56:29.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:28 smithi044 ceph-mon[35259]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:30.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T01:56:30.439 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:30.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.880+0000 7f301bb00640 1 -- 172.21.15.39:0/3685354639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 msgr2=0x7f30141073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.880+0000 7f301bb00640 1 --2- 172.21.15.39:0/3685354639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141073c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3004009900 tx=0x7f300402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:30.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 -- 172.21.15.39:0/3685354639 shutdown_connections 2024-09-12T01:56:30.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 --2- 172.21.15.39:0/3685354639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 0x7f3014109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 --2- 172.21.15.39:0/3685354639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141073c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 --2- 172.21.15.39:0/3685354639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f3014104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 -- 172.21.15.39:0/3685354639 >> 172.21.15.39:0/3685354639 conn(0x7f30140fc2a0 msgr2=0x7f30140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 -- 172.21.15.39:0/3685354639 shutdown_connections 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 -- 172.21.15.39:0/3685354639 wait complete. 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 Processor -- start 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 -- start start 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.881+0000 7f301bb00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f30141980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 0x7f301419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f301410d9c0 con 0x7f3014104fd0 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f301410d840 con 0x7f3014107900 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f301410db40 con 0x7f30141026a0 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47354/0 (socket says 172.21.15.39:47354) 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 -- 172.21.15.39:0/772477345 learned_addr learned my addr 172.21.15.39:0/772477345 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301989c640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f30141980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301a09d640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 0x7f301419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 -- 172.21.15.39:0/772477345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 msgr2=0x7f30141980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f30141980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 -- 172.21.15.39:0/772477345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 msgr2=0x7f301419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 0x7f301419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 -- 172.21.15.39:0/772477345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301419fcd0 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301989c640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f30141980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301909b640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f300402aa00 tx=0x7f3004032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300403f030 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301419ff60 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3004003ce0 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.882+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004035070 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.883+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141a0430 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.884+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30140fdd90 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.885+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3004042030 con 0x7f3014104fd0 2024-09-12T01:56:30.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.885+0000 7f300affd640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 0x7f30000a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:30.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.886+0000 7f301989c640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 0x7f30000a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:30.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.886+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f30040efce0 con 0x7f3014104fd0 2024-09-12T01:56:30.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.886+0000 7f301989c640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 0x7f30000a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3010009930 tx=0x7f3010008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:30.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:30.889+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30040bcaf0 con 0x7f3014104fd0 2024-09-12T01:56:31.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.075+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3014062630 con 0x7f30000a2c40 2024-09-12T01:56:31.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.088+0000 7f300affd640 1 -- 172.21.15.39:0/772477345 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3014062630 con 0x7f30000a2c40 2024-09-12T01:56:31.088 INFO:teuthology.orchestra.run.smithi039.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.a smithi039 running (96s) 17s ago 96s 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 8ce4c98e39de 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.b smithi044 running (93s) 26s ago 93s 28.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 539fa268af6c 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.c smithi172 running (108s) 26s ago 107s 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 7f112e178a3c 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.d smithi039 running (116s) 17s ago 115s 14.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 a25fd9137521 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.e smithi044 running (113s) 26s ago 112s 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 6e755a50f523 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.f smithi172 running (110s) 26s ago 110s 15.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 5806b0c13a69 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.g smithi039 running (100s) 17s ago 99s 14.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 35dc700ef5a2 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.h smithi044 running (105s) 26s ago 104s 19.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 e4fafe3c9815 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.i smithi172 running (102s) 26s ago 102s 20.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 6cf83d847c8f 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.j smithi039 running (119s) 17s ago 119s 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 78a6dd6e7942 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.k smithi044 running (2m) 26s ago 2m 13.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 4f3d36cbb2ed 2024-09-12T01:56:31.089 INFO:teuthology.orchestra.run.smithi039.stdout:mds.l smithi172 running (2m) 26s ago 2m 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 f240adfe77e7 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.x smithi039 *:9283,8765 running (9m) 17s ago 9m 508M - 19.1.1-298-gb53b6d3e 54467abc55f8 3d43d73b8952 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.y smithi044 *:8443,8765 running (7m) 26s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 5172d2c68804 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.z smithi172 *:8443,8765 running (7m) 26s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 341da2dff46a 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mon.a smithi039 running (9m) 17s ago 9m 51.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 dabe1095c0b1 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mon.b smithi044 running (7m) 26s ago 7m 39.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 c3ad14bb4e9a 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:mon.c smithi172 running (7m) 26s ago 7m 39.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 ed473400afab 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 smithi039 running (7m) 17s ago 7m 44.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 fade99e30310 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 smithi044 running (6m) 26s ago 6m 57.0M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 e4c33828c4de 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 smithi172 running (6m) 26s ago 6m 46.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 c0de0e100197 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 smithi039 running (5m) 17s ago 5m 53.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 af381157c6d1 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 smithi044 running (5m) 26s ago 5m 52.2M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 e9a9c4adbfe5 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 smithi172 running (5m) 26s ago 5m 42.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 480e9f9194a1 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 smithi039 running (4m) 17s ago 4m 42.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 458f7e76c506 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 smithi044 running (4m) 26s ago 4m 43.2M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 147031c00f2e 2024-09-12T01:56:31.090 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 smithi172 running (3m) 26s ago 3m 45.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 1fd6c28fc876 2024-09-12T01:56:31.091 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 smithi039 running (3m) 17s ago 3m 52.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 6191101434c6 2024-09-12T01:56:31.091 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 smithi044 running (2m) 26s ago 2m 45.9M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 0de7f2b3cafa 2024-09-12T01:56:31.091 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 smithi172 running (2m) 26s ago 2m 50.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 8bc3afea6048 2024-09-12T01:56:31.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 msgr2=0x7f30000a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 0x7f30000a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3010009930 tx=0x7f3010008040 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 msgr2=0x7f30141985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f300402aa00 tx=0x7f3004032da0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 shutdown_connections 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3014107900 0x7f301419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3014104fd0 0x7f30141985e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30000a2c40 0x7f30000a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 --2- 172.21.15.39:0/772477345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30141026a0 0x7f30141980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 >> 172.21.15.39:0/772477345 conn(0x7f30140fc2a0 msgr2=0x7f3014103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 shutdown_connections 2024-09-12T01:56:31.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:31.090+0000 7f301bb00640 1 -- 172.21.15.39:0/772477345 wait complete. 2024-09-12T01:56:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:30 smithi039 ceph-mon[31204]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:30 smithi039 ceph-mon[31204]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:30 smithi172 ceph-mon[35073]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:30 smithi172 ceph-mon[35073]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:31.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:30 smithi044 ceph-mon[35259]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:31.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:30 smithi044 ceph-mon[35259]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:31.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T01:56:32.042 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 -- 172.21.15.39:0/885485519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 msgr2=0x7f2a2c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 --2- 172.21.15.39:0/885485519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c100f10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009900 tx=0x7f2a2802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:32.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 -- 172.21.15.39:0/885485519 shutdown_connections 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 --2- 172.21.15.39:0/885485519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2c1026d0 0x7f2a2c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 --2- 172.21.15.39:0/885485519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c101d10 0x7f2a2c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 --2- 172.21.15.39:0/885485519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c100f10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 -- 172.21.15.39:0/885485519 >> 172.21.15.39:0/885485519 conn(0x7f2a2c0fc2a0 msgr2=0x7f2a2c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 -- 172.21.15.39:0/885485519 shutdown_connections 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.549+0000 7f2a33567640 1 -- 172.21.15.39:0/885485519 wait complete. 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 Processor -- start 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 -- start start 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2c101d10 0x7f2a2c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c1026d0 0x7f2a2c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c810 con 0x7f2a2c100b10 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c690 con 0x7f2a2c101d10 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a33567640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c990 con 0x7f2a2c1026d0 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60572/0 (socket says 172.21.15.39:60572) 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 -- 172.21.15.39:0/273645030 learned_addr learned my addr 172.21.15.39:0/273645030 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:32.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31b04640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c1026d0 0x7f2a2c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 -- 172.21.15.39:0/273645030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c1026d0 msgr2=0x7f2a2c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c1026d0 0x7f2a2c19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 -- 172.21.15.39:0/273645030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2c101d10 msgr2=0x7f2a2c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2c101d10 0x7f2a2c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.550+0000 7f2a31303640 1 -- 172.21.15.39:0/273645030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2c19fbe0 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a31303640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a28031610 tx=0x7f2a280043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2803f030 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a28003ce0 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2c19fe70 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28035070 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.551+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c1a0350 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.552+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2c1a0670 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.553+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2a28042030 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.554+0000 7f2a227fc640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 0x7f2a180a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.554+0000 7f2a30b02640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 0x7f2a180a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.554+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2a280ef3e0 con 0x7f2a2c100b10 2024-09-12T01:56:32.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.554+0000 7f2a30b02640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 0x7f2a180a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005fd0 tx=0x7f2a1c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:32.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.558+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a280bc1f0 con 0x7f2a2c100b10 2024-09-12T01:56:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.744+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2a2c06aef0 con 0x7f2a180a2cc0 2024-09-12T01:56:32.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.751+0000 7f2a227fc640 1 -- 172.21.15.39:0/273645030 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2a2c06aef0 con 0x7f2a180a2cc0 2024-09-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi039.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi039.stdout:mds.all 12/12 27s ago 2m smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi039.stdout:mgr 3/3 27s ago 7m smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi039.stdout:mon 3/3 27s ago 8m smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi039.stdout:osd 12 27s ago - 2024-09-12T01:56:32.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 msgr2=0x7f2a180a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 0x7f2a180a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c005fd0 tx=0x7f2a1c005850 comp rx=0 tx=0).stop 2024-09-12T01:56:32.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 msgr2=0x7f2a2c197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:32.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2a28031610 tx=0x7f2a280043b0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 shutdown_connections 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2a180a2cc0 0x7f2a180a5180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c1026d0 0x7f2a2c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2c101d10 0x7f2a2c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 --2- 172.21.15.39:0/273645030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a2c100b10 0x7f2a2c197fb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 >> 172.21.15.39:0/273645030 conn(0x7f2a2c0fc2a0 msgr2=0x7f2a2c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 shutdown_connections 2024-09-12T01:56:32.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:32.753+0000 7f2a33567640 1 -- 172.21.15.39:0/273645030 wait complete. 2024-09-12T01:56:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:32 smithi039 ceph-mon[31204]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:32 smithi039 ceph-mon[31204]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:32 smithi172 ceph-mon[35073]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:32 smithi172 ceph-mon[35073]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:32 smithi044 ceph-mon[35259]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:32 smithi044 ceph-mon[35259]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:33.432 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T01:56:33.700 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:34.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:33 smithi039 ceph-mon[31204]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:34.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 -- 172.21.15.39:0/2018312078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c1026d0 msgr2=0x7f1b4c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/2018312078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c108f60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009ca0 tx=0x7f1b4402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 -- 172.21.15.39:0/2018312078 shutdown_connections 2024-09-12T01:56:34.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/2018312078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c108f60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/2018312078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 0x7f1b4c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/2018312078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c100b10 0x7f1b4c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 -- 172.21.15.39:0/2018312078 >> 172.21.15.39:0/2018312078 conn(0x7f1b4c0fc2a0 msgr2=0x7f1b4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 -- 172.21.15.39:0/2018312078 shutdown_connections 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.192+0000 7f1b53cc3640 1 -- 172.21.15.39:0/2018312078 wait complete. 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 Processor -- start 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 -- start start 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 0x7f1b4c1030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c10c790 con 0x7f1b4c100b10 2024-09-12T01:56:34.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c10c610 con 0x7f1b4c1026d0 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b53cc3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c10c910 con 0x7f1b4c101d10 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b51a5f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b51a5f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60596/0 (socket says 172.21.15.39:60596) 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b51a5f640 1 -- 172.21.15.39:0/1402816220 learned_addr learned my addr 172.21.15.39:0/1402816220 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.193+0000 7f1b52260640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b5125e640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 0x7f1b4c1030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 -- 172.21.15.39:0/1402816220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 msgr2=0x7f1b4c1030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 0x7f1b4c1030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 -- 172.21.15.39:0/1402816220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 msgr2=0x7f1b4c103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 -- 172.21.15.39:0/1402816220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c103ef0 con 0x7f1b4c100b10 2024-09-12T01:56:34.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b52260640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b51a5f640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800d950 tx=0x7f1b4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48017020 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c1a2090 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b48009c30 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800f740 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.194+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c1a25f0 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.195+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c100f10 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.196+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1b4801a020 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.197+0000 7f1b42ffd640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 0x7f1b380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.197+0000 7f1b5125e640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 0x7f1b380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.197+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1b480ceae0 con 0x7f1b4c100b10 2024-09-12T01:56:34.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.197+0000 7f1b5125e640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 0x7f1b380a5040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c005d70 tx=0x7f1b3c005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:34.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.201+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b48021070 con 0x7f1b4c100b10 2024-09-12T01:56:34.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:33 smithi172 ceph-mon[35073]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:34.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.385+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f1b4c1a28e0 con 0x7f1b380a2b80 2024-09-12T01:56:34.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.387+0000 7f1b42ffd640 1 -- 172.21.15.39:0/1402816220 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f1b4c1a28e0 con 0x7f1b380a2b80 2024-09-12T01:56:34.388 INFO:teuthology.orchestra.run.smithi039.stdout:HOST ADDR LABELS STATUS 2024-09-12T01:56:34.388 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 172.21.15.39 2024-09-12T01:56:34.388 INFO:teuthology.orchestra.run.smithi039.stdout:smithi044 172.21.15.44 2024-09-12T01:56:34.388 INFO:teuthology.orchestra.run.smithi039.stdout:smithi172 172.21.15.172 2024-09-12T01:56:34.388 INFO:teuthology.orchestra.run.smithi039.stdout:3 hosts in cluster 2024-09-12T01:56:34.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 msgr2=0x7f1b380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 0x7f1b380a5040 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c005d70 tx=0x7f1b3c005d00 comp rx=0 tx=0).stop 2024-09-12T01:56:34.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 msgr2=0x7f1b4c104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800d950 tx=0x7f1b4800de10 comp rx=0 tx=0).stop 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 shutdown_connections 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b4c1026d0 0x7f1b4c103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b380a2b80 0x7f1b380a5040 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b4c101d10 0x7f1b4c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 --2- 172.21.15.39:0/1402816220 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b4c100b10 0x7f1b4c104aa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.389+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 >> 172.21.15.39:0/1402816220 conn(0x7f1b4c0fc2a0 msgr2=0x7f1b4c0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.390+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 shutdown_connections 2024-09-12T01:56:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:34.390+0000 7f1b53cc3640 1 -- 172.21.15.39:0/1402816220 wait complete. 2024-09-12T01:56:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:33 smithi044 ceph-mon[35259]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:35.156 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:34 smithi039 ceph-mon[31204]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:35.156 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:34 smithi039 ceph-mon[31204]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:56:35.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T01:56:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:34 smithi172 ceph-mon[35073]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:34 smithi172 ceph-mon[35073]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:56:35.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:34 smithi044 ceph-mon[35259]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:35.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:34 smithi044 ceph-mon[35259]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:56:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 -- 172.21.15.39:0/3612067259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794101c00 msgr2=0x7fd794102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 --2- 172.21.15.39:0/3612067259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794101c00 0x7fd794102000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd788009900 tx=0x7fd78802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 -- 172.21.15.39:0/3612067259 shutdown_connections 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 --2- 172.21.15.39:0/3612067259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7941037c0 0x7fd79410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 --2- 172.21.15.39:0/3612067259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd794102e00 0x7fd794103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 --2- 172.21.15.39:0/3612067259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794101c00 0x7fd794102000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 -- 172.21.15.39:0/3612067259 >> 172.21.15.39:0/3612067259 conn(0x7fd7940fd390 msgr2=0x7fd7940ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 -- 172.21.15.39:0/3612067259 shutdown_connections 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.941+0000 7fd79c745640 1 -- 172.21.15.39:0/3612067259 wait complete. 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.942+0000 7fd79c745640 1 Processor -- start 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.942+0000 7fd79c745640 1 -- start start 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.942+0000 7fd79c745640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd794101c00 0x7fd794197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.942+0000 7fd79c745640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.942+0000 7fd79c745640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7941037c0 0x7fd79419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79c745640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd79410d8e0 con 0x7fd794102e00 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79c745640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd79410d760 con 0x7fd794101c00 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79c745640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd79410da60 con 0x7fd7941037c0 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60604/0 (socket says 172.21.15.39:60604) 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 -- 172.21.15.39:0/3635143716 learned_addr learned my addr 172.21.15.39:0/3635143716 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79a4e1640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd794101c00 0x7fd794197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79ace2640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7941037c0 0x7fd79419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 -- 172.21.15.39:0/3635143716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7941037c0 msgr2=0x7fd79419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7941037c0 0x7fd79419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 -- 172.21.15.39:0/3635143716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd794101c00 msgr2=0x7fd794197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd794101c00 0x7fd794197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:35.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 -- 172.21.15.39:0/3635143716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79419fb60 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd799ce0640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd79000b4a0 tx=0x7fd79000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790014070 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd790010af0 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79419fe50 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790017d10 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.943+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7941a0380 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.944+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd794108fb0 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.946+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd790017070 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.946+0000 7fd7877fe640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 0x7fd7800a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.946+0000 7fd79a4e1640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 0x7fd7800a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.946+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7900ce2d0 con 0x7fd794102e00 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.947+0000 7fd79a4e1640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 0x7fd7800a5070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd788005ab0 tx=0x7fd788000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:35.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:35.951+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd79009abf0 con 0x7fd794102e00 2024-09-12T01:56:36.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.132+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd794062630 con 0x7fd7800a2bb0 2024-09-12T01:56:36.133 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:35 smithi039 ceph-mon[31204]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:36.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.135+0000 7fd7877fe640 1 -- 172.21.15.39:0/3635143716 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd794062630 con 0x7fd7800a2bb0 2024-09-12T01:56:36.136 INFO:teuthology.orchestra.run.smithi039.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T01:56:36.136 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:56:36.136 INFO:teuthology.orchestra.run.smithi039.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:56:36.136 INFO:teuthology.orchestra.run.smithi039.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 msgr2=0x7fd7800a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 0x7fd7800a5070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd788005ab0 tx=0x7fd788000bc0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 msgr2=0x7fd794198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd79000b4a0 tx=0x7fd79000b960 comp rx=0 tx=0).stop 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 shutdown_connections 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7800a2bb0 0x7fd7800a5070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7941037c0 0x7fd79419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd794102e00 0x7fd794198470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 --2- 172.21.15.39:0/3635143716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd794101c00 0x7fd794197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.137+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 >> 172.21.15.39:0/3635143716 conn(0x7fd7940fd390 msgr2=0x7fd794106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.138+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 shutdown_connections 2024-09-12T01:56:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:36.138+0000 7fd79c745640 1 -- 172.21.15.39:0/3635143716 wait complete. 2024-09-12T01:56:36.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:35 smithi172 ceph-mon[35073]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:36.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:35 smithi044 ceph-mon[35259]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:36.911 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:56:36.923 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T01:56:36.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:56:37.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:36 smithi039 ceph-mon[31204]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:36 smithi172 ceph-mon[35073]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:37.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:36 smithi044 ceph-mon[35259]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 -- 172.21.15.39:0/1589185438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c101c00 msgr2=0x7eff5c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 --2- 172.21.15.39:0/1589185438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c101c00 0x7eff5c102000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7eff50009900 tx=0x7eff5002a410 comp rx=0 tx=0).stop 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 -- 172.21.15.39:0/1589185438 shutdown_connections 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 --2- 172.21.15.39:0/1589185438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c1037c0 0x7eff5c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 --2- 172.21.15.39:0/1589185438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c102e00 0x7eff5c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 --2- 172.21.15.39:0/1589185438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c101c00 0x7eff5c102000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 -- 172.21.15.39:0/1589185438 >> 172.21.15.39:0/1589185438 conn(0x7eff5c0fd390 msgr2=0x7eff5c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 -- 172.21.15.39:0/1589185438 shutdown_connections 2024-09-12T01:56:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.661+0000 7eff6318a640 1 -- 172.21.15.39:0/1589185438 wait complete. 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 Processor -- start 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 -- start start 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 0x7eff5c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c1037c0 0x7eff5c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c10d8d0 con 0x7eff5c102e00 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c10d750 con 0x7eff5c101c00 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff6318a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c10da50 con 0x7eff5c1037c0 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff5bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff5bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60618/0 (socket says 172.21.15.39:60618) 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff5bfff640 1 -- 172.21.15.39:0/2854371897 learned_addr learned my addr 172.21.15.39:0/2854371897 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.662+0000 7eff60f26640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 0x7eff5c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff61727640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c1037c0 0x7eff5c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 -- 172.21.15.39:0/2854371897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c1037c0 msgr2=0x7eff5c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c1037c0 0x7eff5c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 -- 172.21.15.39:0/2854371897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 msgr2=0x7eff5c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 0x7eff5c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 -- 172.21.15.39:0/2854371897 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c19fb70 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff60f26640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 0x7eff5c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff5bfff640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c970 tx=0x7eff4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48007bb0 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff48007d50 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c19fe60 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4800f450 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.663+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c1a0310 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.664+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c109000 con 0x7eff5c102e00 2024-09-12T01:56:37.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.665+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7eff48004fe0 con 0x7eff5c102e00 2024-09-12T01:56:37.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.666+0000 7eff59ffb640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 0x7eff4c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:37.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.666+0000 7eff60f26640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 0x7eff4c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:37.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.666+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7eff480cee00 con 0x7eff5c102e00 2024-09-12T01:56:37.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.666+0000 7eff60f26640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 0x7eff4c0a50f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff5002aa00 tx=0x7eff50031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:37.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.670+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff48014030 con 0x7eff5c102e00 2024-09-12T01:56:37.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.881+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7eff5c02d7c0 con 0x7eff5c102e00 2024-09-12T01:56:37.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.881+0000 7eff59ffb640 1 -- 172.21.15.39:0/2854371897 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3084 (secure 0 0 0) 0x7eff4809bd70 con 0x7eff5c102e00 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:e24 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:btime 2024-09-12T01:55:19:669762+0000 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:legacy client fscid: 1 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:fs_name cephfs 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 24 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-12T01:55:08.326488+0000 2024-09-12T01:56:37.883 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-12T01:55:19.410760+0000 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:tableserver 0 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:root 0 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:session_timeout 300 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:session_autoclose 300 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:max_file_size 1099511627776 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:max_xattr_size 65536 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:required_client_features {} 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure 0 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure_osd_epoch 0 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:56:37.884 INFO:teuthology.orchestra.run.smithi039.stdout:max_mds 3 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:in 0,1,2 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:up {0=24503,1=24467,2=24463} 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:failed 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:damaged 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:stopped 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:data_pools [3] 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:metadata_pool 2 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:inline_data disabled 2024-09-12T01:56:37.885 INFO:teuthology.orchestra.run.smithi039.stdout:balancer 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:bal_rank_mask -1 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:standby_count_wanted 0 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:qdb_cluster leader: 24503 members: 24463,24467,24503 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b{0:24503} state up:active seq 4 addr [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c{0:24448} state up:standby-replay seq 1 addr [v2:172.21.15.172:6836/2267029874,v1:172.21.15.172:6837/2267029874] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.h{1:24467} state up:active seq 9 addr [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.e{1:24443} state up:standby-replay seq 1 addr [v2:172.21.15.44:6834/4061596538,v1:172.21.15.44:6835/4061596538] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.i{2:24463} state up:active seq 9 addr [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.f{2:24442} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/1679490719,v1:172.21.15.172:6835/1679490719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout:Standby daemons: 2024-09-12T01:56:37.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.39:6834/371087519,v1:172.21.15.39:6835/371087519] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.39:6836/1615113005,v1:172.21.15.39:6837/1615113005] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.g{-1:14616} state up:standby seq 1 addr [v2:172.21.15.39:6838/3465657492,v1:172.21.15.39:6839/3465657492] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a{-1:14628} state up:standby seq 1 addr [v2:172.21.15.39:6840/1943939637,v1:172.21.15.39:6841/1943939637] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.l{-1:24406} state up:standby seq 1 addr [v2:172.21.15.172:6832/1133915680,v1:172.21.15.172:6833/1133915680] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.887 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.k{-1:24425} state up:standby seq 1 addr [v2:172.21.15.44:6832/2844392088,v1:172.21.15.44:6833/2844392088] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.883+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 msgr2=0x7eff4c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.883+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 0x7eff4c0a50f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff5002aa00 tx=0x7eff50031400 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 msgr2=0x7eff5c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c970 tx=0x7eff4800ce30 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 shutdown_connections 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff4c0a2c30 0x7eff4c0a50f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c1037c0 0x7eff5c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff5c102e00 0x7eff5c198480 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 --2- 172.21.15.39:0/2854371897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff5c101c00 0x7eff5c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 >> 172.21.15.39:0/2854371897 conn(0x7eff5c0fd390 msgr2=0x7eff5c1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:37.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 shutdown_connections 2024-09-12T01:56:37.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:37.884+0000 7eff6318a640 1 -- 172.21.15.39:0/2854371897 wait complete. 2024-09-12T01:56:38.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:37 smithi039 ceph-mon[31204]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:38.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:37 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2854371897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:56:38.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:37 smithi172 ceph-mon[35073]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:38.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:37 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2854371897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:56:38.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:37 smithi044 ceph-mon[35259]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:56:38.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:37 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2854371897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:56:38.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T01:56:38.951 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:39.230 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:38 smithi039 ceph-mon[31204]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:38 smithi172 ceph-mon[35073]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:39.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:38 smithi044 ceph-mon[35259]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 -- 172.21.15.39:0/2192997766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 msgr2=0x7eff3c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 --2- 172.21.15.39:0/2192997766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c103280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7eff24009900 tx=0x7eff2402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 -- 172.21.15.39:0/2192997766 shutdown_connections 2024-09-12T01:56:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 --2- 172.21.15.39:0/2192997766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c1037c0 0x7eff3c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 --2- 172.21.15.39:0/2192997766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c103280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 --2- 172.21.15.39:0/2192997766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c101c00 0x7eff3c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 -- 172.21.15.39:0/2192997766 >> 172.21.15.39:0/2192997766 conn(0x7eff3c0fd390 msgr2=0x7eff3c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 -- 172.21.15.39:0/2192997766 shutdown_connections 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.460+0000 7eff41aec640 1 -- 172.21.15.39:0/2192997766 wait complete. 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 Processor -- start 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 -- start start 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c101c00 0x7eff3c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c1037c0 0x7eff3c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c10d880 con 0x7eff3c102e00 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c10d700 con 0x7eff3c101c00 2024-09-12T01:56:39.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff41aec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c10da00 con 0x7eff3c1037c0 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.461+0000 7eff3affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60636/0 (socket says 172.21.15.39:60636) 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 -- 172.21.15.39:0/4236864075 learned_addr learned my addr 172.21.15.39:0/4236864075 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3b7fe640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c101c00 0x7eff3c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3bfff640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c1037c0 0x7eff3c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 -- 172.21.15.39:0/4236864075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c1037c0 msgr2=0x7eff3c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c1037c0 0x7eff3c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 -- 172.21.15.39:0/4236864075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c101c00 msgr2=0x7eff3c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c101c00 0x7eff3c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 -- 172.21.15.39:0/4236864075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c19fb60 con 0x7eff3c102e00 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff3affd640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff24004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2403f030 con 0x7eff3c102e00 2024-09-12T01:56:39.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff24003ce0 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c19fdf0 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24035070 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.462+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c1a0270 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.463+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3c109050 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.465+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7eff24042030 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.465+0000 7eff38ff9640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 0x7eff280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.466+0000 7eff3b7fe640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 0x7eff280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.466+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7eff240ef930 con 0x7eff3c102e00 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.466+0000 7eff3b7fe640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 0x7eff280a5070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff3c102c60 tx=0x7eff2c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:39.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.469+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff240bc250 con 0x7eff3c102e00 2024-09-12T01:56:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.647+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7eff3c062e90 con 0x7eff3c102e00 2024-09-12T01:56:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.648+0000 7eff38ff9640 1 -- 172.21.15.39:0/4236864075 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5270 (secure 0 0 0) 0x7eff240c0550 con 0x7eff3c102e00 2024-09-12T01:56:39.649 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 82 2024-09-12T01:56:39.649 INFO:teuthology.orchestra.run.smithi039.stdout:fsid d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T01:56:39.649 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-12T01:47:06.648036+0000 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-12T01:56:04.883161+0000 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:crush_version 26 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:full_ratio 0.95 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:backfillfull_ratio 0.9 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:nearfull_ratio 0.85 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:require_min_compat_client luminous 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:min_compat_client luminous 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:require_osd_release squid 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:stretch_mode_enabled false 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T01:56:39.650 INFO:teuthology.orchestra.run.smithi039.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:max_osd 12 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6802/2221897702,v1:172.21.15.39:6803/2221897702] [v2:172.21.15.39:6804/2221897702,v1:172.21.15.39:6805/2221897702] exists,up 3d18ca71-ba65-4f79-b839-a26243a98b0d 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/2339719980,v1:172.21.15.44:6801/2339719980] [v2:172.21.15.44:6802/2339719980,v1:172.21.15.44:6803/2339719980] exists,up 14cf552e-8b4c-4d78-af25-1e5e24854694 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3618957048,v1:172.21.15.172:6801/3618957048] [v2:172.21.15.172:6802/3618957048,v1:172.21.15.172:6803/3618957048] exists,up 357cc6a5-5b47-4c23-8e6b-0d75cdbda81c 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 up in weight 1 up_from 23 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6810/3975673341,v1:172.21.15.39:6811/3975673341] [v2:172.21.15.39:6812/3975673341,v1:172.21.15.39:6813/3975673341] exists,up 4e0ee5c8-c842-4b5b-b4c4-42693348b505 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 up in weight 1 up_from 30 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/1948738957,v1:172.21.15.44:6809/1948738957] [v2:172.21.15.44:6810/1948738957,v1:172.21.15.44:6811/1948738957] exists,up a4f59844-9cd8-46ff-a56c-d9a5558939c5 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 up in weight 1 up_from 34 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/104325530,v1:172.21.15.172:6809/104325530] [v2:172.21.15.172:6810/104325530,v1:172.21.15.172:6811/104325530] exists,up d6acde19-c23f-487a-97a0-63622abd31c4 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 up in weight 1 up_from 41 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6818/3666498594,v1:172.21.15.39:6819/3666498594] [v2:172.21.15.39:6820/3666498594,v1:172.21.15.39:6821/3666498594] exists,up a2fc9230-8812-41b0-a3f4-6a5723e0a68f 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 up in weight 1 up_from 46 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6816/849440422,v1:172.21.15.44:6817/849440422] [v2:172.21.15.44:6818/849440422,v1:172.21.15.44:6819/849440422] exists,up d7e20a32-eae3-49a7-9c4e-e3d581b5aef6 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 up in weight 1 up_from 54 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/586436553,v1:172.21.15.172:6817/586436553] [v2:172.21.15.172:6818/586436553,v1:172.21.15.172:6819/586436553] exists,up a9110f1b-fd90-436e-a1c3-234f94c1bffb 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6826/3100759551,v1:172.21.15.39:6827/3100759551] [v2:172.21.15.39:6828/3100759551,v1:172.21.15.39:6829/3100759551] exists,up f2b585a6-7a63-46fa-a8cc-7da114411b5e 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/2721109342,v1:172.21.15.44:6825/2721109342] [v2:172.21.15.44:6826/2721109342,v1:172.21.15.44:6827/2721109342] exists,up 6bf3e359-92ab-4cea-8324-7be533216576 2024-09-12T01:56:39.651 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/4178516458,v1:172.21.15.172:6825/4178516458] [v2:172.21.15.172:6826/4178516458,v1:172.21.15.172:6827/4178516458] exists,up 4246243b-00ad-474b-9b8f-5dca402c7de2 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.5 [8,11] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.a [2,11] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.10 [2,1] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.1a [8,4] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.17 [4,8] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.34 [4,9] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.36 [4,9] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.38 [3,9] 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2335103066 expires 2024-09-13T01:48:03.155570+0000 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/3802572076 expires 2024-09-13T01:48:03.155570+0000 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/3476444139 expires 2024-09-13T01:47:38.554416+0000 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/3476444139 expires 2024-09-13T01:47:38.554416+0000 2024-09-12T01:56:39.652 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/3619036511 expires 2024-09-13T01:48:03.155570+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/3026209487 expires 2024-09-13T01:47:38.554416+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/4201782244 expires 2024-09-13T01:48:03.155570+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/3215796392 expires 2024-09-13T01:47:38.554416+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/4201782244 expires 2024-09-13T01:48:03.155570+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2035365900 expires 2024-09-13T01:47:38.554416+0000 2024-09-12T01:56:39.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 msgr2=0x7eff280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 0x7eff280a5070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff3c102c60 tx=0x7eff2c009680 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 msgr2=0x7eff3c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7eff24009230 tx=0x7eff24004360 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 shutdown_connections 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7eff280a2bb0 0x7eff280a5070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff3c1037c0 0x7eff3c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7eff3c102e00 0x7eff3c198470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 --2- 172.21.15.39:0/4236864075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff3c101c00 0x7eff3c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 >> 172.21.15.39:0/4236864075 conn(0x7eff3c0fd390 msgr2=0x7eff3c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 shutdown_connections 2024-09-12T01:56:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:39.651+0000 7eff41aec640 1 -- 172.21.15.39:0/4236864075 wait complete. 2024-09-12T01:56:40.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:39 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4236864075' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:56:40.325 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:39 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4236864075' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:56:40.354 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T01:56:40.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:40.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:39 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4236864075' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:56:40.627 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:41.013 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:40 smithi039 ceph-mon[31204]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 -- 172.21.15.39:0/2087864801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 msgr2=0x7feccc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 --2- 172.21.15.39:0/2087864801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1021c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009900 tx=0x7fecc802a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 -- 172.21.15.39:0/2087864801 shutdown_connections 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 --2- 172.21.15.39:0/2087864801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc106f10 0x7feccc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 --2- 172.21.15.39:0/2087864801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc102790 0x7feccc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 --2- 172.21.15.39:0/2087864801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1021c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 -- 172.21.15.39:0/2087864801 >> 172.21.15.39:0/2087864801 conn(0x7feccc0fd8c0 msgr2=0x7feccc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 -- 172.21.15.39:0/2087864801 shutdown_connections 2024-09-12T01:56:41.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.094+0000 7fecd4125640 1 -- 172.21.15.39:0/2087864801 wait complete. 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 Processor -- start 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 -- start start 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 0x7feccc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 0x7feccc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feccc111f70 con 0x7feccc101de0 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feccc111df0 con 0x7feccc102790 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd4125640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1120f0 con 0x7feccc106f10 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd1ec1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd1ec1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60660/0 (socket says 172.21.15.39:60660) 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd1ec1640 1 -- 172.21.15.39:0/3846585760 learned_addr learned my addr 172.21.15.39:0/3846585760 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd16c0640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 0x7feccc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.095+0000 7fecd26c2640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 0x7feccc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 -- 172.21.15.39:0/3846585760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 msgr2=0x7feccc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 0x7feccc19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 -- 172.21.15.39:0/3846585760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 msgr2=0x7feccc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 0x7feccc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 -- 172.21.15.39:0/3846585760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc19d380 con 0x7feccc101de0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd26c2640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 0x7feccc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd16c0640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 0x7feccc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd1ec1640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecc8006010 tx=0x7fecc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc803f030 con 0x7feccc101de0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc19d610 con 0x7feccc101de0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc8003ce0 con 0x7feccc101de0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8035070 con 0x7feccc101de0 2024-09-12T01:56:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.096+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a4f50 con 0x7feccc101de0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.097+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc1021c0 con 0x7feccc101de0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.098+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fecc8042030 con 0x7feccc101de0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.099+0000 7fecbeffd640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 0x7fecb80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.099+0000 7fecd16c0640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 0x7fecb80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.100+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fecc80ef880 con 0x7feccc101de0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.100+0000 7fecd16c0640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 0x7fecb80a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fecc00058c0 tx=0x7fecc0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:41.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.103+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fecc80bc850 con 0x7feccc101de0 2024-09-12T01:56:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:40 smithi172 ceph-mon[35073]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:41.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.315+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feccc10a0f0 con 0x7feccc101de0 2024-09-12T01:56:41.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.315+0000 7fecbeffd640 1 -- 172.21.15.39:0/3846585760 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7fecc80bc150 con 0x7feccc101de0 2024-09-12T01:56:41.316 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:41.316 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:56:41.317 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 msgr2=0x7fecb80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 0x7fecb80a5040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fecc00058c0 tx=0x7fecc0005850 comp rx=0 tx=0).stop 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 msgr2=0x7feccc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecc8006010 tx=0x7fecc80042f0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 shutdown_connections 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fecb80a2b80 0x7fecb80a5040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feccc106f10 0x7feccc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feccc102790 0x7feccc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 --2- 172.21.15.39:0/3846585760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feccc101de0 0x7feccc1983d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:41.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 >> 172.21.15.39:0/3846585760 conn(0x7feccc0fd8c0 msgr2=0x7feccc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:41.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 shutdown_connections 2024-09-12T01:56:41.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:41.318+0000 7fecd4125640 1 -- 172.21.15.39:0/3846585760 wait complete. 2024-09-12T01:56:41.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:40 smithi044 ceph-mon[35259]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:41.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:42.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:41 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3846585760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:42.229 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:42.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:41 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3846585760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:42.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:41 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3846585760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:42.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 -- 172.21.15.39:0/498052728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98101de0 msgr2=0x7fbd981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/498052728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98101de0 0x7fbd981021c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009900 tx=0x7fbd8802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:42.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 -- 172.21.15.39:0/498052728 shutdown_connections 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/498052728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/498052728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98102790 0x7fbd981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/498052728 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98101de0 0x7fbd981021c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 -- 172.21.15.39:0/498052728 >> 172.21.15.39:0/498052728 conn(0x7fbd980fd8c0 msgr2=0x7fbd980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 -- 172.21.15.39:0/498052728 shutdown_connections 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 -- 172.21.15.39:0/498052728 wait complete. 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.712+0000 7fbd9dcda640 1 Processor -- start 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 -- start start 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 0x7fbd981984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98111f90 con 0x7fbd98102790 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98111e10 con 0x7fbd98101de0 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd9dcda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98112110 con 0x7fbd98106f10 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44508/0 (socket says 172.21.15.39:44508) 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 -- 172.21.15.39:0/1072334377 learned_addr learned my addr 172.21.15.39:0/1072334377 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd97fff640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd977fe640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 0x7fbd981984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 -- 172.21.15.39:0/1072334377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 msgr2=0x7fbd9819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 -- 172.21.15.39:0/1072334377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 msgr2=0x7fbd981984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 0x7fbd981984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd96ffd640 1 -- 172.21.15.39:0/1072334377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9819d480 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd97fff640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.713+0000 7fbd977fe640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 0x7fbd981984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd96ffd640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000b4a0 tx=0x7fbd8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80014070 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd80010af0 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9819d770 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80017d10 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.714+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981a5050 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.715+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd981021c0 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.716+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbd80017070 con 0x7fbd98102790 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.717+0000 7fbd94ff9640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 0x7fbd840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:42.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.717+0000 7fbd977fe640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 0x7fbd840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:42.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.717+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbd800ce4b0 con 0x7fbd98102790 2024-09-12T01:56:42.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.717+0000 7fbd977fe640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 0x7fbd840a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbd88000c00 tx=0x7fbd88032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:42.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.721+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd8009b420 con 0x7fbd98102790 2024-09-12T01:56:42.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.932+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd9802d7c0 con 0x7fbd98102790 2024-09-12T01:56:42.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.933+0000 7fbd94ff9640 1 -- 172.21.15.39:0/1072334377 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11908 (secure 0 0 0) 0x7fbd8009ad20 con 0x7fbd98102790 2024-09-12T01:56:42.934 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:42.934 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"btime":"2024-09-12T01:55:19:669762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:55:19.410760+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:56:42.935 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-09-12T01:56:42.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 msgr2=0x7fbd840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 0x7fbd840a5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbd88000c00 tx=0x7fbd88032c70 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 msgr2=0x7fbd98198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000b4a0 tx=0x7fbd8000b960 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 shutdown_connections 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbd840a2b80 0x7fbd840a5040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd98106f10 0x7fbd9819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98102790 0x7fbd98198a10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 --2- 172.21.15.39:0/1072334377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd98101de0 0x7fbd981984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 >> 172.21.15.39:0/1072334377 conn(0x7fbd980fd8c0 msgr2=0x7fbd980fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 shutdown_connections 2024-09-12T01:56:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:42.935+0000 7fbd9dcda640 1 -- 172.21.15.39:0/1072334377 wait complete. 2024-09-12T01:56:43.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:42 smithi039 ceph-mon[31204]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:43.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:42 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1072334377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:42 smithi172 ceph-mon[35073]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:42 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1072334377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:43.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:42 smithi044 ceph-mon[35259]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:43.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:42 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1072334377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:43.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:56:43.815 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 -- 172.21.15.39:0/1826617755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4102790 msgr2=0x7f9af41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 --2- 172.21.15.39:0/1826617755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4102790 0x7f9af41067e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009900 tx=0x7f9ae402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 -- 172.21.15.39:0/1826617755 shutdown_connections 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 --2- 172.21.15.39:0/1826617755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4106f10 0x7f9af410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 --2- 172.21.15.39:0/1826617755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4102790 0x7f9af41067e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 --2- 172.21.15.39:0/1826617755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4101de0 0x7f9af41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 -- 172.21.15.39:0/1826617755 >> 172.21.15.39:0/1826617755 conn(0x7f9af40fd8c0 msgr2=0x7f9af40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 -- 172.21.15.39:0/1826617755 shutdown_connections 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.312+0000 7f9afc04b640 1 -- 172.21.15.39:0/1826617755 wait complete. 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 Processor -- start 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 -- start start 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4101de0 0x7f9af4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4102790 0x7f9af4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4111f90 con 0x7f9af4106f10 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4111e10 con 0x7f9af4102790 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afc04b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4112110 con 0x7f9af4101de0 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44526/0 (socket says 172.21.15.39:44526) 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 -- 172.21.15.39:0/4256924031 learned_addr learned my addr 172.21.15.39:0/4256924031 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9af9de7640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4101de0 0x7f9af4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9af95e6640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4102790 0x7f9af4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 -- 172.21.15.39:0/4256924031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4101de0 msgr2=0x7f9af4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4101de0 0x7f9af4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 -- 172.21.15.39:0/4256924031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4102790 msgr2=0x7f9af4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4102790 0x7f9af4198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.313+0000 7f9afa5e8640 1 -- 172.21.15.39:0/4256924031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af419d520 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9afa5e8640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b970 tx=0x7f9aec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec019070 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af419d810 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aec00cb40 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec007650 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.314+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af41a50f0 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.315+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af41021c0 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.316+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9aec01c070 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.317+0000 7f9aeaffd640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.317+0000 7f9af9de7640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.317+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9aec0ce6d0 con 0x7f9af4106f10 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.317+0000 7f9af9de7640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 0x7f9ae00a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005fd0 tx=0x7f9af0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:44.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.321+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9aec09b640 con 0x7f9af4106f10 2024-09-12T01:56:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.499+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9af410a150 con 0x7f9af4106f10 2024-09-12T01:56:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.501+0000 7f9aeaffd640 1 -- 172.21.15.39:0/4256924031 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22679 (secure 0 0 0) 0x7f9aec09af40 con 0x7f9af4106f10 2024-09-12T01:56:44.502 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":82,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:56:04.883161+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 msgr2=0x7f9ae00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 0x7f9ae00a5040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005fd0 tx=0x7f9af0005850 comp rx=0 tx=0).stop 2024-09-12T01:56:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 msgr2=0x7f9af419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00b970 tx=0x7f9aec00be30 comp rx=0 tx=0).stop 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 shutdown_connections 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af4106f10 0x7f9af419ce40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af4102790 0x7f9af4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9ae00a2b80 0x7f9ae00a5040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 --2- 172.21.15.39:0/4256924031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af4101de0 0x7f9af4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 >> 172.21.15.39:0/4256924031 conn(0x7f9af40fd8c0 msgr2=0x7f9af40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 shutdown_connections 2024-09-12T01:56:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:44.503+0000 7f9afc04b640 1 -- 172.21.15.39:0/4256924031 wait complete. 2024-09-12T01:56:45.128 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:44 smithi039 ceph-mon[31204]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:45.128 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:44 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4256924031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:45.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:55:08.326488+0000', 'modified': '2024-09-12T01:55:19.410760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24503, 'mds_1': 24467, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1679490719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1679490719}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1679490719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/4061596538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4061596538}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 4061596538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/2267029874', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2267029874}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2267029874}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/3543698961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3543698961}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3543698961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/3549353612', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 3549353612}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 3549353612}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/321221291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 321221291}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 321221291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24503, 'qdb_cluster': [24463, 24467, 24503]} 2024-09-12T01:56:45.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T01:56:45.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:56:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:44 smithi172 ceph-mon[35073]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:44 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4256924031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:45.422 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:45.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:44 smithi044 ceph-mon[35259]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:56:45.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:44 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4256924031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:45.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.906+0000 7fdee4d73640 1 -- 172.21.15.39:0/1263491495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 msgr2=0x7fdee0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.906+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1263491495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0101200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fded8009900 tx=0x7fded802a480 comp rx=0 tx=0).stop 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 -- 172.21.15.39:0/1263491495 shutdown_connections 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1263491495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102ef0 0x7fdee010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1263491495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102570 0x7fdee01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1263491495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0101200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 -- 172.21.15.39:0/1263491495 >> 172.21.15.39:0/1263491495 conn(0x7fdee00fc7d0 msgr2=0x7fdee00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 -- 172.21.15.39:0/1263491495 shutdown_connections 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.907+0000 7fdee4d73640 1 -- 172.21.15.39:0/1263491495 wait complete. 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 Processor -- start 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 -- start start 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 0x7fdee0198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102ef0 0x7fdee019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0111020 con 0x7fdee0100e20 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0110ea0 con 0x7fdee0102ef0 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdee4d73640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdee01111a0 con 0x7fdee0102570 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44538/0 (socket says 172.21.15.39:44538) 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 -- 172.21.15.39:0/1474505030 learned_addr learned my addr 172.21.15.39:0/1474505030 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdeded9d640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102ef0 0x7fdee019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 0x7fdee0198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 -- 172.21.15.39:0/1474505030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 msgr2=0x7fdee0198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 0x7fdee0198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 -- 172.21.15.39:0/1474505030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102ef0 msgr2=0x7fdee019cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102ef0 0x7fdee019cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 -- 172.21.15.39:0/1474505030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee019d6c0 con 0x7fdee0100e20 2024-09-12T01:56:45.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 0x7fdee0198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.908+0000 7fdede59c640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fded8006010 tx=0x7fded8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.909+0000 7fded77fe640 1 -- 172.21.15.39:0/1474505030 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded803f070 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.909+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee019d950 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.909+0000 7fded77fe640 1 -- 172.21.15.39:0/1474505030 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fded8031e30 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.909+0000 7fded77fe640 1 -- 172.21.15.39:0/1474505030 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8035030 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.909+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01a5290 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.911+0000 7fded77fe640 1 -- 172.21.15.39:0/1474505030 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fded8042070 con 0x7fdee0100e20 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.911+0000 7fdee714c740 1 Processor -- start 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 -- start start 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd89bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eddd802090 con 0x55eddd89c2f0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eddd7a9a70 con 0x55eddd89b9d0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdee714c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eddd7fe050 con 0x55eddd8a6bb0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fded77fe640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 0x7fdecc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44550/0 (socket says 172.21.15.39:44550) 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdede59c640 1 -- 172.21.15.39:0/632309155 learned_addr learned my addr 172.21.15.39:0/632309155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdeded9d640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 0x7fdecc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdeded9d640 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd89bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fded77fe640 1 -- 172.21.15.39:0/1474505030 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fded80efa30 con 0x7fdee0100e20 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.912+0000 7fdede59c640 1 -- 172.21.15.39:0/632309155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 msgr2=0x55eddd8a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdede59c640 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdede59c640 1 -- 172.21.15.39:0/632309155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 msgr2=0x55eddd89bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdede59c640 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd89bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdede59c640 1 -- 172.21.15.39:0/632309155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eddd7b6130 con 0x55eddd89c2f0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdeded9d640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 0x7fdecc0a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fd0 tx=0x7fded0009d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fdede59c640 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fded80ed480 tx=0x7fded80a6e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91e5d75ac9d8340 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fded4ff9640 1 -- 172.21.15.39:0/632309155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded80bbc00 con 0x55eddd89c2f0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fded4ff9640 1 -- 172.21.15.39:0/632309155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fded80bc9a0 con 0x55eddd89c2f0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.913+0000 7fded4ff9640 1 -- 172.21.15.39:0/632309155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded803b5f0 con 0x55eddd89c2f0 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- 172.21.15.39:0/632309155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 msgr2=0x55eddd8a6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fded80ed480 tx=0x7fded80a6e20 comp rx=0 tx=0).stop 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- 172.21.15.39:0/632309155 shutdown_connections 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89c2f0 0x55eddd8a6670 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- 172.21.15.39:0/632309155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd89bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- 172.21.15.39:0/632309155 >> 172.21.15.39:0/632309155 conn(0x55eddd897f60 msgr2=0x55eddd898340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- 172.21.15.39:0/632309155 shutdown_connections 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- 172.21.15.39:0/632309155 wait complete. 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 -- start start 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 Processor -- start 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd8a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.914+0000 7fdee714c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8a9540 con 0x55eddd8a6bb0 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eddd7bcf20 con 0x55eddd89b9d0 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8a96c0 con 0x55eddd89c2f0 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 10 client.0 _ll_register_callbacks cb 0x55eddd786030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:45.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44552/0 (socket says 172.21.15.39:44552) 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 -- 172.21.15.39:0/2174579731 learned_addr learned my addr 172.21.15.39:0/2174579731 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdede59c640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd8a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 -- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 msgr2=0x55eddd8a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 -- 172.21.15.39:0/2174579731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 msgr2=0x55eddd8a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd8a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 -- 172.21.15.39:0/2174579731 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eddd5732b0 con 0x55eddd8a6bb0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdeded9d640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fded0016f80 tx=0x7fded00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5c01b5b37a03e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdec5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded001f040 con 0x55eddd8a6bb0 2024-09-12T01:56:45.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fded0023420 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded80bc9a0 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fded0013040 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.915+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eddd8b4d40 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fded80bc9a0 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fded002c5c0 con 0x55eddd8a6bb0 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 20 client.15096 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd8b7440 0x55eddd8b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 4 client.15096 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eddd80f600 con 0x55eddd8b7440 2024-09-12T01:56:45.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.916+0000 7fdede59c640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd8b7440 0x55eddd8b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.917+0000 7fdede59c640 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd8b7440 0x55eddd8b88b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe3bc24d91b7eb77 server_cookie=4764ed8248b77d68 in_seq=0 out_seq=0 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.917+0000 7fdec5ffb640 10 client.15096 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.917+0000 7fdec5ffb640 1 -- 172.21.15.39:0/2174579731 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eddd80f600 con 0x55eddd8b7440 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.917+0000 7fdec5ffb640 10 client.15096 handle_command_reply: tid=0 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.917+0000 7fdee714c740 1 client.15096 shutdown 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 msgr2=0x55eddd8a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fded0016f80 tx=0x7fded00093d0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 shutdown_connections 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd8b7440 0x55eddd8b88b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd8a6bb0 0x55eddd8a3cd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 --2- 172.21.15.39:0/2174579731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89b9d0 0x55eddd8a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 >> 172.21.15.39:0/2174579731 conn(0x55eddd897f60 msgr2=0x55eddd89dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdec5ffb640 0 client.15096 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:45.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 shutdown_connections 2024-09-12T01:56:45.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 1 -- 172.21.15.39:0/2174579731 wait complete. 2024-09-12T01:56:45.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.918+0000 7fdee714c740 20 client.15096 trim_cache size 0 max 16384 2024-09-12T01:56:45.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 Processor -- start 2024-09-12T01:56:45.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 -- start start 2024-09-12T01:56:45.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd8a6bb0 0x55eddd8b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b6bf0 con 0x55eddd89b9d0 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b72c0 con 0x55eddd8a6bb0 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdee714c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b7990 con 0x55eddd89c2f0 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44556/0 (socket says 172.21.15.39:44556) 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 -- 172.21.15.39:0/188973030 learned_addr learned my addr 172.21.15.39:0/188973030 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 -- 172.21.15.39:0/188973030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 msgr2=0x55eddd8b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 -- 172.21.15.39:0/188973030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd8a6bb0 msgr2=0x55eddd8b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd8a6bb0 0x55eddd8b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 -- 172.21.15.39:0/188973030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eddd897a00 con 0x55eddd89b9d0 2024-09-12T01:56:45.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.936+0000 7fdede59c640 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fded80b8700 tx=0x7fded803b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a214ddf38b1b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdec7fff640 1 -- 172.21.15.39:0/188973030 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8049040 con 0x55eddd89b9d0 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdec7fff640 1 -- 172.21.15.39:0/188973030 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fded80bc9a0 con 0x55eddd89b9d0 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdec7fff640 1 -- 172.21.15.39:0/188973030 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded803b5f0 con 0x55eddd89b9d0 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 -- 172.21.15.39:0/188973030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 msgr2=0x55eddd8a3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fded80b8700 tx=0x7fded803b990 comp rx=0 tx=0).stop 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 -- 172.21.15.39:0/188973030 shutdown_connections 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd8a6bb0 0x55eddd8b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd89c2f0 0x55eddd8b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 --2- 172.21.15.39:0/188973030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8a3050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 -- 172.21.15.39:0/188973030 >> 172.21.15.39:0/188973030 conn(0x55eddd897f60 msgr2=0x55eddd8a3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 -- 172.21.15.39:0/188973030 shutdown_connections 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.937+0000 7fdee714c740 1 -- 172.21.15.39:0/188973030 wait complete. 2024-09-12T01:56:45.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 -- start start 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 Processor -- start 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 0x55eddd8bb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b8730 con 0x55eddd89b9d0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b8060 con 0x55eddd89c2f0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eddd8b8e00 con 0x55eddd8a6bb0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdee714c740 10 client.0 _ll_register_callbacks cb 0x7fded001c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44566/0 (socket says 172.21.15.39:44566) 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 -- 172.21.15.39:0/1376208818 learned_addr learned my addr 172.21.15.39:0/1376208818 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 0x55eddd8bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdeded9d640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 -- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 msgr2=0x55eddd8bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8bbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 -- 172.21.15.39:0/1376208818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 msgr2=0x55eddd8bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 0x55eddd8bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdede59c640 1 -- 172.21.15.39:0/1376208818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eddd8bc2d0 con 0x55eddd89b9d0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.938+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 0x55eddd8bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdede59c640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fded80b8c70 tx=0x7fded80ba710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7621e91982b3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8049070 con 0x55eddd89b9d0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fded803b5f0 con 0x55eddd89b9d0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded80bc9a0 con 0x55eddd89b9d0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fded80bbc00 con 0x55eddd89b9d0 2024-09-12T01:56:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eddd920ab0 con 0x55eddd89b9d0 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fded80bc9a0 con 0x55eddd89b9d0 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fded80c01b0 con 0x55eddd89b9d0 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 20 client.15102 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd925130 0x55eddd923e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 4 client.15102 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.939+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "status"}) -- 0x55eddd809b10 con 0x55eddd925130 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd925130 0x55eddd923e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdec5ffb640 10 client.15102 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdeddd9b640 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd925130 0x55eddd923e40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8691c1f0fc62b83e server_cookie=d37029b503c716b1 in_seq=0 out_seq=0 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdec5ffb640 1 -- 172.21.15.39:0/1376208818 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55eddd809b10 con 0x55eddd925130 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdec5ffb640 10 client.15102 handle_command_reply: tid=0 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 client.15102 shutdown 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 msgr2=0x55eddd8c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fded80b8c70 tx=0x7fded80ba710 comp rx=0 tx=0).stop 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 shutdown_connections 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55eddd925130 0x55eddd923e40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eddd8a6bb0 0x55eddd8bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eddd89c2f0 0x55eddd8bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdec5ffb640 0 client.15102 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 --2- 172.21.15.39:0/1376208818 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55eddd89b9d0 0x55eddd8c1240 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.940+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 >> 172.21.15.39:0/1376208818 conn(0x55eddd897f60 msgr2=0x55eddd8a4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 shutdown_connections 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee714c740 1 -- 172.21.15.39:0/1376208818 wait complete. 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee714c740 20 client.15102 trim_cache size 0 max 16384 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24463, 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:45.953 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 89.287951972000002, 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 117.28367323800001 2024-09-12T01:56:45.954 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 msgr2=0x7fdecc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 0x7fdecc0a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fded0009fd0 tx=0x7fded0009d60 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 msgr2=0x7fdee0198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fded8006010 tx=0x7fded8003c80 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 shutdown_connections 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee0102ef0 0x7fdee019cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdecc0a2b80 0x7fdecc0a5040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee0102570 0x7fdee0198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 --2- 172.21.15.39:0/1474505030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0100e20 0x7fdee0198710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 >> 172.21.15.39:0/1474505030 conn(0x7fdee00fc7d0 msgr2=0x7fdee006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:45.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 shutdown_connections 2024-09-12T01:56:45.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:45.941+0000 7fdee4d73640 1 -- 172.21.15.39:0/1474505030 wait complete. 2024-09-12T01:56:46.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:56:46.938 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:47.260 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:47 smithi039 ceph-mon[31204]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:47.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:47 smithi044 ceph-mon[35259]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 -- 172.21.15.39:0/3084067910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 msgr2=0x7f5ea41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/3084067910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea41067f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009900 tx=0x7f5e9402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 -- 172.21.15.39:0/3084067910 shutdown_connections 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/3084067910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 0x7f5ea410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/3084067910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea41067f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/3084067910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 0x7f5ea41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 -- 172.21.15.39:0/3084067910 >> 172.21.15.39:0/3084067910 conn(0x7f5ea40fd8f0 msgr2=0x7f5ea40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 -- 172.21.15.39:0/3084067910 shutdown_connections 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.448+0000 7f5eaaddc640 1 -- 172.21.15.39:0/3084067910 wait complete. 2024-09-12T01:56:47.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 Processor -- start 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 -- start start 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 0x7f5ea4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 0x7f5ea419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4112020 con 0x7f5ea41027a0 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4111ea0 con 0x7f5ea4106f20 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5eaaddc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41121a0 con 0x7f5ea4101df0 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44584/0 (socket says 172.21.15.39:44584) 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 -- 172.21.15.39:0/586866060 learned_addr learned my addr 172.21.15.39:0/586866060 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 0x7f5ea4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5ea9379640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 0x7f5ea419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 -- 172.21.15.39:0/586866060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 msgr2=0x7f5ea4198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 0x7f5ea4198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 -- 172.21.15.39:0/586866060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 msgr2=0x7f5ea419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 0x7f5ea419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 -- 172.21.15.39:0/586866060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea419d5f0 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.449+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e94005ab0 tx=0x7f5e940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.450+0000 7f5e99ffb640 1 -- 172.21.15.39:0/586866060 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9403f030 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.450+0000 7f5e99ffb640 1 -- 172.21.15.39:0/586866060 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e94003ce0 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.450+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea419d880 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.450+0000 7f5e99ffb640 1 -- 172.21.15.39:0/586866060 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94035070 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.450+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea41a51c0 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.452+0000 7f5e99ffb640 1 -- 172.21.15.39:0/586866060 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5e94042030 con 0x7f5ea41027a0 2024-09-12T01:56:47.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 Processor -- start 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 -- start start 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953777c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x5649537893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5649536de090 con 0x5649537781d0 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564953685a70 con 0x5649537778b0 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5649536da050 con 0x564953786fc0 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5e99ffb640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 0x7f5e8c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44598/0 (socket says 172.21.15.39:44598) 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 -- 172.21.15.39:0/3678742286 learned_addr learned my addr 172.21.15.39:0/3678742286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x5649537893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea9379640 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953777c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea9379640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 0x7f5e8c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 -- 172.21.15.39:0/3678742286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 msgr2=0x5649537893b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x5649537893b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5e99ffb640 1 -- 172.21.15.39:0/586866060 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e940ef930 con 0x7f5ea41027a0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 -- 172.21.15.39:0/3678742286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 msgr2=0x564953777c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953777c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.453+0000 7f5ea8b78640 1 -- 172.21.15.39:0/3678742286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564953692130 con 0x5649537781d0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009a70 tx=0x7f5ea0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0f63c65083346e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5ea9379640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 0x7f5e8c0a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0070b0 tx=0x7f5e9c0093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5e8affd640 1 -- 172.21.15.39:0/3678742286 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x5649537781d0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5e8affd640 1 -- 172.21.15.39:0/3678742286 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0013470 con 0x5649537781d0 2024-09-12T01:56:47.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5e8affd640 1 -- 172.21.15.39:0/3678742286 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0012630 con 0x5649537781d0 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5ead1b5740 1 -- 172.21.15.39:0/3678742286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 msgr2=0x564953786a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.454+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009a70 tx=0x7f5ea0009f30 comp rx=0 tx=0).stop 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 -- 172.21.15.39:0/3678742286 shutdown_connections 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x5649537893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953786a80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/3678742286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953777c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 -- 172.21.15.39:0/3678742286 >> 172.21.15.39:0/3678742286 conn(0x564953773f60 msgr2=0x564953774340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 -- 172.21.15.39:0/3678742286 shutdown_connections 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 -- 172.21.15.39:0/3678742286 wait complete. 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 -- start start 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 Processor -- start 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.455+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953786870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x564953784100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564953789b90 con 0x5649537781d0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564953698f20 con 0x5649537778b0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564953789d10 con 0x564953786fc0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 10 client.0 _ll_register_callbacks cb 0x564953662030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44604/0 (socket says 172.21.15.39:44604) 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 -- 172.21.15.39:0/516857428 learned_addr learned my addr 172.21.15.39:0/516857428 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953786870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ea9379640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x564953784100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 -- 172.21.15.39:0/516857428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 msgr2=0x564953784100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x564953784100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 -- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 msgr2=0x564953786870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953786870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 -- 172.21.15.39:0/516857428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495344f2b0 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ea9379640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x564953784100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ed7b0 tx=0x7f5e94009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc7fcea263b8df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94049070 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e9403bd00 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea0013470 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.456+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e940bc8a0 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5649537954f0 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0013470 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5e940b8810 con 0x5649537781d0 2024-09-12T01:56:47.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 20 client.15114 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953797b60 0x564953798fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 4 client.15114 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649536eb600 con 0x564953797b60 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.457+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953797b60 0x564953798fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.458+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953797b60 0x564953798fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9c7fe298ae18040 server_cookie=f45eaa0914638e66 in_seq=0 out_seq=0 2024-09-12T01:56:47.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.458+0000 7f5e83fff640 10 client.15114 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.458+0000 7f5e83fff640 1 -- 172.21.15.39:0/516857428 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649536eb600 con 0x564953797b60 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.458+0000 7f5e83fff640 10 client.15114 handle_command_reply: tid=0 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.458+0000 7f5ead1b5740 1 client.15114 shutdown 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 msgr2=0x564953783bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ed7b0 tx=0x7f5e94009560 comp rx=0 tx=0).stop 2024-09-12T01:56:47.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 shutdown_connections 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953797b60 0x564953798fd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564953786fc0 0x564953784100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537781d0 0x564953783bc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/516857428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649537778b0 0x564953786870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 >> 172.21.15.39:0/516857428 conn(0x564953773f60 msgr2=0x564953779cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5e83fff640 0 client.15114 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 shutdown_connections 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 1 -- 172.21.15.39:0/516857428 wait complete. 2024-09-12T01:56:47.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.459+0000 7f5ead1b5740 20 client.15114 trim_cache size 0 max 16384 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 Processor -- start 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 -- start start 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x564953798fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x56495376ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564953797310 con 0x5649537778b0 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649537979e0 con 0x564953786fc0 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5649537980b0 con 0x5649537781d0 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44620/0 (socket says 172.21.15.39:44620) 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 -- 172.21.15.39:0/1936226126 learned_addr learned my addr 172.21.15.39:0/1936226126 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea9379640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x56495376ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 -- 172.21.15.39:0/1936226126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 msgr2=0x564953798fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x564953798fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x564953798fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 -- 172.21.15.39:0/1936226126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 msgr2=0x56495376ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.477+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x56495376ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5ea8b78640 1 -- 172.21.15.39:0/1936226126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564953778000 con 0x5649537778b0 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x564953798fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5ea9379640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x56495376ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009a70 tx=0x7f5ea0009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca70050a56f934ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5e8a7fc640 1 -- 172.21.15.39:0/1936226126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017040 con 0x5649537778b0 2024-09-12T01:56:47.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5e8a7fc640 1 -- 172.21.15.39:0/1936226126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0006b80 con 0x5649537778b0 2024-09-12T01:56:47.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.478+0000 7f5e8a7fc640 1 -- 172.21.15.39:0/1936226126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00263b0 con 0x5649537778b0 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- 172.21.15.39:0/1936226126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 msgr2=0x564953797490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009a70 tx=0x7f5ea0009110 comp rx=0 tx=0).stop 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- 172.21.15.39:0/1936226126 shutdown_connections 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x56495376ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x564953798fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/1936226126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x564953797490 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- 172.21.15.39:0/1936226126 >> 172.21.15.39:0/1936226126 conn(0x564953773f60 msgr2=0x564953774340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- 172.21.15.39:0/1936226126 shutdown_connections 2024-09-12T01:56:47.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- 172.21.15.39:0/1936226126 wait complete. 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 -- start start 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 Processor -- start 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.479+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x5649537a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x5649537a0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564953798e50 con 0x5649537778b0 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564953798780 con 0x564953786fc0 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564953799520 con 0x5649537781d0 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 10 client.0 _ll_register_callbacks cb 0x7f5e94005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44624/0 (socket says 172.21.15.39:44624) 2024-09-12T01:56:47.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 -- 172.21.15.39:0/954752279 learned_addr learned my addr 172.21.15.39:0/954752279 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea9379640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x5649537a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x5649537a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 -- 172.21.15.39:0/954752279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 msgr2=0x5649537a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x5649537a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 -- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 msgr2=0x5649537a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x5649537a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 -- 172.21.15.39:0/954752279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495379a380 con 0x5649537778b0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ea8b78640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0029040 tx=0x7f5ea000e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88837f76c03ed353 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0034060 con 0x5649537778b0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5ea0013470 con 0x5649537778b0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.480+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ea0006b80 con 0x5649537778b0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5ea0017050 con 0x5649537778b0 2024-09-12T01:56:47.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 10 client.15120 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56495379ed80 con 0x5649537778b0 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0006b80 con 0x5649537778b0 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea00062e0 con 0x5649537778b0 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 10 client.15120 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 10 client.15120 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 20 client.15120 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953805970 0x564953804680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 4 client.15120 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "status"}) -- 0x5649536e5b10 con 0x564953805970 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.481+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953805970 0x564953804680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5e9bfff640 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953805970 0x564953804680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd9603f0316456be server_cookie=f7830d241b9f086d in_seq=0 out_seq=0 2024-09-12T01:56:47.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5e83fff640 10 client.15120 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5e83fff640 1 -- 172.21.15.39:0/954752279 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5649536e5b10 con 0x564953805970 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5e83fff640 10 client.15120 handle_command_reply: tid=0 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 client.15120 shutdown 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 msgr2=0x56495379fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0029040 tx=0x7f5ea000e7a0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 shutdown_connections 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x564953805970 0x564953804680 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5e83fff640 0 client.15120 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564953786fc0 0x5649537a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5649537781d0 0x5649537a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 --2- 172.21.15.39:0/954752279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5649537778b0 0x56495379fbf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 >> 172.21.15.39:0/954752279 conn(0x564953773f60 msgr2=0x56495376ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 shutdown_connections 2024-09-12T01:56:47.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 1 -- 172.21.15.39:0/954752279 wait complete. 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.482+0000 7f5ead1b5740 20 client.15120 trim_cache size 0 max 16384 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24467, 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 91.840609673000003, 2024-09-12T01:56:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 121.41096398400001 2024-09-12T01:56:47.490 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:47.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 msgr2=0x7f5e8c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 0x7f5e8c0a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0070b0 tx=0x7f5e9c0093d0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 msgr2=0x7f5ea4198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e94005ab0 tx=0x7f5e940042f0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 shutdown_connections 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ea4106f20 0x7f5ea419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ea41027a0 0x7f5ea4198b80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5e8c0a2c00 0x7f5e8c0a50c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 --2- 172.21.15.39:0/586866060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ea4101df0 0x7f5ea4198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 >> 172.21.15.39:0/586866060 conn(0x7f5ea40fd8f0 msgr2=0x7f5ea40fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 shutdown_connections 2024-09-12T01:56:47.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:47.483+0000 7f5eaaddc640 1 -- 172.21.15.39:0/586866060 wait complete. 2024-09-12T01:56:47.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:47 smithi172 ceph-mon[35073]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T01:56:48.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:48 smithi039 ceph-mon[31204]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:56:48.247 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:56:48.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:48 smithi044 ceph-mon[35259]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:56:48.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:48 smithi172 ceph-mon[35073]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-12T01:56:48.510 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.065+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/108170072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141082a0 msgr2=0x7fbb1410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.065+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/108170072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141082a0 0x7fbb1410ec40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009cd0 tx=0x7fbb0402a910 comp rx=0 tx=0).stop 2024-09-12T01:56:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/108170072 shutdown_connections 2024-09-12T01:56:49.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/108170072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141082a0 0x7fbb1410ec40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/108170072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141036e0 0x7fbb14107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/108170072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb14103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/108170072 >> 172.21.15.39:0/108170072 conn(0x7fbb140fc7d0 msgr2=0x7fbb140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/108170072 shutdown_connections 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/108170072 wait complete. 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 Processor -- start 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- start start 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb141986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 0x7fbb1419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14112160 con 0x7fbb141036e0 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14111fe0 con 0x7fbb14102d30 2024-09-12T01:56:49.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.066+0000 7fbb1c7b8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141122e0 con 0x7fbb141082a0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44640/0 (socket says 172.21.15.39:44640) 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 -- 172.21.15.39:0/703071827 learned_addr learned my addr 172.21.15.39:0/703071827 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1a554640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb141986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 -- 172.21.15.39:0/703071827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 msgr2=0x7fbb1419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 0x7fbb1419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 0x7fbb1419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 -- 172.21.15.39:0/703071827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 msgr2=0x7fbb141986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb141986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 -- 172.21.15.39:0/703071827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1419d660 con 0x7fbb141036e0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1a554640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb141986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 0x7fbb1419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb19d53640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb08006fd0 tx=0x7fbb0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb137fe640 1 -- 172.21.15.39:0/703071827 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08011830 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1419d950 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb137fe640 1 -- 172.21.15.39:0/703071827 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb08016070 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb137fe640 1 -- 172.21.15.39:0/703071827 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800f2e0 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.067+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb141a5230 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.069+0000 7fbb137fe640 1 -- 172.21.15.39:0/703071827 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb0801b460 con 0x7fbb141036e0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 Processor -- start 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 -- start start 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 0x5623e273b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e273dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5623e2697090 con 0x5623e27309d0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623e263ea70 con 0x5623e27312f0 2024-09-12T01:56:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5623e2693050 con 0x5623e273bbb0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb137fe640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1ad55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1ad55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44642/0 (socket says 172.21.15.39:44642) 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.070+0000 7fbb1ad55640 1 -- 172.21.15.39:0/760040440 learned_addr learned my addr 172.21.15.39:0/760040440 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1a554640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 0x5623e273b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb137fe640 1 -- 172.21.15.39:0/703071827 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbb080ce7d0 con 0x7fbb141036e0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb19d53640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e273dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 -- 172.21.15.39:0/760040440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 msgr2=0x5623e273dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e273dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 -- 172.21.15.39:0/760040440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 msgr2=0x5623e273b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 0x5623e273b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 -- 172.21.15.39:0/760040440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e264b130 con 0x5623e27309d0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1a554640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 0x5623e273b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009a60 tx=0x7fbb04003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b466371773bfb987 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 0x7fbafc0a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb0402f510 tx=0x7fbb04042000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb10ff9640 1 -- 172.21.15.39:0/760040440 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0404d070 con 0x5623e27309d0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb10ff9640 1 -- 172.21.15.39:0/760040440 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb04036050 con 0x5623e27309d0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.071+0000 7fbb10ff9640 1 -- 172.21.15.39:0/760040440 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04031de0 con 0x5623e27309d0 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- 172.21.15.39:0/760040440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 msgr2=0x5623e2730db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009a60 tx=0x7fbb04003aa0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- 172.21.15.39:0/760040440 shutdown_connections 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e273dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27312f0 0x5623e273b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/760040440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27309d0 0x5623e2730db0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- 172.21.15.39:0/760040440 >> 172.21.15.39:0/760040440 conn(0x5623e272cf60 msgr2=0x5623e272d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- 172.21.15.39:0/760040440 shutdown_connections 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- 172.21.15.39:0/760040440 wait complete. 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.072+0000 7fbb1eb91740 1 -- start start 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 Processor -- start 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e273b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e2738dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5623e273e780 con 0x5623e27312f0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623e2651f20 con 0x5623e273bbb0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5623e273e900 con 0x5623e27309d0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1eb91740 10 client.0 _ll_register_callbacks cb 0x5623e261b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44650/0 (socket says 172.21.15.39:44650) 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 -- 172.21.15.39:0/3466801979 learned_addr learned my addr 172.21.15.39:0/3466801979 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1a554640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e273b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 -- 172.21.15.39:0/3466801979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 msgr2=0x5623e273b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e273b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 -- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 msgr2=0x5623e2738dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e2738dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e2738dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 -- 172.21.15.39:0/3466801979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e24082b0 con 0x5623e27312f0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb1a554640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e273b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbb19d53640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbb0809ace0 tx=0x7fbb08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae1109990911bef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.073+0000 7fbaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0809afe0 con 0x5623e27312f0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb04036050 con 0x5623e27312f0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbb080cc390 con 0x5623e27312f0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb08065050 con 0x5623e27312f0 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 10 client.15132 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:49.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5623e274a1b0 con 0x5623e27312f0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb08079e50 con 0x5623e27312f0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbb08095b50 con 0x5623e27312f0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 20 client.15132 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e274c7c0 0x5623e274dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 4 client.15132 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e26a4600 con 0x5623e274c7c0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.074+0000 7fbb1a554640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e274c7c0 0x5623e274dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.075+0000 7fbb1a554640 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e274c7c0 0x5623e274dc30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200a8d81a976d019 server_cookie=89081a16c1b679f in_seq=0 out_seq=0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.075+0000 7fbaf9ffb640 10 client.15132 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/3466801979 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623e26a4600 con 0x5623e274c7c0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbaf9ffb640 10 client.15132 handle_command_reply: tid=0 2024-09-12T01:56:49.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 client.15132 shutdown 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 msgr2=0x5623e2738870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbb0809ace0 tx=0x7fbb08000bc0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 shutdown_connections 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e274c7c0 0x5623e274dc30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e2738dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738870 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/3466801979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e273b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 >> 172.21.15.39:0/3466801979 conn(0x5623e272cf60 msgr2=0x5623e2732c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbaf9ffb640 0 client.15132 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 shutdown_connections 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 1 -- 172.21.15.39:0/3466801979 wait complete. 2024-09-12T01:56:49.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.076+0000 7fbb1eb91740 20 client.15132 trim_cache size 0 max 16384 2024-09-12T01:56:49.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 Processor -- start 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 -- start start 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27309d0 0x5623e274dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e2756300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5623e274bf70 con 0x5623e27312f0 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623e274c640 con 0x5623e27309d0 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5623e274cd10 con 0x5623e273bbb0 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44666/0 (socket says 172.21.15.39:44666) 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 -- 172.21.15.39:0/2757006605 learned_addr learned my addr 172.21.15.39:0/2757006605 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e2756300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb1a554640 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27309d0 0x5623e274dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 -- 172.21.15.39:0/2757006605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 msgr2=0x5623e2756300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e2756300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 -- 172.21.15.39:0/2757006605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27309d0 msgr2=0x5623e274dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27309d0 0x5623e274dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.094+0000 7fbb19d53640 1 -- 172.21.15.39:0/2757006605 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e272e010 con 0x5623e27312f0 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb19d53640 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010f60 tx=0x7fbb080108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632431db2dfb283e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbafbfff640 1 -- 172.21.15.39:0/2757006605 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0809afe0 con 0x5623e27312f0 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbafbfff640 1 -- 172.21.15.39:0/2757006605 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb0807e070 con 0x5623e27312f0 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbafbfff640 1 -- 172.21.15.39:0/2757006605 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0809a940 con 0x5623e27312f0 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 -- 172.21.15.39:0/2757006605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 msgr2=0x5623e2738130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbb08010f60 tx=0x7fbb080108e0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 -- 172.21.15.39:0/2757006605 shutdown_connections 2024-09-12T01:56:49.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e273bbb0 0x5623e2756300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2738130 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/2757006605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e27309d0 0x5623e274dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 -- 172.21.15.39:0/2757006605 >> 172.21.15.39:0/2757006605 conn(0x5623e272cf60 msgr2=0x5623e2738830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.095+0000 7fbb1eb91740 1 -- 172.21.15.39:0/2757006605 shutdown_connections 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 -- 172.21.15.39:0/2757006605 wait complete. 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 -- start start 2024-09-12T01:56:49.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 Processor -- start 2024-09-12T01:56:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e27357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e27b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5623e274dab0 con 0x5623e27312f0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623e274d3e0 con 0x5623e273bbb0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5623e274e180 con 0x5623e27309d0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1eb91740 10 client.0 _ll_register_callbacks cb 0x7fbb080959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb19d53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44674/0 (socket says 172.21.15.39:44674) 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb19d53640 1 -- 172.21.15.39:0/1033895461 learned_addr learned my addr 172.21.15.39:0/1033895461 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1a554640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e27357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.096+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e27b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 -- 172.21.15.39:0/1033895461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 msgr2=0x5623e27357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e27357d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 -- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 msgr2=0x5623e27b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e27b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 -- 172.21.15.39:0/1033895461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e27b2830 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb1ad55640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e27b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb19d53640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbb080a3720 tx=0x7fbb08010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a3ce194bd1a827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0809a940 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbb08095b50 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0807e070 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb0809afe0 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb1eb91740 10 client.15138 fetch_fsmap learned FSMap version 24 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5623e27badc0 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb0807e070 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbb08099f30 con 0x5623e27312f0 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.097+0000 7fbb1eb91740 10 client.15138 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T01:56:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 10 client.15138 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 20 client.15138 populate_metadata read hostname 'smithi039' 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e27bf2e0 0x5623e27bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 4 client.15138 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "status"}) -- 0x5623e269eb10 con 0x5623e27bf2e0 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1a554640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e27bf2e0 0x5623e27bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1a554640 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e27bf2e0 0x5623e27bdff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3085061a1893c695 server_cookie=add65b4ef0b521e in_seq=0 out_seq=0 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbaf9ffb640 10 client.15138 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbaf9ffb640 1 -- 172.21.15.39:0/1033895461 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5623e269eb10 con 0x5623e27bf2e0 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbaf9ffb640 10 client.15138 handle_command_reply: tid=0 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.098+0000 7fbb1eb91740 1 client.15138 shutdown 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 msgr2=0x5623e2735d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbb080a3720 tx=0x7fbb08010740 comp rx=0 tx=0).stop 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 shutdown_connections 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5623e27bf2e0 0x5623e27bdff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623e273bbb0 0x5623e27b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5623e27312f0 0x5623e2735d10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 --2- 172.21.15.39:0/1033895461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623e27309d0 0x5623e27357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 >> 172.21.15.39:0/1033895461 conn(0x5623e272cf60 msgr2=0x5623e272b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbaf9ffb640 0 client.15138 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 shutdown_connections 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 1 -- 172.21.15.39:0/1033895461 wait complete. 2024-09-12T01:56:49.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1eb91740 20 client.15138 trim_cache size 0 max 16384 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24503, 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 100.51240457900001, 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-09-12T01:56:49.109 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 111.29623788000001 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 msgr2=0x7fbafc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 0x7fbafc0a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb0402f510 tx=0x7fbb04042000 comp rx=0 tx=0).stop 2024-09-12T01:56:49.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 msgr2=0x7fbb14198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb08006fd0 tx=0x7fbb0800b8e0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 shutdown_connections 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb141082a0 0x7fbb1419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb141036e0 0x7fbb14198bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 --2- 172.21.15.39:0/703071827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb14102d30 0x7fbb141986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 >> 172.21.15.39:0/703071827 conn(0x7fbb140fc7d0 msgr2=0x7fbb14105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.099+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 shutdown_connections 2024-09-12T01:56:49.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:49.100+0000 7fbb1c7b8640 1 -- 172.21.15.39:0/703071827 wait complete. 2024-09-12T01:56:49.957 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:56:49.968 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:56:49.968 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:56:49.969 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:56:49.969 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:56:50.010 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:56:50.010 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T01:56:50.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:50.011 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T01:56:50.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:50.030 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-12T01:56:50.100 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-09-12T01:56:50.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:50.102 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T01:56:50.103 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:56:50.103 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:50.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:56:50.400 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:50.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:50 smithi039 ceph-mon[31204]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:50 smithi044 ceph-mon[35259]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:50.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:50 smithi172 ceph-mon[35073]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 -- 172.21.15.39:0/60125463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 msgr2=0x7f7ea41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 --2- 172.21.15.39:0/60125463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea41067e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009900 tx=0x7f7e8c02a410 comp rx=0 tx=0).stop 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 -- 172.21.15.39:0/60125463 shutdown_connections 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 --2- 172.21.15.39:0/60125463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4106f10 0x7f7ea410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 --2- 172.21.15.39:0/60125463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea41067e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 --2- 172.21.15.39:0/60125463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4101de0 0x7f7ea41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 -- 172.21.15.39:0/60125463 >> 172.21.15.39:0/60125463 conn(0x7f7ea40fd8c0 msgr2=0x7f7ea40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 -- 172.21.15.39:0/60125463 shutdown_connections 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.920+0000 7f7eaa405640 1 -- 172.21.15.39:0/60125463 wait complete. 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 Processor -- start 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 -- start start 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 0x7f7ea4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4106f10 0x7f7ea419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4111f90 con 0x7f7ea4102790 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4111e10 con 0x7f7ea4101de0 2024-09-12T01:56:50.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7eaa405640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea4112110 con 0x7f7ea4106f10 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44692/0 (socket says 172.21.15.39:44692) 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 -- 172.21.15.39:0/2285382032 learned_addr learned my addr 172.21.15.39:0/2285382032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7ea3fff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 0x7f7ea4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 -- 172.21.15.39:0/2285382032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4106f10 msgr2=0x7f7ea419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7ea89a2640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4106f10 0x7f7ea419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4106f10 0x7f7ea419ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 -- 172.21.15.39:0/2285382032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 msgr2=0x7f7ea4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 0x7f7ea4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.921+0000 7f7e9bfff640 1 -- 172.21.15.39:0/2285382032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea419d3d0 con 0x7f7ea4102790 2024-09-12T01:56:50.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7ea3fff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 0x7f7ea4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7e9bfff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005ab0 tx=0x7f7e8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c03f030 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea419d660 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e8c003ce0 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c035070 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.922+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea41a4fa0 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.923+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea41032c0 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.924+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e8c042030 con 0x7f7ea4102790 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.925+0000 7f7ea1ffb640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 0x7f7e900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.925+0000 7f7ea3fff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 0x7f7e900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:50.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.925+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e8c0ef9d0 con 0x7f7ea4102790 2024-09-12T01:56:50.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.925+0000 7f7ea3fff640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 0x7f7e900a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400baa0 tx=0x7f7e94005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:50.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:50.930+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e8c0bc940 con 0x7f7ea4102790 2024-09-12T01:56:51.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.143+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ea410a120 con 0x7f7ea4102790 2024-09-12T01:56:51.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.144+0000 7f7ea1ffb640 1 -- 172.21.15.39:0/2285382032 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f7e8c0bc240 con 0x7f7ea4102790 2024-09-12T01:56:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 msgr2=0x7f7e900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 0x7f7e900a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400baa0 tx=0x7f7e94005d90 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 msgr2=0x7f7ea4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005ab0 tx=0x7f7e8c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 shutdown_connections 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7e900a2b80 0x7f7e900a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4106f10 0x7f7ea419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ea4102790 0x7f7ea4198960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 --2- 172.21.15.39:0/2285382032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ea4101de0 0x7f7ea4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.145+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 >> 172.21.15.39:0/2285382032 conn(0x7f7ea40fd8c0 msgr2=0x7f7ea40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.146+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 shutdown_connections 2024-09-12T01:56:51.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:51.146+0000 7f7eaa405640 1 -- 172.21.15.39:0/2285382032 wait complete. 2024-09-12T01:56:51.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:51 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2285382032' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:56:51.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:51 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2285382032' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:56:51.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:51 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2285382032' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:56:51.883 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:56:51.883 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:56:51.883 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-09-12T01:56:51.883 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:56:51.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:51.884 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:56:51.884 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:56:51.884 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:56:51.884 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:51.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:51.884 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-09-12T01:56:51.901 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-09-12T01:56:51.902 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42177sec preferred_lft 42177sec 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:56:51.903 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-09-12T01:56:51.904 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:56:51.904 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T01:56:52.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:52.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:52.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:52.126 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:56:52.153 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-09-12T01:56:52.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:52.155 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-09-12T01:56:52.239 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-09-12T01:56:52.239 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:56:52.239 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:56:52.239 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:56:52.239 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:56:52.240 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T01:56:52.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:52.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:52 smithi039 ceph-mon[31204]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:52.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:52.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:52.539 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T01:56:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:52.555 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-09-12T01:56:52.610 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:52.610 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T01:56:52.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:56:52.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:56:52.611 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T01:56:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:52 smithi044 ceph-mon[35259]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:52.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:52.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:52.731 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:56:52.731 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T01:56:52.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:52 smithi172 ceph-mon[35073]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-12T01:56:52.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:52.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:52.863 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:56:52.863 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T01:56:52.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-09-12T01:56:52.864 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:56:52.864 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T01:56:52.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:52.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:52.943 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:52.973 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:56:52.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:56:52.973 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:53.028 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T01:56:53.028 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T01:56:53.028 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df 2024-09-12T01:56:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:53.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T01:56:53.143 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T01:56:53.143 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-12T01:56:53.144 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.44:3300,172.21.15.172:3300" 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:3300,172.21.15.44:3300,172.21.15.172:3300:/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df 2024-09-12T01:56:53.320 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=d27de812-70a8-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:56:53.321 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:56:53.321 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:56:53.321 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:56:53.321 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:56:53.321 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:56:53.323 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:56:53.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:56:53.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:56:53.350 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:53.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:53.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:53.449 INFO:teuthology.orchestra.run.smithi039.stdout:client24836 2024-09-12T01:56:53.450 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:56:53.450 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:56:53.467 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:53.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:53.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:53.564 INFO:teuthology.orchestra.run.smithi039.stdout:client24836 2024-09-12T01:56:53.564 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:56:53.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:56:53.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:53.622 INFO:teuthology.orchestra.run.smithi039.stdout:client24836 2024-09-12T01:56:53.622 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d27de812-70a8-11ef-bcea-c7b262605968.client24836/status') 2024-09-12T01:56:53.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:56:53.682 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.24836 (3)172.21.15.39:0/3760364224 2024-09-12T01:56:53.682 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-09-12T01:56:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-09-12T01:56:53.682 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-09-12T01:56:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:71 bytes copied, 2.4615e-05 s, 2.9 MB/s 2024-09-12T01:56:53.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:56:53.690 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T01:56:53.699 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:56:53.700 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T01:56:53.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T01:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 -- 172.21.15.39:0/1767201221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef0100d20 msgr2=0x7f4ef01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 --2- 172.21.15.39:0/1767201221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef0100d20 0x7f4ef01011a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009900 tx=0x7f4ee002a410 comp rx=0 tx=0).stop 2024-09-12T01:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 -- 172.21.15.39:0/1767201221 shutdown_connections 2024-09-12T01:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 --2- 172.21.15.39:0/1767201221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef01016e0 0x7f4ef0108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 --2- 172.21.15.39:0/1767201221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef0100d20 0x7f4ef01011a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 --2- 172.21.15.39:0/1767201221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 0x7f4ef01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 -- 172.21.15.39:0/1767201221 >> 172.21.15.39:0/1767201221 conn(0x7f4ef00fb980 msgr2=0x7f4ef00fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 -- 172.21.15.39:0/1767201221 shutdown_connections 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.804+0000 7f4ef8591640 1 -- 172.21.15.39:0/1767201221 wait complete. 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 Processor -- start 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 -- start start 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef0100d20 0x7f4ef0197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 0x7f4ef019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef010d8a0 con 0x7f4ef01016e0 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef010d720 con 0x7f4ef0101ff0 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef8591640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef010da20 con 0x7f4ef0100d20 2024-09-12T01:56:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49418/0 (socket says 172.21.15.39:49418) 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 -- 172.21.15.39:0/952471683 learned_addr learned my addr 172.21.15.39:0/952471683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef6b2e640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 0x7f4ef019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef632d640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef0100d20 0x7f4ef0197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 -- 172.21.15.39:0/952471683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef0100d20 msgr2=0x7f4ef0197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef0100d20 0x7f4ef0197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 -- 172.21.15.39:0/952471683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 msgr2=0x7f4ef019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 0x7f4ef019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.805+0000 7f4ef5b2c640 1 -- 172.21.15.39:0/952471683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef019fa20 con 0x7f4ef01016e0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ef5b2c640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0031440 tx=0x7f4ee0032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee003f030 con 0x7f4ef01016e0 2024-09-12T01:56:53.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ee0003ce0 con 0x7f4ef01016e0 2024-09-12T01:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef019fcb0 con 0x7f4ef01016e0 2024-09-12T01:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0035070 con 0x7f4ef01016e0 2024-09-12T01:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.806+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef01a01a0 con 0x7f4ef01016e0 2024-09-12T01:56:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.807+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef0107e60 con 0x7f4ef01016e0 2024-09-12T01:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.808+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4ee0042030 con 0x7f4ef01016e0 2024-09-12T01:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.809+0000 7f4ee77fe640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 0x7f4edc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.809+0000 7f4ef632d640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 0x7f4edc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.809+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ee00ef9e0 con 0x7f4ef01016e0 2024-09-12T01:56:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.809+0000 7f4ef632d640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 0x7f4edc0a5170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4eec005db0 tx=0x7f4eec005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:53.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:53.812+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ee00bc950 con 0x7f4ef01016e0 2024-09-12T01:56:54.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.024+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f4ef002d990 con 0x7f4ef01016e0 2024-09-12T01:56:54.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.339+0000 7f4ee77fe640 1 -- 172.21.15.39:0/952471683 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f4ee00bc250 con 0x7f4ef01016e0 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 msgr2=0x7f4edc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 0x7f4edc0a5170 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4eec005db0 tx=0x7f4eec005d40 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 msgr2=0x7f4ef0198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0031440 tx=0x7f4ee0032e20 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 shutdown_connections 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef0101ff0 0x7f4ef019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ef01016e0 0x7f4ef0198340 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4edc0a2cb0 0x7f4edc0a5170 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 --2- 172.21.15.39:0/952471683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef0100d20 0x7f4ef0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 >> 172.21.15.39:0/952471683 conn(0x7f4ef00fb980 msgr2=0x7f4ef0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 shutdown_connections 2024-09-12T01:56:54.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.341+0000 7f4ef8591640 1 -- 172.21.15.39:0/952471683 wait complete. 2024-09-12T01:56:54.353 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T01:56:54.364 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T01:56:54.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 -- 172.21.15.39:0/2688725684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c1036e0 msgr2=0x7f6f2c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/2688725684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c109f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009ca0 tx=0x7f6f2402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 -- 172.21.15.39:0/2688725684 shutdown_connections 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/2688725684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c109f70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/2688725684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c102d20 0x7f6f2c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/2688725684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c101b30 0x7f6f2c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 -- 172.21.15.39:0/2688725684 >> 172.21.15.39:0/2688725684 conn(0x7f6f2c0fd270 msgr2=0x7f6f2c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 -- 172.21.15.39:0/2688725684 shutdown_connections 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.528+0000 7f6f30b9f640 1 -- 172.21.15.39:0/2688725684 wait complete. 2024-09-12T01:56:54.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 Processor -- start 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 -- start start 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c102d20 0x7f6f2c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c10d790 con 0x7f6f2c101b30 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c10d610 con 0x7f6f2c1036e0 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f30b9f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c10d910 con 0x7f6f2c102d20 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49432/0 (socket says 172.21.15.39:49432) 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 -- 172.21.15.39:0/1520501140 learned_addr learned my addr 172.21.15.39:0/1520501140 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2ad9d640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f29d9b640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c102d20 0x7f6f2c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 -- 172.21.15.39:0/1520501140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c102d20 msgr2=0x7f6f2c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c102d20 0x7f6f2c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 -- 172.21.15.39:0/1520501140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c1036e0 msgr2=0x7f6f2c19f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c19f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.529+0000 7f6f2a59c640 1 -- 172.21.15.39:0/1520501140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c19fa10 con 0x7f6f2c101b30 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f2a59c640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00d770 tx=0x7f6f1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c017070 con 0x7f6f2c101b30 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1c009c30 con 0x7f6f2c101b30 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c003dd0 con 0x7f6f2c101b30 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2c19fd00 con 0x7f6f2c101b30 2024-09-12T01:56:54.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.530+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2c1a01a0 con 0x7f6f2c101b30 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.531+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2c108f20 con 0x7f6f2c101b30 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.532+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6f1c003fb0 con 0x7f6f2c101b30 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.533+0000 7f6f237fe640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 0x7f6f180a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.533+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6f1c0cedd0 con 0x7f6f2c101b30 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.533+0000 7f6f29d9b640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 0x7f6f180a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.533+0000 7f6f29d9b640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 0x7f6f180a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005fd0 tx=0x7f6f14005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.536+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f1c009de0 con 0x7f6f2c101b30 2024-09-12T01:56:54.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:54 smithi039 ceph-mon[31204]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:54.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:54 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:56:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:54 smithi044 ceph-mon[35259]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:54 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:56:54.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.713+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f2c062f70 con 0x7f6f2c101b30 2024-09-12T01:56:54.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.714+0000 7f6f237fe640 1 -- 172.21.15.39:0/1520501140 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22679 (secure 0 0 0) 0x7f6f1c097030 con 0x7f6f2c101b30 2024-09-12T01:56:54.714 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:54.714 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":82,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:56:04.883161+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 msgr2=0x7f6f180a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 0x7f6f180a5050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005fd0 tx=0x7f6f14005850 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 msgr2=0x7f6f2c197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00d770 tx=0x7f6f1c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 shutdown_connections 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f2c1036e0 0x7f6f2c19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6f180a2b90 0x7f6f180a5050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f2c102d20 0x7f6f2c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 --2- 172.21.15.39:0/1520501140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f2c101b30 0x7f6f2c197df0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 >> 172.21.15.39:0/1520501140 conn(0x7f6f2c0fd270 msgr2=0x7f6f2c1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 shutdown_connections 2024-09-12T01:56:54.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.716+0000 7f6f30b9f640 1 -- 172.21.15.39:0/1520501140 wait complete. 2024-09-12T01:56:54.728 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:50:23.669815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:55:04.470714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:55:06.558788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:56:54.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:56:54.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:54 smithi172 ceph-mon[35073]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T01:56:54.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:54 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:56:54.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/469750548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 msgr2=0x7fbf68100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/469750548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf68100820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009900 tx=0x7fbf5802a480 comp rx=0 tx=0).stop 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/469750548 shutdown_connections 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/469750548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 0x7fbf68101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/469750548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf681011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/469750548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf68100820 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/469750548 >> 172.21.15.39:0/469750548 conn(0x7fbf680fc1b0 msgr2=0x7fbf680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/469750548 shutdown_connections 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.835+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/469750548 wait complete. 2024-09-12T01:56:54.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 Processor -- start 2024-09-12T01:56:54.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 -- start start 2024-09-12T01:56:54.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf6819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 0x7fbf681a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6810fa00 con 0x7fbf68100420 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6810f880 con 0x7fbf68101700 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6d1cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6810fb80 con 0x7fbf68100d60 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf66d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf66d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49440/0 (socket says 172.21.15.39:49440) 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf66d9d640 1 -- 172.21.15.39:0/3294689113 learned_addr learned my addr 172.21.15.39:0/3294689113 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6759e640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 0x7fbf681a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.836+0000 7fbf6659c640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf6819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 -- 172.21.15.39:0/3294689113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 msgr2=0x7fbf6819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf6819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 -- 172.21.15.39:0/3294689113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 msgr2=0x7fbf681a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 0x7fbf681a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 -- 172.21.15.39:0/3294689113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf681a1d30 con 0x7fbf68100420 2024-09-12T01:56:54.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf6659c640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf6819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf66d9d640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf580314e0 tx=0x7fbf58032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5803f030 con 0x7fbf68100420 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf58003ce0 con 0x7fbf68100420 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf681a1fc0 con 0x7fbf68100420 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58035070 con 0x7fbf68100420 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.837+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf681a23c0 con 0x7fbf68100420 2024-09-12T01:56:54.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.838+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6810b360 con 0x7fbf68100420 2024-09-12T01:56:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.839+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbf58042030 con 0x7fbf68100420 2024-09-12T01:56:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.840+0000 7fbf4ffff640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 0x7fbf500a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.840+0000 7fbf6659c640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 0x7fbf500a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.840+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbf580ef8e0 con 0x7fbf68100420 2024-09-12T01:56:54.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.841+0000 7fbf6659c640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 0x7fbf500a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf6819b620 tx=0x7fbf5c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:54.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:54.843+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf580bc850 con 0x7fbf68100420 2024-09-12T01:56:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.019+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf68062ef0 con 0x7fbf68100420 2024-09-12T01:56:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.019+0000 7fbf4ffff640 1 -- 172.21.15.39:0/3294689113 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fbf580bc150 con 0x7fbf68100420 2024-09-12T01:56:55.019 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-12T01:56:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 msgr2=0x7fbf500a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 0x7fbf500a5050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf6819b620 tx=0x7fbf5c005e50 comp rx=0 tx=0).stop 2024-09-12T01:56:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 msgr2=0x7fbf6819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf580314e0 tx=0x7fbf58032ce0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 shutdown_connections 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf68101700 0x7fbf681a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbf500a2b90 0x7fbf500a5050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf68100d60 0x7fbf6819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 --2- 172.21.15.39:0/3294689113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf68100420 0x7fbf6819a110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 >> 172.21.15.39:0/3294689113 conn(0x7fbf680fc1b0 msgr2=0x7fbf680fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 shutdown_connections 2024-09-12T01:56:55.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.021+0000 7fbf6d1cf640 1 -- 172.21.15.39:0/3294689113 wait complete. 2024-09-12T01:56:55.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- 172.21.15.39:0/2287853725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 msgr2=0x7f43d01072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 --2- 172.21.15.39:0/2287853725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d01072a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009900 tx=0x7f43b802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- 172.21.15.39:0/2287853725 shutdown_connections 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 --2- 172.21.15.39:0/2287853725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d01077e0 0x7f43d0109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 --2- 172.21.15.39:0/2287853725 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d01072a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 --2- 172.21.15.39:0/2287853725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0102580 0x7f43d0104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- 172.21.15.39:0/2287853725 >> 172.21.15.39:0/2287853725 conn(0x7f43d00fc140 msgr2=0x7f43d00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:55.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- 172.21.15.39:0/2287853725 shutdown_connections 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- 172.21.15.39:0/2287853725 wait complete. 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 Processor -- start 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.140+0000 7f43d5882640 1 -- start start 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 0x7f43d0101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 0x7f43d0100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43d010d7b0 con 0x7f43d0104eb0 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43d010d630 con 0x7f43d0102580 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43d5882640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43d010d930 con 0x7f43d01077e0 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49456/0 (socket says 172.21.15.39:49456) 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 -- 172.21.15.39:0/3607025448 learned_addr learned my addr 172.21.15.39:0/3607025448 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:55.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ceffd640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 0x7f43d0101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43cf7fe640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 0x7f43d0100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 -- 172.21.15.39:0/3607025448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 msgr2=0x7f43d0100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 0x7f43d0100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 -- 172.21.15.39:0/3607025448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 msgr2=0x7f43d0101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 0x7f43d0101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 -- 172.21.15.39:0/3607025448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d0101300 con 0x7f43d0104eb0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ceffd640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 0x7f43d0101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43cf7fe640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 0x7f43d0100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.141+0000 7f43ce7fc640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f43b8031610 tx=0x7f43b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.142+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b803f030 con 0x7f43d0104eb0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.142+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43b8003ad0 con 0x7f43d0104eb0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.142+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d01a1fb0 con 0x7f43d0104eb0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.142+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8035070 con 0x7f43d0104eb0 2024-09-12T01:56:55.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.142+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d01a2410 con 0x7f43d0104eb0 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.143+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d00fdc30 con 0x7f43d0104eb0 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.144+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f43b8042030 con 0x7f43d0104eb0 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.145+0000 7f43d4880640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 0x7f43bc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.145+0000 7f43ceffd640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 0x7f43bc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.145+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f43b80ef790 con 0x7f43d0104eb0 2024-09-12T01:56:55.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.145+0000 7f43ceffd640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 0x7f43bc0a5050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005fd0 tx=0x7f43c8005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:55.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.149+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43b80bc700 con 0x7f43d0104eb0 2024-09-12T01:56:55.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.326+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f43d0062ef0 con 0x7f43d0104eb0 2024-09-12T01:56:55.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.326+0000 7f43d4880640 1 -- 172.21.15.39:0/3607025448 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f43b80bc000 con 0x7f43d0104eb0 2024-09-12T01:56:55.326 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-12T01:56:55.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 msgr2=0x7f43bc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 0x7f43bc0a5050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005fd0 tx=0x7f43c8005ea0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 msgr2=0x7f43d0100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f43b8031610 tx=0x7f43b8004270 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 shutdown_connections 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f43bc0a2b90 0x7f43bc0a5050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d01077e0 0x7f43d0100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43d0104eb0 0x7f43d0100530 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 --2- 172.21.15.39:0/3607025448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43d0102580 0x7f43d0101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 >> 172.21.15.39:0/3607025448 conn(0x7f43d00fc140 msgr2=0x7f43d0102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:55.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 shutdown_connections 2024-09-12T01:56:55.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.328+0000 7f43d5882640 1 -- 172.21.15.39:0/3607025448 wait complete. 2024-09-12T01:56:55.339 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 -- 172.21.15.39:0/3856520611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f4101c20 msgr2=0x7fc5f41020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 --2- 172.21.15.39:0/3856520611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f4101c20 0x7fc5f41020a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009900 tx=0x7fc5e002a410 comp rx=0 tx=0).stop 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 -- 172.21.15.39:0/3856520611 shutdown_connections 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 --2- 172.21.15.39:0/3856520611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f41025e0 0x7fc5f4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 --2- 172.21.15.39:0/3856520611 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f4101c20 0x7fc5f41020a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 --2- 172.21.15.39:0/3856520611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 -- 172.21.15.39:0/3856520611 >> 172.21.15.39:0/3856520611 conn(0x7fc5f40fc1b0 msgr2=0x7fc5f40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 -- 172.21.15.39:0/3856520611 shutdown_connections 2024-09-12T01:56:55.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.446+0000 7fc5facdd640 1 -- 172.21.15.39:0/3856520611 wait complete. 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 Processor -- start 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 -- start start 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 0x7fc5f4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f410c6b0 con 0x7fc5f41025e0 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f410c530 con 0x7fc5f4101c20 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5facdd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f410c830 con 0x7fc5f4100a30 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5f927a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5f927a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49478/0 (socket says 172.21.15.39:49478) 2024-09-12T01:56:55.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5f927a640 1 -- 172.21.15.39:0/2776287204 learned_addr learned my addr 172.21.15.39:0/2776287204 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5f8a79640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.447+0000 7fc5f3fff640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 0x7fc5f4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 -- 172.21.15.39:0/2776287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 msgr2=0x7fc5f4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 -- 172.21.15.39:0/2776287204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 msgr2=0x7fc5f4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 0x7fc5f4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 -- 172.21.15.39:0/2776287204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f419fae0 con 0x7fc5f41025e0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f3fff640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 0x7fc5f4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f8a79640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f927a640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00cce0 tx=0x7fc5ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00f450 con 0x7fc5f41025e0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5ec00fad0 con 0x7fc5f41025e0 2024-09-12T01:56:55.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f419fdd0 con 0x7fc5f41025e0 2024-09-12T01:56:55.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec018c10 con 0x7fc5f41025e0 2024-09-12T01:56:55.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.448+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f41a0240 con 0x7fc5f41025e0 2024-09-12T01:56:55.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.449+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f41a0500 con 0x7fc5f41025e0 2024-09-12T01:56:55.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.450+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc5ec00f5f0 con 0x7fc5f41025e0 2024-09-12T01:56:55.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.451+0000 7fc5f1ffb640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 0x7fc5e40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:55.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.451+0000 7fc5f8a79640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 0x7fc5e40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:55.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.451+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc5ec0cf7a0 con 0x7fc5f41025e0 2024-09-12T01:56:55.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.451+0000 7fc5f8a79640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 0x7fc5e40a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:55.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.455+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5ec014030 con 0x7fc5f41025e0 2024-09-12T01:56:55.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.634+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc5f41a06d0 con 0x7fc5f41025e0 2024-09-12T01:56:55.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.635+0000 7fc5f1ffb640 1 -- 172.21.15.39:0/2776287204 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7fc5ec09c710 con 0x7fc5f41025e0 2024-09-12T01:56:55.635 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-09-12T01:56:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 msgr2=0x7fc5e40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 0x7fc5e40a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80058c0 tx=0x7fc5e8005850 comp rx=0 tx=0).stop 2024-09-12T01:56:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 msgr2=0x7fc5f419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00cce0 tx=0x7fc5ec00a620 comp rx=0 tx=0).stop 2024-09-12T01:56:55.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 shutdown_connections 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc5f41025e0 0x7fc5f419f470 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f4101c20 0x7fc5f4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc5e40a2b90 0x7fc5e40a5050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 --2- 172.21.15.39:0/2776287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4100a30 0x7fc5f4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 >> 172.21.15.39:0/2776287204 conn(0x7fc5f40fc1b0 msgr2=0x7fc5f406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 shutdown_connections 2024-09-12T01:56:55.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:55.637+0000 7fc5facdd640 1 -- 172.21.15.39:0/2776287204 wait complete. 2024-09-12T01:56:55.647 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:56:55.647 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:55 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:56:55.647 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1520501140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:55.647 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3294689113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.647 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3607025448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.648 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T01:56:55.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:56:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:55 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:56:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1520501140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3294689113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3607025448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/952471683' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:56:55.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:55 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:56:55.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1520501140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:55.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3294689113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3607025448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:56:55.906 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 -- 172.21.15.39:0/3273779871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c100e20 msgr2=0x7f767c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 --2- 172.21.15.39:0/3273779871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c100e20 0x7f767c101200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f766c009900 tx=0x7f766c02a480 comp rx=0 tx=0).stop 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 -- 172.21.15.39:0/3273779871 shutdown_connections 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 --2- 172.21.15.39:0/3273779871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c102ef0 0x7f767c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 --2- 172.21.15.39:0/3273779871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 --2- 172.21.15.39:0/3273779871 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c100e20 0x7f767c101200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 -- 172.21.15.39:0/3273779871 >> 172.21.15.39:0/3273779871 conn(0x7f767c0fc7d0 msgr2=0x7f767c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 -- 172.21.15.39:0/3273779871 shutdown_connections 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.409+0000 7f7681e95640 1 -- 172.21.15.39:0/3273779871 wait complete. 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 Processor -- start 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 -- start start 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c100e20 0x7f767c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f767c110f80 con 0x7f767c102ef0 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f767c110e00 con 0x7f767c102570 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f7681e95640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f767c111100 con 0x7f767c100e20 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f767bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f767affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f767bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49482/0 (socket says 172.21.15.39:49482) 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f767bfff640 1 -- 172.21.15.39:0/1668013188 learned_addr learned my addr 172.21.15.39:0/1668013188 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.410+0000 7f767b7fe640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c100e20 0x7f767c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 -- 172.21.15.39:0/1668013188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c100e20 msgr2=0x7f767c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c100e20 0x7f767c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 -- 172.21.15.39:0/1668013188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 msgr2=0x7f767c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 -- 172.21.15.39:0/1668013188 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c1a4870 con 0x7f767c102ef0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767affd640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f767bfff640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f767400eaa0 tx=0x7f767400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674004d20 con 0x7f767c102ef0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7674005020 con 0x7f767c102ef0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c1a4a40 con 0x7f767c102ef0 2024-09-12T01:56:56.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740116d0 con 0x7f767c102ef0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.411+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c1a4f80 con 0x7f767c102ef0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.412+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c101200 con 0x7f767c102ef0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.414+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f76740051d0 con 0x7f767c102ef0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.415+0000 7f7678ff9640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 0x7f76640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.415+0000 7f767b7fe640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 0x7f76640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.415+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76740cf490 con 0x7f767c102ef0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.415+0000 7f767b7fe640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 0x7f76640a50c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f766c009230 tx=0x7f766c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:56.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.418+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7674016030 con 0x7f767c102ef0 2024-09-12T01:56:56.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.632+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f767c1a5270 con 0x7f767c102ef0 2024-09-12T01:56:56.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:56 smithi039 ceph-mon[31204]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:56:56.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:56 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2776287204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:56:56.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.633+0000 7f7678ff9640 1 -- 172.21.15.39:0/1668013188 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f767409c480 con 0x7f767c102ef0 2024-09-12T01:56:56.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:56.634 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:56:56.634 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.635+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 msgr2=0x7f76640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 0x7f76640a50c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f766c009230 tx=0x7f766c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 msgr2=0x7f767c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f767400eaa0 tx=0x7f767400eea0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 shutdown_connections 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f767c102ef0 0x7f767c1a4330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f767c102570 0x7f767c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76640a2c00 0x7f76640a50c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 --2- 172.21.15.39:0/1668013188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767c100e20 0x7f767c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:56.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 >> 172.21.15.39:0/1668013188 conn(0x7f767c0fc7d0 msgr2=0x7f767c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 shutdown_connections 2024-09-12T01:56:56.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:56.636+0000 7f7681e95640 1 -- 172.21.15.39:0/1668013188 wait complete. 2024-09-12T01:56:56.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:56 smithi044 ceph-mon[35259]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:56:56.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:56 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2776287204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:56:56.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:56 smithi172 ceph-mon[35073]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:56:56.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:56 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2776287204' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:56:57.429 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T01:56:57.430 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T01:56:57.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:57.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 -- 172.21.15.39:0/707389684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3168101c00 msgr2=0x7f3168102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 --2- 172.21.15.39:0/707389684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3168101c00 0x7f3168102080 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3158009900 tx=0x7f315802a410 comp rx=0 tx=0).stop 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 -- 172.21.15.39:0/707389684 shutdown_connections 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 --2- 172.21.15.39:0/707389684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31681025c0 0x7f3168108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 --2- 172.21.15.39:0/707389684 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3168101c00 0x7f3168102080 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 --2- 172.21.15.39:0/707389684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168100a10 0x7f3168100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.540+0000 7f316ff13640 1 -- 172.21.15.39:0/707389684 >> 172.21.15.39:0/707389684 conn(0x7f31680fc170 msgr2=0x7f31680fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.541+0000 7f316ff13640 1 -- 172.21.15.39:0/707389684 shutdown_connections 2024-09-12T01:56:57.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.541+0000 7f316ff13640 1 -- 172.21.15.39:0/707389684 wait complete. 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.541+0000 7f316ff13640 1 Processor -- start 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.541+0000 7f316ff13640 1 -- start start 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3168100a10 0x7f316819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168101c00 0x7f316819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f316810d7e0 con 0x7f31681025c0 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f316810d660 con 0x7f3168100a10 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316ff13640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f316810d960 con 0x7f3168101c00 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316d4ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168101c00 0x7f316819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49498/0 (socket says 172.21.15.39:49498) 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 -- 172.21.15.39:0/1733074048 learned_addr learned my addr 172.21.15.39:0/1733074048 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316dcaf640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3168100a10 0x7f316819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 -- 172.21.15.39:0/1733074048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168101c00 msgr2=0x7f316819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168101c00 0x7f316819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 -- 172.21.15.39:0/1733074048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3168100a10 msgr2=0x7f316819e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3168100a10 0x7f316819e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.542+0000 7f316e4b0640 1 -- 172.21.15.39:0/1733074048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31681a6060 con 0x7f31681025c0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f316e4b0640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f316000eb10 tx=0x7f316000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160004b20 con 0x7f31681025c0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3160004cc0 con 0x7f31681025c0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31681a6350 con 0x7f31681025c0 2024-09-12T01:56:57.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160010760 con 0x7f31681025c0 2024-09-12T01:56:57.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.543+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31681a6820 con 0x7f31681025c0 2024-09-12T01:56:57.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.544+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31681a6ae0 con 0x7f31681025c0 2024-09-12T01:56:57.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.545+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3160005020 con 0x7f31681025c0 2024-09-12T01:56:57.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.546+0000 7f315effd640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 0x7f31540a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.546+0000 7f316dcaf640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 0x7f31540a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.546+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f31600cf5e0 con 0x7f31681025c0 2024-09-12T01:56:57.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.547+0000 7f316dcaf640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 0x7f31540a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3168101a60 tx=0x7f3164005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.550+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f316009c550 con 0x7f31681025c0 2024-09-12T01:56:57.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:57 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1668013188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:57 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1668013188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.725+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31681a6cb0 con 0x7f31540a2b90 2024-09-12T01:56:57.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.731+0000 7f315effd640 1 -- 172.21.15.39:0/1733074048 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258991 (secure 0 0 0) 0x7f31681a6cb0 con 0x7f31540a2b90 2024-09-12T01:56:57.734 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:57.735 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 msgr2=0x7f31540a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 0x7f31540a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3168101a60 tx=0x7f3164005f90 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 msgr2=0x7f31681a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f316000eb10 tx=0x7f316000c2d0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 shutdown_connections 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31681025c0 0x7f31681a59f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f31540a2b90 0x7f31540a5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3168101c00 0x7f316819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 --2- 172.21.15.39:0/1733074048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3168100a10 0x7f316819e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 >> 172.21.15.39:0/1733074048 conn(0x7f31680fc170 msgr2=0x7f3168109810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 shutdown_connections 2024-09-12T01:56:57.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.734+0000 7f316ff13640 1 -- 172.21.15.39:0/1733074048 wait complete. 2024-09-12T01:56:57.745 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-12T01:56:57.264516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656475,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":744,"num_read_kb":488,"num_write":356,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360288,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581536,"statfs":{"total":1151940427776,"available":1151571492864,"internally_reserved":0,"allocated":11304960,"data_stored":7223729,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003058"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:52.813210+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:52.813210+0000","last_peered":"2024-09-12T01:56:52.813210+0000","last_clean":"2024-09-12T01:56:52.813210+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:52.813210+0000","last_undegraded":"2024-09-12T01:56:52.813210+0000","last_fullsized":"2024-09-12T01:56:52.813210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.813967+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:53.813967+0000","last_peered":"2024-09-12T01:56:53.813967+0000","last_clean":"2024-09-12T01:56:53.813967+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:53.813967+0000","last_undegraded":"2024-09-12T01:56:53.813967+0000","last_fullsized":"2024-09-12T01:56:53.813967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":263,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.815826+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:54.815826+0000","last_peered":"2024-09-12T01:56:54.815826+0000","last_clean":"2024-09-12T01:56:54.815826+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:54.815826+0000","last_undegraded":"2024-09-12T01:56:54.815826+0000","last_fullsized":"2024-09-12T01:56:54.815826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":163,"num_write":35,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.846169+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:53.846169+0000","last_peered":"2024-09-12T01:56:53.846169+0000","last_clean":"2024-09-12T01:56:53.846169+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:53.846169+0000","last_undegraded":"2024-09-12T01:56:53.846169+0000","last_fullsized":"2024-09-12T01:56:53.846169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.847176+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:54.847176+0000","last_peered":"2024-09-12T01:56:54.847176+0000","last_clean":"2024-09-12T01:56:54.847176+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:54.847176+0000","last_undegraded":"2024-09-12T01:56:54.847176+0000","last_fullsized":"2024-09-12T01:56:54.847176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65873,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":618,"num_read_kb":379,"num_write":173,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1091702,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234035,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":501103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:57.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:57.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:57 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1668013188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 -- 172.21.15.39:0/1643892752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244100a10 msgr2=0x7fb244100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 --2- 172.21.15.39:0/1643892752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244100a10 0x7fb244100e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb234009900 tx=0x7fb23402a410 comp rx=0 tx=0).stop 2024-09-12T01:56:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 -- 172.21.15.39:0/1643892752 shutdown_connections 2024-09-12T01:56:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 --2- 172.21.15.39:0/1643892752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 0x7fb244108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 --2- 172.21.15.39:0/1643892752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244101c00 0x7fb244102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 --2- 172.21.15.39:0/1643892752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244100a10 0x7fb244100e10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 -- 172.21.15.39:0/1643892752 >> 172.21.15.39:0/1643892752 conn(0x7fb2440fc170 msgr2=0x7fb2440fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 -- 172.21.15.39:0/1643892752 shutdown_connections 2024-09-12T01:56:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.889+0000 7fb24925e640 1 -- 172.21.15.39:0/1643892752 wait complete. 2024-09-12T01:56:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 Processor -- start 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 -- start start 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244100a10 0x7fb244069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 0x7fb24419f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c670 con 0x7fb244101c00 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c4f0 con 0x7fb244100a10 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24925e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c7f0 con 0x7fb2441025c0 2024-09-12T01:56:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49522/0 (socket says 172.21.15.39:49522) 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 -- 172.21.15.39:0/514972171 learned_addr learned my addr 172.21.15.39:0/514972171 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24359e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 0x7fb24419f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb242d9d640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244100a10 0x7fb244069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 -- 172.21.15.39:0/514972171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 msgr2=0x7fb24419f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 0x7fb24419f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 -- 172.21.15.39:0/514972171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244100a10 msgr2=0x7fb244069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244100a10 0x7fb244069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.890+0000 7fb24259c640 1 -- 172.21.15.39:0/514972171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24419f9f0 con 0x7fb244101c00 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb24259c640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb23800d950 tx=0x7fb23800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238017070 con 0x7fb244101c00 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb238009c30 con 0x7fb244101c00 2024-09-12T01:56:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24419fce0 con 0x7fb244101c00 2024-09-12T01:56:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23800f6b0 con 0x7fb244101c00 2024-09-12T01:56:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.891+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2441a0220 con 0x7fb244101c00 2024-09-12T01:56:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.892+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb244107e50 con 0x7fb244101c00 2024-09-12T01:56:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.893+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb2380109d0 con 0x7fb244101c00 2024-09-12T01:56:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.894+0000 7fb22bfff640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 0x7fb22c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.894+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb2380cec70 con 0x7fb244101c00 2024-09-12T01:56:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.894+0000 7fb242d9d640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 0x7fb22c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.894+0000 7fb242d9d640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 0x7fb22c0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb234006010 tx=0x7fb234000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:57.898+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb238009de0 con 0x7fb244101c00 2024-09-12T01:56:58.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.073+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb244062630 con 0x7fb22c0a2c10 2024-09-12T01:56:58.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.079+0000 7fb22bfff640 1 -- 172.21.15.39:0/514972171 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258991 (secure 0 0 0) 0x7fb244062630 con 0x7fb22c0a2c10 2024-09-12T01:56:58.082 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:58.083 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 msgr2=0x7fb22c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 0x7fb22c0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb234006010 tx=0x7fb234000bc0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 msgr2=0x7fb24419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb23800d950 tx=0x7fb23800de10 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 shutdown_connections 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb22c0a2c10 0x7fb22c0a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2441025c0 0x7fb24419f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb244101c00 0x7fb24419cae0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 --2- 172.21.15.39:0/514972171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb244100a10 0x7fb244069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 >> 172.21.15.39:0/514972171 conn(0x7fb2440fc170 msgr2=0x7fb244105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 shutdown_connections 2024-09-12T01:56:58.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.083+0000 7fb24925e640 1 -- 172.21.15.39:0/514972171 wait complete. 2024-09-12T01:56:58.094 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-12T01:56:57.264516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656475,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":744,"num_read_kb":488,"num_write":356,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360288,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581536,"statfs":{"total":1151940427776,"available":1151571492864,"internally_reserved":0,"allocated":11304960,"data_stored":7223729,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003058"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:52.813210+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:52.813210+0000","last_peered":"2024-09-12T01:56:52.813210+0000","last_clean":"2024-09-12T01:56:52.813210+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:52.813210+0000","last_undegraded":"2024-09-12T01:56:52.813210+0000","last_fullsized":"2024-09-12T01:56:52.813210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.813967+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:53.813967+0000","last_peered":"2024-09-12T01:56:53.813967+0000","last_clean":"2024-09-12T01:56:53.813967+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:53.813967+0000","last_undegraded":"2024-09-12T01:56:53.813967+0000","last_fullsized":"2024-09-12T01:56:53.813967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":263,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.815826+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:54.815826+0000","last_peered":"2024-09-12T01:56:54.815826+0000","last_clean":"2024-09-12T01:56:54.815826+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:54.815826+0000","last_undegraded":"2024-09-12T01:56:54.815826+0000","last_fullsized":"2024-09-12T01:56:54.815826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":163,"num_write":35,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.846169+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:53.846169+0000","last_peered":"2024-09-12T01:56:53.846169+0000","last_clean":"2024-09-12T01:56:53.846169+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:53.846169+0000","last_undegraded":"2024-09-12T01:56:53.846169+0000","last_fullsized":"2024-09-12T01:56:53.846169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.847176+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:54.847176+0000","last_peered":"2024-09-12T01:56:54.847176+0000","last_clean":"2024-09-12T01:56:54.847176+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:54.847176+0000","last_undegraded":"2024-09-12T01:56:54.847176+0000","last_fullsized":"2024-09-12T01:56:54.847176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65873,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":618,"num_read_kb":379,"num_write":173,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1091702,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234035,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":501103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:58.098 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T01:56:58.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:56:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 -- 172.21.15.39:0/2956244392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c104ee0 msgr2=0x7fc62c1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 --2- 172.21.15.39:0/2956244392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c104ee0 0x7fc62c1072d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc620009900 tx=0x7fc62002a410 comp rx=0 tx=0).stop 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 -- 172.21.15.39:0/2956244392 shutdown_connections 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 --2- 172.21.15.39:0/2956244392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c107810 0x7fc62c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 --2- 172.21.15.39:0/2956244392 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c104ee0 0x7fc62c1072d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 --2- 172.21.15.39:0/2956244392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 0x7fc62c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 -- 172.21.15.39:0/2956244392 >> 172.21.15.39:0/2956244392 conn(0x7fc62c0fc190 msgr2=0x7fc62c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 -- 172.21.15.39:0/2956244392 shutdown_connections 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.238+0000 7fc6329d8640 1 -- 172.21.15.39:0/2956244392 wait complete. 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 Processor -- start 2024-09-12T01:56:58.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 -- start start 2024-09-12T01:56:58.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 0x7fc62c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 0x7fc62c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c10d7e0 con 0x7fc62c107810 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c10d660 con 0x7fc62c104ee0 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc6329d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c10d960 con 0x7fc62c1025b0 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc630f75640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc630f75640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49536/0 (socket says 172.21.15.39:49536) 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc630f75640 1 -- 172.21.15.39:0/1655255007 learned_addr learned my addr 172.21.15.39:0/1655255007 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc62bfff640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 0x7fc62c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.239+0000 7fc62b7fe640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 0x7fc62c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 -- 172.21.15.39:0/1655255007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 msgr2=0x7fc62c197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 0x7fc62c197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 -- 172.21.15.39:0/1655255007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 msgr2=0x7fc62c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 0x7fc62c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 -- 172.21.15.39:0/1655255007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c19fb30 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc62b7fe640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 0x7fc62c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc630f75640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc62400ccb0 tx=0x7fc62400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62400f450 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62400fad0 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c19fe20 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624018bf0 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.240+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c1a0290 con 0x7fc62c107810 2024-09-12T01:56:58.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.241+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62c0fdc80 con 0x7fc62c107810 2024-09-12T01:56:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.242+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc62400f5f0 con 0x7fc62c107810 2024-09-12T01:56:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.243+0000 7fc6297fa640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 0x7fc6140a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.243+0000 7fc62bfff640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 0x7fc6140a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.243+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6240cf790 con 0x7fc62c107810 2024-09-12T01:56:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.244+0000 7fc62bfff640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 0x7fc6140a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0058c0 tx=0x7fc61c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:58.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.247+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc624014030 con 0x7fc62c107810 2024-09-12T01:56:58.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.421+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc62c062630 con 0x7fc6140a2b90 2024-09-12T01:56:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.427+0000 7fc6297fa640 1 -- 172.21.15.39:0/1655255007 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258991 (secure 0 0 0) 0x7fc62c062630 con 0x7fc6140a2b90 2024-09-12T01:56:58.430 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:58.431 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.430+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 msgr2=0x7fc6140a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.430+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 0x7fc6140a5050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0058c0 tx=0x7fc61c00a250 comp rx=0 tx=0).stop 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.430+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 msgr2=0x7fc62c19f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.430+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc62400ccb0 tx=0x7fc62400a620 comp rx=0 tx=0).stop 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 shutdown_connections 2024-09-12T01:56:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc62c107810 0x7fc62c19f4c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc62c104ee0 0x7fc62c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc6140a2b90 0x7fc6140a5050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 --2- 172.21.15.39:0/1655255007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c1025b0 0x7fc62c197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 >> 172.21.15.39:0/1655255007 conn(0x7fc62c0fc190 msgr2=0x7fc62c102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 shutdown_connections 2024-09-12T01:56:58.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:58.431+0000 7fc6329d8640 1 -- 172.21.15.39:0/1655255007 wait complete. 2024-09-12T01:56:58.441 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-12T01:56:57.264516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656475,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":744,"num_read_kb":488,"num_write":356,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360288,"kb_used_data":11040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581536,"statfs":{"total":1151940427776,"available":1151571492864,"internally_reserved":0,"allocated":11304960,"data_stored":7223729,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003058"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:52.813210+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:52.813210+0000","last_peered":"2024-09-12T01:56:52.813210+0000","last_clean":"2024-09-12T01:56:52.813210+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:52.813210+0000","last_undegraded":"2024-09-12T01:56:52.813210+0000","last_fullsized":"2024-09-12T01:56:52.813210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.813967+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:53.813967+0000","last_peered":"2024-09-12T01:56:53.813967+0000","last_clean":"2024-09-12T01:56:53.813967+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:53.813967+0000","last_undegraded":"2024-09-12T01:56:53.813967+0000","last_fullsized":"2024-09-12T01:56:53.813967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":263,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.815826+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:54.815826+0000","last_peered":"2024-09-12T01:56:54.815826+0000","last_clean":"2024-09-12T01:56:54.815826+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:54.815826+0000","last_undegraded":"2024-09-12T01:56:54.815826+0000","last_fullsized":"2024-09-12T01:56:54.815826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":163,"num_write":35,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:53.846169+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:53.846169+0000","last_peered":"2024-09-12T01:56:53.846169+0000","last_clean":"2024-09-12T01:56:53.846169+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:53.846169+0000","last_undegraded":"2024-09-12T01:56:53.846169+0000","last_fullsized":"2024-09-12T01:56:53.846169+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":125,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:54.847176+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:54.847176+0000","last_peered":"2024-09-12T01:56:54.847176+0000","last_clean":"2024-09-12T01:56:54.847176+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:54.847176+0000","last_undegraded":"2024-09-12T01:56:54.847176+0000","last_fullsized":"2024-09-12T01:56:54.847176+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65873,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":618,"num_read_kb":379,"num_write":173,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1091702,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234035,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495672,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":501103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":499443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:56:58.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:58.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:58 smithi039 ceph-mon[31204]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:56:58.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:58 smithi039 ceph-mon[31204]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:58.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:58 smithi044 ceph-mon[35259]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:56:58.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:58 smithi044 ceph-mon[35259]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:58.736 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:58 smithi172 ceph-mon[35073]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:56:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:58 smithi172 ceph-mon[35073]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 -- 172.21.15.39:0/335461581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 msgr2=0x7f23981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 --2- 172.21.15.39:0/335461581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981067e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f238c009900 tx=0x7f238c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 -- 172.21.15.39:0/335461581 shutdown_connections 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 --2- 172.21.15.39:0/335461581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 --2- 172.21.15.39:0/335461581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981067e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 --2- 172.21.15.39:0/335461581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 0x7f23981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 -- 172.21.15.39:0/335461581 >> 172.21.15.39:0/335461581 conn(0x7f23980fd8c0 msgr2=0x7f23980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 -- 172.21.15.39:0/335461581 shutdown_connections 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.233+0000 7f239fec5640 1 -- 172.21.15.39:0/335461581 wait complete. 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 Processor -- start 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 -- start start 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 0x7f2398198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111fe0 con 0x7f2398102790 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2398111e60 con 0x7f2398106f10 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239fec5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2398112160 con 0x7f2398101de0 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239d460640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239d460640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49554/0 (socket says 172.21.15.39:49554) 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239d460640 1 -- 172.21.15.39:0/2614633557 learned_addr learned my addr 172.21.15.39:0/2614633557 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239e462640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.234+0000 7f239dc61640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 0x7f2398198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 -- 172.21.15.39:0/2614633557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 msgr2=0x7f2398198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 0x7f2398198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 -- 172.21.15.39:0/2614633557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 msgr2=0x7f239819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 -- 172.21.15.39:0/2614633557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819d410 con 0x7f2398102790 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239e462640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239d460640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f238c006010 tx=0x7f238c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c03f070 con 0x7f2398102790 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f238c031c90 con 0x7f2398102790 2024-09-12T01:56:59.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819d6a0 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c035030 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.235+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981a4fe0 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.236+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23981021c0 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.237+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f238c042070 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.238+0000 7f238affd640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 0x7f23840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.238+0000 7f239dc61640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 0x7f23840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.238+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f238c0efdc0 con 0x7f2398102790 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.238+0000 7f239dc61640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 0x7f23840a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2394009890 tx=0x7f2394008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.241+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f238c0bcd30 con 0x7f2398102790 2024-09-12T01:56:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:59 smithi039 ceph-mon[31204]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:56:59 smithi039 ceph-mon[31204]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.456+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23981997c0 con 0x7f2398102790 2024-09-12T01:56:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.457+0000 7f238affd640 1 -- 172.21.15.39:0/2614633557 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f23981997c0 con 0x7f2398102790 2024-09-12T01:56:59.457 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:56:59.457 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:56:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.459+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 msgr2=0x7f23840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.459+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 0x7f23840a50c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2394009890 tx=0x7f2394008040 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.459+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 msgr2=0x7f23981989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f238c006010 tx=0x7f238c003ba0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 shutdown_connections 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2398106f10 0x7f239819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2398102790 0x7f23981989a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f23840a2c00 0x7f23840a50c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 --2- 172.21.15.39:0/2614633557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2398101de0 0x7f2398198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 >> 172.21.15.39:0/2614633557 conn(0x7f23980fd8c0 msgr2=0x7f23980fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 shutdown_connections 2024-09-12T01:56:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:56:59.460+0000 7f239fec5640 1 -- 172.21.15.39:0/2614633557 wait complete. 2024-09-12T01:56:59.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:59 smithi044 ceph-mon[35259]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:56:59 smithi044 ceph-mon[35259]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:59 smithi172 ceph-mon[35073]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:56:59.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:56:59 smithi172 ceph-mon[35073]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:00.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:00.502 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:00.623 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:00 smithi039 ceph-mon[31204]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:57:00.624 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2614633557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:00.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:00 smithi044 ceph-mon[35259]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:57:00.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:00 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2614633557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:00 smithi172 ceph-mon[35073]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-12T01:57:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:00 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2614633557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- 172.21.15.39:0/3472828484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 msgr2=0x7feeb4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 --2- 172.21.15.39:0/3472828484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4100ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feea4009930 tx=0x7feea402a420 comp rx=0 tx=0).stop 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- 172.21.15.39:0/3472828484 shutdown_connections 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 --2- 172.21.15.39:0/3472828484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4101420 0x7feeb410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 --2- 172.21.15.39:0/3472828484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4100ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 --2- 172.21.15.39:0/3472828484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4106a80 0x7feeb4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- 172.21.15.39:0/3472828484 >> 172.21.15.39:0/3472828484 conn(0x7feeb40fc7a0 msgr2=0x7feeb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- 172.21.15.39:0/3472828484 shutdown_connections 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- 172.21.15.39:0/3472828484 wait complete. 2024-09-12T01:57:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 Processor -- start 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.053+0000 7feebb43c640 1 -- start start 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4101420 0x7feeb4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 0x7feeb41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4110e80 con 0x7feeb4100a80 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4110d00 con 0x7feeb4106a80 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feebb43c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feeb4111000 con 0x7feeb4101420 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49570/0 (socket says 172.21.15.39:49570) 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 -- 172.21.15.39:0/3250527737 learned_addr learned my addr 172.21.15.39:0/3250527737 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb89d7640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4101420 0x7feeb4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb99d9640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 0x7feeb41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 -- 172.21.15.39:0/3250527737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4101420 msgr2=0x7feeb4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4101420 0x7feeb4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 -- 172.21.15.39:0/3250527737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 msgr2=0x7feeb41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 0x7feeb41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 -- 172.21.15.39:0/3250527737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb41a48d0 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb99d9640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 0x7feeb41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeb91d8640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d770 tx=0x7feeb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.054+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0017070 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.055+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb0005500 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.055+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb41a4aa0 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.055+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0004e00 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.055+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb41a4f60 con 0x7feeb4100a80 2024-09-12T01:57:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.056+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb4100ee0 con 0x7feeb4100a80 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.057+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feeb0004fa0 con 0x7feeb4100a80 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.057+0000 7feeaa7fc640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 0x7feea00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.058+0000 7feeb89d7640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 0x7feea00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.058+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feeb00ce9f0 con 0x7feeb4100a80 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.058+0000 7feeb89d7640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 0x7feea00a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feea4009900 tx=0x7feea40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.062+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feeb009b900 con 0x7feeb4100a80 2024-09-12T01:57:01.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.238+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feeb4109020 con 0x7feeb4100a80 2024-09-12T01:57:01.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.240+0000 7feeaa7fc640 1 -- 172.21.15.39:0/3250527737 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22679 (secure 0 0 0) 0x7feeb009b200 con 0x7feeb4100a80 2024-09-12T01:57:01.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:01.240 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":82,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:56:04.883161+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 msgr2=0x7feea00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 0x7feea00a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feea4009900 tx=0x7feea40058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 msgr2=0x7feeb4199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d770 tx=0x7feeb000dc30 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 shutdown_connections 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feeb4106a80 0x7feeb41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7feea00a2c00 0x7feea00a50c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb4101420 0x7feeb4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.242+0000 7feebb43c640 1 --2- 172.21.15.39:0/3250527737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feeb4100a80 0x7feeb4199310 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.243+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 >> 172.21.15.39:0/3250527737 conn(0x7feeb40fc7a0 msgr2=0x7feeb40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:01.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.243+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 shutdown_connections 2024-09-12T01:57:01.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:01.243+0000 7feebb43c640 1 -- 172.21.15.39:0/3250527737 wait complete. 2024-09-12T01:57:01.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:01 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3250527737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:01 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3250527737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:01.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:01 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3250527737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:02.130 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T01:57:02.130 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T01:57:02.140 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T01:57:02.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T01:57:02.140 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T01:57:02.140 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:57:02.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:57:02.142 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T01:57:03.441 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:57:03.442 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:57:03.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:02 smithi172 ceph-mon[35073]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:03.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:02 smithi044 ceph-mon[35259]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:03.444 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:03.444 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:02 smithi039 ceph-mon[31204]: pgmap v341: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 -- 172.21.15.39:0/1656761321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 msgr2=0x7f653c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 --2- 172.21.15.39:0/1656761321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c1067e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f652c009900 tx=0x7f652c02a410 comp rx=0 tx=0).stop 2024-09-12T01:57:03.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 -- 172.21.15.39:0/1656761321 shutdown_connections 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 --2- 172.21.15.39:0/1656761321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c106f10 0x7f653c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 --2- 172.21.15.39:0/1656761321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c1067e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 --2- 172.21.15.39:0/1656761321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c101de0 0x7f653c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 -- 172.21.15.39:0/1656761321 >> 172.21.15.39:0/1656761321 conn(0x7f653c0fd8c0 msgr2=0x7f653c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 -- 172.21.15.39:0/1656761321 shutdown_connections 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.864+0000 7f65444d8640 1 -- 172.21.15.39:0/1656761321 wait complete. 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 Processor -- start 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 -- start start 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 0x7f653c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c106f10 0x7f653c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f653c111f70 con 0x7f653c102790 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f653c111df0 con 0x7f653c101de0 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f65444d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1120f0 con 0x7f653c106f10 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43154/0 (socket says 172.21.15.39:43154) 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 -- 172.21.15.39:0/2669887452 learned_addr learned my addr 172.21.15.39:0/2669887452 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6542274640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 0x7f653c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 -- 172.21.15.39:0/2669887452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c106f10 msgr2=0x7f653c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c106f10 0x7f653c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 -- 172.21.15.39:0/2669887452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 msgr2=0x7f653c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.865+0000 7f6541a73640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 0x7f653c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f6541a73640 1 -- 172.21.15.39:0/2669887452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c19f6c0 con 0x7f653c102790 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f6542274640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 0x7f653c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f6541a73640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f652c006010 tx=0x7f652c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f65337fe640 1 -- 172.21.15.39:0/2669887452 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c03f030 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c19f950 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f65337fe640 1 -- 172.21.15.39:0/2669887452 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f652c004440 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f65337fe640 1 -- 172.21.15.39:0/2669887452 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c035070 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.866+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1a7290 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.868+0000 7f65337fe640 1 -- 172.21.15.39:0/2669887452 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f652c042030 con 0x7f653c102790 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.868+0000 7f65468b1740 1 Processor -- start 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 -- start start 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b00f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b0e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cad6a66280 con 0x55cad6b01480 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cad6a0db10 con 0x55cad6b0bd40 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65468b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cad6a62240 con 0x55cad6b00b60 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65337fe640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 0x7f65280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43162/0 (socket says 172.21.15.39:43162) 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 -- 172.21.15.39:0/2436882668 learned_addr learned my addr 172.21.15.39:0/2436882668 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542a75640 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b00f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542a75640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 0x7f65280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f65337fe640 1 -- 172.21.15.39:0/2669887452 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f652c0ef4e0 con 0x7f653c102790 2024-09-12T01:57:03.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6541a73640 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b0e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 -- 172.21.15.39:0/2436882668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 msgr2=0x55cad6b00f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b00f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 -- 172.21.15.39:0/2436882668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 msgr2=0x55cad6b0e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b0e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.869+0000 7f6542274640 1 -- 172.21.15.39:0/2436882668 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad6a1a1f0 con 0x55cad6b01480 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.870+0000 7f6542274640 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d40 tx=0x7f65380117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efce3754d7f045b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.870+0000 7f6542a75640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 0x7f65280a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6534005fd0 tx=0x7f6534004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.870+0000 7f6530ff9640 1 -- 172.21.15.39:0/2436882668 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538012650 con 0x55cad6b01480 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.870+0000 7f6530ff9640 1 -- 172.21.15.39:0/2436882668 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6538009e30 con 0x55cad6b01480 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.870+0000 7f6530ff9640 1 -- 172.21.15.39:0/2436882668 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653800fca0 con 0x55cad6b01480 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- 172.21.15.39:0/2436882668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 msgr2=0x55cad6b0b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d40 tx=0x7f65380117b0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- 172.21.15.39:0/2436882668 shutdown_connections 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b0e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b0b800 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 --2- 172.21.15.39:0/2436882668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b00f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- 172.21.15.39:0/2436882668 >> 172.21.15.39:0/2436882668 conn(0x55cad6afd0f0 msgr2=0x55cad6afd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- 172.21.15.39:0/2436882668 shutdown_connections 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- 172.21.15.39:0/2436882668 wait complete. 2024-09-12T01:57:03.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 -- start start 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.871+0000 7f65468b1740 1 Processor -- start 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 0x55cad6b08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 0x55cad6b095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cad6b0e910 con 0x55cad6b01480 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cad6a20f10 con 0x55cad6b00b60 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cad6b0ea90 con 0x55cad6b0bd40 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f65468b1740 10 client.0 _ll_register_callbacks cb 0x55cad69e9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43178/0 (socket says 172.21.15.39:43178) 2024-09-12T01:57:03.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 -- 172.21.15.39:0/365338023 learned_addr learned my addr 172.21.15.39:0/365338023 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6542274640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 0x55cad6b08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6542a75640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 0x55cad6b095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 -- 172.21.15.39:0/365338023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 msgr2=0x55cad6b095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 0x55cad6b095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 -- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 msgr2=0x55cad6b08b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 0x55cad6b08b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 -- 172.21.15.39:0/365338023 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad67d76a0 con 0x55cad6b01480 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6542a75640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 0x55cad6b095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6542274640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 0x55cad6b08b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6541a73640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f652c000c00 tx=0x7f652c0bb950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c628dbba338168 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:03.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.872+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c049070 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f652c0b83c0 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6538009e30 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f652c0c0100 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 10 client.15222 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad6b1a3d0 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6538009e30 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f652c0ef0b0 con 0x55cad6b01480 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 10 client.15222 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:03.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 10 client.15222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 20 client.15222 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b1b8d0 0x55cad6b1dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 4 client.15222 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.873+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad6a737f0 con 0x55cad6b1b8d0 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.874+0000 7f6542274640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b1b8d0 0x55cad6b1dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.874+0000 7f6542274640 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b1b8d0 0x55cad6b1dce0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adf435a0401e9d3 server_cookie=3df510aad05f1548 in_seq=0 out_seq=0 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.874+0000 7f6525ffb640 10 client.15222 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f6525ffb640 1 -- 172.21.15.39:0/365338023 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cad6a737f0 con 0x55cad6b1b8d0 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f6525ffb640 10 client.15222 handle_command_reply: tid=0 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 client.15222 shutdown 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 msgr2=0x55cad6b090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f652c000c00 tx=0x7f652c0bb950 comp rx=0 tx=0).stop 2024-09-12T01:57:03.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 shutdown_connections 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b1b8d0 0x55cad6b1dce0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b0bd40 0x55cad6b095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b090b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 --2- 172.21.15.39:0/365338023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b00b60 0x55cad6b08b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 >> 172.21.15.39:0/365338023 conn(0x55cad6afd0f0 msgr2=0x55cad6afc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f6525ffb640 0 client.15222 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 shutdown_connections 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 1 -- 172.21.15.39:0/365338023 wait complete. 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.875+0000 7f65468b1740 20 client.15222 trim_cache size 0 max 16384 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.892+0000 7f65468b1740 1 Processor -- start 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.892+0000 7f65468b1740 1 -- start start 2024-09-12T01:57:03.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 0x55cad6b23550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1b1fe0 con 0x55cad6b0bd40 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1af8b0 con 0x55cad6b01480 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f65468b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1ad700 con 0x55cad6b00b60 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43180/0 (socket says 172.21.15.39:43180) 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 -- 172.21.15.39:0/1153094 learned_addr learned my addr 172.21.15.39:0/1153094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6541a73640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 0x55cad6b23550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542274640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 -- 172.21.15.39:0/1153094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 msgr2=0x55cad6b0a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 -- 172.21.15.39:0/1153094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 msgr2=0x55cad6b23550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 0x55cad6b23550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 -- 172.21.15.39:0/1153094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad6b07b20 con 0x55cad6b0bd40 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542274640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6541a73640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 0x55cad6b23550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6542a75640 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6534013070 tx=0x7f6534015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2714c1f2eb4221e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6527fff640 1 -- 172.21.15.39:0/1153094 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534010a50 con 0x55cad6b0bd40 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6527fff640 1 -- 172.21.15.39:0/1153094 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6534027070 con 0x55cad6b0bd40 2024-09-12T01:57:03.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.893+0000 7f6527fff640 1 -- 172.21.15.39:0/1153094 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534022480 con 0x55cad6b0bd40 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- 172.21.15.39:0/1153094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 msgr2=0x55cad6b23a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6534013070 tx=0x7f6534015070 comp rx=0 tx=0).stop 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- 172.21.15.39:0/1153094 shutdown_connections 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b0bd40 0x55cad6b23a90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b01480 0x55cad6b23550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 --2- 172.21.15.39:0/1153094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- 172.21.15.39:0/1153094 >> 172.21.15.39:0/1153094 conn(0x55cad6afd0f0 msgr2=0x55cad6b0a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- 172.21.15.39:0/1153094 shutdown_connections 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- 172.21.15.39:0/1153094 wait complete. 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 -- start start 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.894+0000 7f65468b1740 1 Processor -- start 2024-09-12T01:57:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1add70 con 0x55cad6b01480 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1af1e0 con 0x55cad6b0bd40 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1ae440 con 0x55cad6b00b60 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f65468b1740 10 client.0 _ll_register_callbacks cb 0x7f652c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43186/0 (socket says 172.21.15.39:43186) 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 -- 172.21.15.39:0/398067350 learned_addr learned my addr 172.21.15.39:0/398067350 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6542a75640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6542274640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 -- 172.21.15.39:0/398067350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 msgr2=0x55cad6b0fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 -- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 msgr2=0x55cad6b10770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b10770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 -- 172.21.15.39:0/398067350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad6b85770 con 0x55cad6b01480 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6542274640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6541a73640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f652c0bc330 tx=0x7f652c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed922fb27ab40e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c049040 con 0x55cad6b01480 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.895+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f652c003cd0 con 0x55cad6b01480 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6534027070 con 0x55cad6b01480 2024-09-12T01:57:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f652c0b7ff0 con 0x55cad6b01480 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 10 client.15228 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cad6b86a20 con 0x55cad6b01480 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6534027070 con 0x55cad6b01480 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f652c031b50 con 0x55cad6b01480 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 10 client.15228 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 10 client.15228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 20 client.15228 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b86fe0 0x55cad6b89400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 4 client.15228 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:57:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cad6a6dd00 con 0x55cad6b86fe0 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.896+0000 7f6542274640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b86fe0 0x55cad6b89400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.897+0000 7f6542274640 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b86fe0 0x55cad6b89400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38ce0401d79d7cb server_cookie=45b36652f3395b16 in_seq=0 out_seq=0 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.897+0000 7f6525ffb640 10 client.15228 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f6525ffb640 1 -- 172.21.15.39:0/398067350 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cad6a6dd00 con 0x55cad6b86fe0 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f6525ffb640 10 client.15228 handle_command_reply: tid=0 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 client.15228 shutdown 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 msgr2=0x55cad6b10230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f652c0bc330 tx=0x7f652c009560 comp rx=0 tx=0).stop 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 shutdown_connections 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55cad6b86fe0 0x55cad6b89400 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cad6b0bd40 0x55cad6b10770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cad6b01480 0x55cad6b10230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 --2- 172.21.15.39:0/398067350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cad6b00b60 0x55cad6b0fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 >> 172.21.15.39:0/398067350 conn(0x55cad6afd0f0 msgr2=0x55cad6afc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.898+0000 7f6525ffb640 0 client.15228 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 shutdown_connections 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65468b1740 1 -- 172.21.15.39:0/398067350 wait complete. 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65468b1740 20 client.15228 trim_cache size 0 max 16384 2024-09-12T01:57:03.472 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:03.473 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-12T01:57:03.473 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "7a24c54b-552d-41f3-b933-43f3ce6ee4b0", 2024-09-12T01:57:03.473 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-12T01:57:03.473 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 msgr2=0x7f65280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 0x7f65280a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6534005fd0 tx=0x7f6534004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 msgr2=0x7f653c19ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f652c006010 tx=0x7f652c004040 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 shutdown_connections 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f65280a2b80 0x7f65280a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c106f10 0x7f653c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f653c102790 0x7f653c19ac50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 --2- 172.21.15.39:0/2669887452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f653c101de0 0x7f653c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 >> 172.21.15.39:0/2669887452 conn(0x7f653c0fd8c0 msgr2=0x7f653c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 shutdown_connections 2024-09-12T01:57:03.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:02.899+0000 7f65444d8640 1 -- 172.21.15.39:0/2669887452 wait complete. 2024-09-12T01:57:03.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:57:03.810 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:04.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 -- 172.21.15.39:0/2914256607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc8102da0 msgr2=0x7fbdc8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2914256607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc8102da0 0x7fbdc8103180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009900 tx=0x7fbdc402a480 comp rx=0 tx=0).stop 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 -- 172.21.15.39:0/2914256607 shutdown_connections 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2914256607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc810c180 0x7fbdc810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2914256607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2914256607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc8102da0 0x7fbdc8103180 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 -- 172.21.15.39:0/2914256607 >> 172.21.15.39:0/2914256607 conn(0x7fbdc80fc7a0 msgr2=0x7fbdc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 -- 172.21.15.39:0/2914256607 shutdown_connections 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.305+0000 7fbdcf755640 1 -- 172.21.15.39:0/2914256607 wait complete. 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 Processor -- start 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 -- start start 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc8102da0 0x7fbdc81a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc81a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc8112020 con 0x7fbdc810c180 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc8111ea0 con 0x7fbdc8102da0 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcf755640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc81121a0 con 0x7fbdc81036c0 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcdcf2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcdcf2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43214/0 (socket says 172.21.15.39:43214) 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcdcf2640 1 -- 172.21.15.39:0/2484981094 learned_addr learned my addr 172.21.15.39:0/2484981094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcd4f1640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc8102da0 0x7fbdc81a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.306+0000 7fbdcccf0640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc81a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 -- 172.21.15.39:0/2484981094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 msgr2=0x7fbdc81a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc81a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 -- 172.21.15.39:0/2484981094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc8102da0 msgr2=0x7fbdc81a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc8102da0 0x7fbdc81a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 -- 172.21.15.39:0/2484981094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc819ad00 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcccf0640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc81a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcdcf2640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000b970 tx=0x7fbdc000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0019070 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdc000cb40 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc819aff0 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0007650 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.307+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc81a72e0 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.308+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc8103200 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.309+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbdc001c070 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.310+0000 7fbdbe7fc640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 0x7fbdb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.310+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbdc00cead0 con 0x7fbdc810c180 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.310+0000 7fbdcd4f1640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 0x7fbdb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:04.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.311+0000 7fbdcd4f1640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 0x7fbdb40a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:04.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.313+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbdc009b3f0 con 0x7fbdc810c180 2024-09-12T01:57:04.362 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:04.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.499+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbdc8102120 con 0x7fbdb40a2b80 2024-09-12T01:57:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.505+0000 7fbdbe7fc640 1 -- 172.21.15.39:0/2484981094 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258996 (secure 0 0 0) 0x7fbdc8102120 con 0x7fbdb40a2b80 2024-09-12T01:57:04.507 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:04.508 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 msgr2=0x7fbdb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 0x7fbdb40a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc40058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 msgr2=0x7fbdc819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000b970 tx=0x7fbdc000be30 comp rx=0 tx=0).stop 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 shutdown_connections 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbdc810c180 0x7fbdc819a5d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbdb40a2b80 0x7fbdb40a5040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdc81036c0 0x7fbdc81a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 --2- 172.21.15.39:0/2484981094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbdc8102da0 0x7fbdc81a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:04.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.508+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 >> 172.21.15.39:0/2484981094 conn(0x7fbdc80fc7a0 msgr2=0x7fbdc8101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:04.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.509+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 shutdown_connections 2024-09-12T01:57:04.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:04.509+0000 7fbdcf755640 1 -- 172.21.15.39:0/2484981094 wait complete. 2024-09-12T01:57:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:04 smithi039 ceph-mon[31204]: scrub queued for path: / 2024-09-12T01:57:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:04 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:04 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:57:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:04 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:04.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:04 smithi039 ceph-mon[31204]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:57:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:04 smithi044 ceph-mon[35259]: scrub queued for path: / 2024-09-12T01:57:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:04 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:04 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:57:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:04 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:04.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:04 smithi044 ceph-mon[35259]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:57:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:04 smithi172 ceph-mon[35073]: scrub queued for path: / 2024-09-12T01:57:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:04 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:04 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:57:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:04 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:04 smithi172 ceph-mon[35073]: pgmap v342: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-12T01:57:05.412 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-12T01:57:03.265985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661848,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":775,"num_read_kb":509,"num_write":357,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360312,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581512,"statfs":{"total":1151940427776,"available":1151571468288,"internally_reserved":0,"allocated":11329536,"data_stored":7240464,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":42,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003061"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:57.821080+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:56:57.821080+0000","last_peered":"2024-09-12T01:56:57.821080+0000","last_clean":"2024-09-12T01:56:57.821080+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:56:57.821080+0000","last_undegraded":"2024-09-12T01:56:57.821080+0000","last_fullsized":"2024-09-12T01:56:57.821080+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":129,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:58.821663+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:56:58.821663+0000","last_peered":"2024-09-12T01:56:58.821663+0000","last_clean":"2024-09-12T01:56:58.821663+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:56:58.821663+0000","last_undegraded":"2024-09-12T01:56:58.821663+0000","last_fullsized":"2024-09-12T01:56:58.821663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'35","reported_seq":275,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:59.823671+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:56:59.823671+0000","last_peered":"2024-09-12T01:56:59.823671+0000","last_clean":"2024-09-12T01:56:59.823671+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:56:59.823671+0000","last_undegraded":"2024-09-12T01:56:59.823671+0000","last_fullsized":"2024-09-12T01:56:59.823671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67102,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":218,"num_read_kb":174,"num_write":36,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:58.855547+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:56:58.855547+0000","last_peered":"2024-09-12T01:56:58.855547+0000","last_clean":"2024-09-12T01:56:58.855547+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:56:58.855547+0000","last_undegraded":"2024-09-12T01:56:58.855547+0000","last_fullsized":"2024-09-12T01:56:58.855547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:59.856575+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:59.856575+0000","last_peered":"2024-09-12T01:56:59.856575+0000","last_clean":"2024-09-12T01:56:59.856575+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:59.856575+0000","last_undegraded":"2024-09-12T01:56:59.856575+0000","last_fullsized":"2024-09-12T01:56:59.856575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71246,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":649,"num_read_kb":400,"num_write":174,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1097075,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234036,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495673,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659198,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":506784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":505124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:05.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:57:05.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 -- 172.21.15.39:0/1280351402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc103740 msgr2=0x7fd3fc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 --2- 172.21.15.39:0/1280351402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc103740 0x7fd3fc107b80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009930 tx=0x7fd3ec02a420 comp rx=0 tx=0).stop 2024-09-12T01:57:05.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 -- 172.21.15.39:0/1280351402 shutdown_connections 2024-09-12T01:57:05.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 --2- 172.21.15.39:0/1280351402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 --2- 172.21.15.39:0/1280351402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc103740 0x7fd3fc107b80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 --2- 172.21.15.39:0/1280351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc102d90 0x7fd3fc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.613+0000 7fd403810640 1 -- 172.21.15.39:0/1280351402 >> 172.21.15.39:0/1280351402 conn(0x7fd3fc0fc7d0 msgr2=0x7fd3fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.614+0000 7fd403810640 1 -- 172.21.15.39:0/1280351402 shutdown_connections 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.614+0000 7fd403810640 1 -- 172.21.15.39:0/1280351402 wait complete. 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.614+0000 7fd403810640 1 Processor -- start 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 -- start start 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 0x7fd3fc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc112090 con 0x7fd3fc102d90 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc111f10 con 0x7fd3fc108290 2024-09-12T01:57:05.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd403810640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc112210 con 0x7fd3fc103740 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43232/0 (socket says 172.21.15.39:43232) 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 -- 172.21.15.39:0/3683340838 learned_addr learned my addr 172.21.15.39:0/3683340838 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd400dab640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 0x7fd3fc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd401dad640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 -- 172.21.15.39:0/3683340838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 msgr2=0x7fd3fc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 0x7fd3fc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 -- 172.21.15.39:0/3683340838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 msgr2=0x7fd3fc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 -- 172.21.15.39:0/3683340838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc19d600 con 0x7fd3fc102d90 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd400dab640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 0x7fd3fc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd401dad640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:05.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.615+0000 7fd4015ac640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800e9f0 tx=0x7fd3f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.616+0000 7fd3f27fc640 1 -- 172.21.15.39:0/3683340838 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800cd80 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.616+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3fc19d8f0 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.616+0000 7fd3f27fc640 1 -- 172.21.15.39:0/3683340838 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f8010910 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.616+0000 7fd3f27fc640 1 -- 172.21.15.39:0/3683340838 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80188f0 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.616+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3fc1a51d0 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.618+0000 7fd3f27fc640 1 -- 172.21.15.39:0/3683340838 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd3f8010ac0 con 0x7fd3fc102d90 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.618+0000 7fd405be9740 1 Processor -- start 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.618+0000 7fd405be9740 1 -- start start 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 0x562e133b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562e133112e0 con 0x562e133b6680 2024-09-12T01:57:05.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e132b8ce0 con 0x562e133abdc0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd405be9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e1330d2a0 con 0x562e133ab4a0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd3f27fc640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 0x7fd3e80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd400dab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 0x562e133b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd400dab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 0x562e133b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43246/0 (socket says 172.21.15.39:43246) 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:48022/0 (socket says 172.21.15.39:48022) 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd400dab640 1 -- 172.21.15.39:0/219362609 learned_addr learned my addr 172.21.15.39:0/219362609 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd3f27fc640 1 -- 172.21.15.39:0/3683340838 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3f80cf520 con 0x7fd3fc102d90 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd4015ac640 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 0x7fd3e80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 -- 172.21.15.39:0/219362609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 msgr2=0x562e133b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 -- 172.21.15.39:0/219362609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 msgr2=0x562e133b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 0x562e133b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 -- 172.21.15.39:0/219362609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1329d440 con 0x562e133ab4a0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.619+0000 7fd401dad640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 0x7fd3e80a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4005c40 tx=0x7fd3f400e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd401dad640 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4014df0 tx=0x7fd3f40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eb6702b5c2468e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd3e77fe640 1 -- 172.21.15.39:0/219362609 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4009c50 con 0x562e133ab4a0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd3e77fe640 1 -- 172.21.15.39:0/219362609 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f4026070 con 0x562e133ab4a0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd3e77fe640 1 -- 172.21.15.39:0/219362609 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4004510 con 0x562e133ab4a0 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 -- 172.21.15.39:0/219362609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 msgr2=0x562e133ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4014df0 tx=0x7fd3f40117b0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 -- 172.21.15.39:0/219362609 shutdown_connections 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133b6680 0x562e133b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 --2- 172.21.15.39:0/219362609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133ab880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.620+0000 7fd405be9740 1 -- 172.21.15.39:0/219362609 >> 172.21.15.39:0/219362609 conn(0x562e133a7a30 msgr2=0x562e133a7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- 172.21.15.39:0/219362609 shutdown_connections 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- 172.21.15.39:0/219362609 wait complete. 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- start start 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 Processor -- start 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562e133b9250 con 0x562e133abdc0 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e132cc050 con 0x562e133b6680 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e133b93d0 con 0x562e133ab4a0 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.621+0000 7fd405be9740 10 client.0 _ll_register_callbacks cb 0x562e1330c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43248/0 (socket says 172.21.15.39:43248) 2024-09-12T01:57:05.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd401dad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 -- 172.21.15.39:0/60384894 learned_addr learned my addr 172.21.15.39:0/60384894 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd4015ac640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 -- 172.21.15.39:0/60384894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 msgr2=0x562e133b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 -- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 msgr2=0x562e133b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 -- 172.21.15.39:0/60384894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e130823c0 con 0x562e133abdc0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd401dad640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd400dab640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009930 tx=0x7fd3ec0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6bd47310e4080f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec049060 con 0x562e133abdc0 2024-09-12T01:57:05.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3ec004450 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.622+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f4026070 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd3ec035050 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 10 client.15246 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e133c4bd0 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f4026070 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd3ec004b50 con 0x562e133abdc0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 10 client.15246 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 10 client.15246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 20 client.15246 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e133c60e0 0x562e133c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 4 client.15246 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e1331e850 con 0x562e133c60e0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.623+0000 7fd4015ac640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e133c60e0 0x562e133c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.624+0000 7fd3e4ff9640 10 client.15246 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.624+0000 7fd4015ac640 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e133c60e0 0x562e133c8500 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=892c1713b68ffe62 server_cookie=d9406b61c3959faa in_seq=0 out_seq=0 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.624+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/60384894 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e1331e850 con 0x562e133c60e0 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.624+0000 7fd3e4ff9640 10 client.15246 handle_command_reply: tid=0 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 client.15246 shutdown 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 msgr2=0x562e133b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009930 tx=0x7fd3ec0317e0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 shutdown_connections 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e133c60e0 0x562e133c8500 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133abdc0 0x562e133b3250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 --2- 172.21.15.39:0/60384894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133ab4a0 0x562e133b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 >> 172.21.15.39:0/60384894 conn(0x562e133a7a30 msgr2=0x562e133ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd3e4ff9640 0 client.15246 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:05.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 shutdown_connections 2024-09-12T01:57:05.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 1 -- 172.21.15.39:0/60384894 wait complete. 2024-09-12T01:57:05.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.625+0000 7fd405be9740 20 client.15246 trim_cache size 0 max 16384 2024-09-12T01:57:05.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 Processor -- start 2024-09-12T01:57:05.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 -- start start 2024-09-12T01:57:05.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133b6680 0x562e133ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1adcd0 con 0x562e133ab4a0 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1ab5a0 con 0x562e133abdc0 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd405be9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1a93f0 con 0x562e133b6680 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43250/0 (socket says 172.21.15.39:43250) 2024-09-12T01:57:05.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.643+0000 7fd4015ac640 1 -- 172.21.15.39:0/1342261973 learned_addr learned my addr 172.21.15.39:0/1342261973 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:05.645 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:05 smithi039 ceph-mon[31204]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 -- 172.21.15.39:0/1342261973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133b6680 msgr2=0x562e133ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133b6680 0x562e133ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 -- 172.21.15.39:0/1342261973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 msgr2=0x562e133c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 -- 172.21.15.39:0/1342261973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e133b6310 con 0x562e133abdc0 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd4015ac640 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd400dab640 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133cddd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec004ef0 tx=0x7fd3ec02a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6b92f8d74dfdf9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd3e6ffd640 1 -- 172.21.15.39:0/1342261973 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec054070 con 0x562e133abdc0 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd3e6ffd640 1 -- 172.21.15.39:0/1342261973 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ec055040 con 0x562e133abdc0 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.644+0000 7fd3e6ffd640 1 -- 172.21.15.39:0/1342261973 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec049070 con 0x562e133abdc0 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 -- 172.21.15.39:0/1342261973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 msgr2=0x562e133cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133cddd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec004ef0 tx=0x7fd3ec02a420 comp rx=0 tx=0).stop 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 -- 172.21.15.39:0/1342261973 shutdown_connections 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133b6680 0x562e133ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133abdc0 0x562e133cddd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 --2- 172.21.15.39:0/1342261973 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 -- 172.21.15.39:0/1342261973 >> 172.21.15.39:0/1342261973 conn(0x562e133a7a30 msgr2=0x562e133b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 -- 172.21.15.39:0/1342261973 shutdown_connections 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.645+0000 7fd405be9740 1 -- 172.21.15.39:0/1342261973 wait complete. 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.646+0000 7fd405be9740 1 -- start start 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.646+0000 7fd405be9740 1 Processor -- start 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.646+0000 7fd405be9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.646+0000 7fd405be9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 0x562e133bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.646+0000 7fd405be9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd405be9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1a9a60 con 0x562e133ab4a0 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd405be9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1aaed0 con 0x562e133b6680 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd405be9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc1aa130 con 0x562e133abdc0 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd405be9740 10 client.0 _ll_register_callbacks cb 0x7fd3f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd401dad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43258/0 (socket says 172.21.15.39:43258) 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 -- 172.21.15.39:0/1093599630 learned_addr learned my addr 172.21.15.39:0/1093599630 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd400dab640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 0x562e133bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 -- 172.21.15.39:0/1093599630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 msgr2=0x562e133bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 0x562e133bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 -- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 msgr2=0x562e133b9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd4015ac640 1 -- 172.21.15.39:0/1093599630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e133ba550 con 0x562e133ab4a0 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd401dad640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.647+0000 7fd400dab640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 0x562e133bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd4015ac640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80ccfd0 tx=0x7fd3f80cf720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39137f9b79f0334b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:05.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f809a090 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3f8098400 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3ec055040 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd3f80cf0b0 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 10 client.15252 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e13430930 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ec055040 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd3f8097ae0 con 0x562e133ab4a0 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 10 client.15252 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 10 client.15252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.648+0000 7fd405be9740 20 client.15252 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e13431000 0x562e13433420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd405be9740 4 client.15252 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e13318d60 con 0x562e13431000 2024-09-12T01:57:05.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd400dab640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e13431000 0x562e13433420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd3e4ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd400dab640 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e13431000 0x562e13433420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1980b50a3e83b5 server_cookie=fa8d4e4e3beea155 in_seq=0 out_seq=0 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd3e4ff9640 1 -- 172.21.15.39:0/1093599630 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562e13318d60 con 0x562e13431000 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.649+0000 7fd3e4ff9640 10 client.15252 handle_command_reply: tid=0 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 client.15252 shutdown 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 msgr2=0x562e133be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80ccfd0 tx=0x7fd3f80cf720 comp rx=0 tx=0).stop 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 shutdown_connections 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562e13431000 0x562e13433420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e133b6680 0x562e133b9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e133abdc0 0x562e133bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 --2- 172.21.15.39:0/1093599630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562e133ab4a0 0x562e133be8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd3e4ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:05.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 >> 172.21.15.39:0/1093599630 conn(0x562e133a7a30 msgr2=0x562e133a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 shutdown_connections 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 1 -- 172.21.15.39:0/1093599630 wait complete. 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.650+0000 7fd405be9740 20 client.15252 trim_cache size 0 max 16384 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: "7a24c54b-552d-41f3-b933-43f3ce6ee4b0": { 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-12T01:57:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "7a24c54b-552d-41f3-b933-43f3ce6ee4b0", 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 msgr2=0x7fd3e80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 0x7fd3e80a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4005c40 tx=0x7fd3f400e000 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 msgr2=0x7fd3fc198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800e9f0 tx=0x7fd3f800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 shutdown_connections 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3fc108290 0x7fd3fc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3e80a2b80 0x7fd3e80a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3fc103740 0x7fd3fc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 --2- 172.21.15.39:0/3683340838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3fc102d90 0x7fd3fc198650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 >> 172.21.15.39:0/3683340838 conn(0x7fd3fc0fc7d0 msgr2=0x7fd3fc105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 shutdown_connections 2024-09-12T01:57:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:05.651+0000 7fd403810640 1 -- 172.21.15.39:0/3683340838 wait complete. 2024-09-12T01:57:05.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:05 smithi044 ceph-mon[35259]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:06.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:05 smithi172 ceph-mon[35073]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:06.360 INFO:tasks.cephfs.filesystem:scrub status for tag:7a24c54b-552d-41f3-b933-43f3ce6ee4b0 - {'path': '/', 'tag': '7a24c54b-552d-41f3-b933-43f3ce6ee4b0', 'options': 'recursive,force'} 2024-09-12T01:57:06.371 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.823+0000 7f101f5c9640 1 -- 172.21.15.39:0/3680672457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f101810c170 msgr2=0x7f101810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.823+0000 7f101f5c9640 1 --2- 172.21.15.39:0/3680672457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f101810c170 0x7f101810e610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1010009ca0 tx=0x7f101002a950 comp rx=0 tx=0).stop 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 -- 172.21.15.39:0/3680672457 shutdown_connections 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 --2- 172.21.15.39:0/3680672457 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f101810c170 0x7f101810e610 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 --2- 172.21.15.39:0/3680672457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018103660 0x7f101810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 --2- 172.21.15.39:0/3680672457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1018102d40 0x7f1018103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 -- 172.21.15.39:0/3680672457 >> 172.21.15.39:0/3680672457 conn(0x7f10180fc7a0 msgr2=0x7f10180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 -- 172.21.15.39:0/3680672457 shutdown_connections 2024-09-12T01:57:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 -- 172.21.15.39:0/3680672457 wait complete. 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 Processor -- start 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 -- start start 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018102d40 0x7f1018198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.824+0000 7f101f5c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 0x7f101819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1018111f70 con 0x7f1018103660 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1018111df0 con 0x7f1018102d40 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10181120f0 con 0x7f101810c170 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43264/0 (socket says 172.21.15.39:43264) 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 -- 172.21.15.39:0/2599905645 learned_addr learned my addr 172.21.15.39:0/2599905645 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:06.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101d365640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018102d40 0x7f1018198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101db66640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 0x7f101819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 -- 172.21.15.39:0/2599905645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 msgr2=0x7f101819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 0x7f101819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 -- 172.21.15.39:0/2599905645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018102d40 msgr2=0x7f1018198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018102d40 0x7f1018198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 -- 172.21.15.39:0/2599905645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101819d3c0 con 0x7f1018103660 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101db66640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 0x7f101819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101cb64640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f100800d740 tx=0x7f100800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008017070 con 0x7f1018103660 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100800de50 con 0x7f1018103660 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101819d6b0 con 0x7f1018103660 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100800f620 con 0x7f1018103660 2024-09-12T01:57:06.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.825+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181a4f90 con 0x7f1018103660 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.826+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018103120 con 0x7f1018103660 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.827+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1008009c30 con 0x7f1018103660 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.828+0000 7f100e7fc640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 0x7f10040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.829+0000 7f101d365640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 0x7f10040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.829+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f10080ceba0 con 0x7f1018103660 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.829+0000 7f101d365640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 0x7f10040a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10140058c0 tx=0x7f101400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:06.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:06.833+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f100809bb10 con 0x7f1018103660 2024-09-12T01:57:06.870 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:06 smithi039 ceph-mon[31204]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:06 smithi044 ceph-mon[35259]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:07.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:06 smithi172 ceph-mon[35073]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:07.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.007+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10180feac0 con 0x7f10040a2b80 2024-09-12T01:57:07.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.013+0000 7f100e7fc640 1 -- 172.21.15.39:0/2599905645 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258997 (secure 0 0 0) 0x7f10180feac0 con 0x7f10040a2b80 2024-09-12T01:57:07.016 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:07.017 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:57:07.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 msgr2=0x7f10040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 0x7f10040a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10140058c0 tx=0x7f101400a250 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 msgr2=0x7f1018198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f100800d740 tx=0x7f100800dc00 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 shutdown_connections 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10040a2b80 0x7f10040a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f101810c170 0x7f101819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1018103660 0x7f1018198950 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 --2- 172.21.15.39:0/2599905645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1018102d40 0x7f1018198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:07.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.017+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 >> 172.21.15.39:0/2599905645 conn(0x7f10180fc7a0 msgr2=0x7f10180fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:07.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.018+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 shutdown_connections 2024-09-12T01:57:07.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:07.018+0000 7f101f5c9640 1 -- 172.21.15.39:0/2599905645 wait complete. 2024-09-12T01:57:07.720 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-12T01:57:05.266607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662986,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":802,"num_read_kb":522,"num_write":358,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360312,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581512,"statfs":{"total":1151940427776,"available":1151571468288,"internally_reserved":0,"allocated":11329536,"data_stored":7241602,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6819,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":50,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003043"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:02.828937+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:57:02.828937+0000","last_peered":"2024-09-12T01:57:02.828937+0000","last_clean":"2024-09-12T01:57:02.828937+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:57:02.828937+0000","last_undegraded":"2024-09-12T01:57:02.828937+0000","last_fullsized":"2024-09-12T01:57:02.828937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:03.829732+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:57:03.829732+0000","last_peered":"2024-09-12T01:57:03.829732+0000","last_clean":"2024-09-12T01:57:03.829732+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:57:03.829732+0000","last_undegraded":"2024-09-12T01:57:03.829732+0000","last_fullsized":"2024-09-12T01:57:03.829732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":288,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:04.831994+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:57:04.831994+0000","last_peered":"2024-09-12T01:57:04.831994+0000","last_clean":"2024-09-12T01:57:04.831994+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:57:04.831994+0000","last_undegraded":"2024-09-12T01:57:04.831994+0000","last_fullsized":"2024-09-12T01:57:04.831994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":182,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:03.864726+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:57:03.864726+0000","last_peered":"2024-09-12T01:57:03.864726+0000","last_clean":"2024-09-12T01:57:03.864726+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:57:03.864726+0000","last_undegraded":"2024-09-12T01:57:03.864726+0000","last_fullsized":"2024-09-12T01:57:03.864726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:59.856575+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:56:59.856575+0000","last_peered":"2024-09-12T01:56:59.856575+0000","last_clean":"2024-09-12T01:56:59.856575+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:56:59.856575+0000","last_undegraded":"2024-09-12T01:56:59.856575+0000","last_fullsized":"2024-09-12T01:56:59.856575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889801+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889801+0000","last_peered":"2024-09-12T01:56:04.889801+0000","last_clean":"2024-09-12T01:56:04.889801+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889801+0000","last_undegraded":"2024-09-12T01:56:04.889801+0000","last_fullsized":"2024-09-12T01:56:04.889801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72384,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":676,"num_read_kb":413,"num_write":175,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":217152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1098213,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234036,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659198,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888131,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018953,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":506784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":505124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:07.724 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:57:07.724 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:57:07.991 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.511+0000 7ff71e335640 1 -- 172.21.15.39:0/197765491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff718102d40 msgr2=0x7ff718103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.511+0000 7ff71e335640 1 --2- 172.21.15.39:0/197765491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff718102d40 0x7ff718103120 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff708009900 tx=0x7ff70802a480 comp rx=0 tx=0).stop 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.511+0000 7ff71e335640 1 -- 172.21.15.39:0/197765491 shutdown_connections 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 --2- 172.21.15.39:0/197765491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71810c170 0x7ff71810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 --2- 172.21.15.39:0/197765491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 0x7ff71810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 --2- 172.21.15.39:0/197765491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff718102d40 0x7ff718103120 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 -- 172.21.15.39:0/197765491 >> 172.21.15.39:0/197765491 conn(0x7ff7180fc7a0 msgr2=0x7ff7180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 -- 172.21.15.39:0/197765491 shutdown_connections 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 -- 172.21.15.39:0/197765491 wait complete. 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 Processor -- start 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.512+0000 7ff71e335640 1 -- start start 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff718102d40 0x7ff7181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 0x7ff718100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff718112000 con 0x7ff71810c170 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff718111e80 con 0x7ff718102d40 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71e335640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff718112180 con 0x7ff718103660 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43282/0 (socket says 172.21.15.39:43282) 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 -- 172.21.15.39:0/1553156295 learned_addr learned my addr 172.21.15.39:0/1553156295 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff717fff640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff718102d40 0x7ff7181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff7177fe640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 0x7ff718100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 -- 172.21.15.39:0/1553156295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 msgr2=0x7ff718100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 0x7ff718100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 -- 172.21.15.39:0/1553156295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff718102d40 msgr2=0x7ff7181009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff718102d40 0x7ff7181009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 -- 172.21.15.39:0/1553156295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7181a6980 con 0x7ff71810c170 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff71c8d2640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff710009fd0 tx=0x7ff71000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.513+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710017070 con 0x7ff71810c170 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.514+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7181a6c70 con 0x7ff71810c170 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.514+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff710003e50 con 0x7ff71810c170 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.514+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100106c0 con 0x7ff71810c170 2024-09-12T01:57:08.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.514+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7181a7160 con 0x7ff71810c170 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.515+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff718103120 con 0x7ff71810c170 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.516+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff710003970 con 0x7ff71810c170 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.517+0000 7ff7157fa640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 0x7ff7000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.517+0000 7ff717fff640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 0x7ff7000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.517+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff7100cedd0 con 0x7ff71810c170 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.517+0000 7ff717fff640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 0x7ff7000a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff708000c00 tx=0x7ff708005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:08.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.521+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff71009bd40 con 0x7ff71810c170 2024-09-12T01:57:08.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.695+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 --> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff718062630 con 0x7ff7000a2b80 2024-09-12T01:57:08.695 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:08 smithi039 ceph-mon[31204]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:08.696 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:08 smithi039 ceph-mon[31204]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:57:08.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.701+0000 7ff7157fa640 1 -- 172.21.15.39:0/1553156295 <== mgr.14150 v2:172.21.15.39:6800/571724551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258996 (secure 0 0 0) 0x7ff718062630 con 0x7ff7000a2b80 2024-09-12T01:57:08.704 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:08.705 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 msgr2=0x7ff7000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 0x7ff7000a5040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff708000c00 tx=0x7ff708005b50 comp rx=0 tx=0).stop 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 msgr2=0x7ff718101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff710009fd0 tx=0x7ff71000b260 comp rx=0 tx=0).stop 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 shutdown_connections 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff71810c170 0x7ff718101420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff7000a2b80 0x7ff7000a5040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff718103660 0x7ff718100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 --2- 172.21.15.39:0/1553156295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff718102d40 0x7ff7181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:08.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 >> 172.21.15.39:0/1553156295 conn(0x7ff7180fc7a0 msgr2=0x7ff7180fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:08.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 shutdown_connections 2024-09-12T01:57:08.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:08.705+0000 7ff71e335640 1 -- 172.21.15.39:0/1553156295 wait complete. 2024-09-12T01:57:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:08 smithi044 ceph-mon[35259]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:08 smithi044 ceph-mon[35259]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:57:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:08 smithi172 ceph-mon[35073]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:09.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:08 smithi172 ceph-mon[35073]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T01:57:09.354 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-12T01:57:07.267032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662986,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":808,"num_read_kb":528,"num_write":358,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180870,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360312,"kb_used_data":11064,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581512,"statfs":{"total":1151940427776,"available":1151571468288,"internally_reserved":0,"allocated":11329536,"data_stored":7241602,"data_compressed":109974,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6511,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":45,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003040"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251418+0000","last_change":"2024-09-12T01:55:07.603780+0000","last_active":"2024-09-12T01:56:33.251418+0000","last_peered":"2024-09-12T01:56:33.251418+0000","last_clean":"2024-09-12T01:56:33.251418+0000","last_became_active":"2024-09-12T01:55:07.603325+0000","last_became_peered":"2024-09-12T01:55:07.603325+0000","last_unstale":"2024-09-12T01:56:33.251418+0000","last_undegraded":"2024-09-12T01:56:33.251418+0000","last_fullsized":"2024-09-12T01:56:33.251418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:34.468464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265439+0000","last_change":"2024-09-12T01:55:07.605674+0000","last_active":"2024-09-12T01:56:33.265439+0000","last_peered":"2024-09-12T01:56:33.265439+0000","last_clean":"2024-09-12T01:56:33.265439+0000","last_became_active":"2024-09-12T01:55:07.605327+0000","last_became_peered":"2024-09-12T01:55:07.605327+0000","last_unstale":"2024-09-12T01:56:33.265439+0000","last_undegraded":"2024-09-12T01:56:33.265439+0000","last_fullsized":"2024-09-12T01:56:33.265439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:14.724196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263898+0000","last_change":"2024-09-12T01:55:07.609706+0000","last_active":"2024-09-12T01:56:33.263898+0000","last_peered":"2024-09-12T01:56:33.263898+0000","last_clean":"2024-09-12T01:56:33.263898+0000","last_became_active":"2024-09-12T01:55:07.609382+0000","last_became_peered":"2024-09-12T01:55:07.609382+0000","last_unstale":"2024-09-12T01:56:33.263898+0000","last_undegraded":"2024-09-12T01:56:33.263898+0000","last_fullsized":"2024-09-12T01:56:33.263898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:27.286480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.234390+0000","last_change":"2024-09-12T01:55:07.608115+0000","last_active":"2024-09-12T01:56:33.234390+0000","last_peered":"2024-09-12T01:56:33.234390+0000","last_clean":"2024-09-12T01:56:33.234390+0000","last_became_active":"2024-09-12T01:55:07.607687+0000","last_became_peered":"2024-09-12T01:55:07.607687+0000","last_unstale":"2024-09-12T01:56:33.234390+0000","last_undegraded":"2024-09-12T01:56:33.234390+0000","last_fullsized":"2024-09-12T01:56:33.234390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:36.005142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243117+0000","last_change":"2024-09-12T01:55:07.600127+0000","last_active":"2024-09-12T01:56:33.243117+0000","last_peered":"2024-09-12T01:56:33.243117+0000","last_clean":"2024-09-12T01:56:33.243117+0000","last_became_active":"2024-09-12T01:55:07.599807+0000","last_became_peered":"2024-09-12T01:55:07.599807+0000","last_unstale":"2024-09-12T01:56:33.243117+0000","last_undegraded":"2024-09-12T01:56:33.243117+0000","last_fullsized":"2024-09-12T01:56:33.243117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:50.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.255159+0000","last_change":"2024-09-12T01:55:07.600638+0000","last_active":"2024-09-12T01:56:33.255159+0000","last_peered":"2024-09-12T01:56:33.255159+0000","last_clean":"2024-09-12T01:56:33.255159+0000","last_became_active":"2024-09-12T01:55:07.600303+0000","last_became_peered":"2024-09-12T01:55:07.600303+0000","last_unstale":"2024-09-12T01:56:33.255159+0000","last_undegraded":"2024-09-12T01:56:33.255159+0000","last_fullsized":"2024-09-12T01:56:33.255159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:51.988134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258727+0000","last_change":"2024-09-12T01:55:07.602455+0000","last_active":"2024-09-12T01:56:33.258727+0000","last_peered":"2024-09-12T01:56:33.258727+0000","last_clean":"2024-09-12T01:56:33.258727+0000","last_became_active":"2024-09-12T01:55:07.602106+0000","last_became_peered":"2024-09-12T01:55:07.602106+0000","last_unstale":"2024-09-12T01:56:33.258727+0000","last_undegraded":"2024-09-12T01:56:33.258727+0000","last_fullsized":"2024-09-12T01:56:33.258727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:35.269052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264766+0000","last_change":"2024-09-12T01:56:05.524736+0000","last_active":"2024-09-12T01:56:33.264766+0000","last_peered":"2024-09-12T01:56:33.264766+0000","last_clean":"2024-09-12T01:56:33.264766+0000","last_became_active":"2024-09-12T01:56:05.524283+0000","last_became_peered":"2024-09-12T01:56:05.524283+0000","last_unstale":"2024-09-12T01:56:33.264766+0000","last_undegraded":"2024-09-12T01:56:33.264766+0000","last_fullsized":"2024-09-12T01:56:33.264766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.654658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265357+0000","last_change":"2024-09-12T01:55:07.600417+0000","last_active":"2024-09-12T01:56:33.265357+0000","last_peered":"2024-09-12T01:56:33.265357+0000","last_clean":"2024-09-12T01:56:33.265357+0000","last_became_active":"2024-09-12T01:55:07.600063+0000","last_became_peered":"2024-09-12T01:55:07.600063+0000","last_unstale":"2024-09-12T01:56:33.265357+0000","last_undegraded":"2024-09-12T01:56:33.265357+0000","last_fullsized":"2024-09-12T01:56:33.265357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:04.297598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.257516+0000","last_change":"2024-09-12T01:56:04.893446+0000","last_active":"2024-09-12T01:56:33.257516+0000","last_peered":"2024-09-12T01:56:33.257516+0000","last_clean":"2024-09-12T01:56:33.257516+0000","last_became_active":"2024-09-12T01:56:04.893118+0000","last_became_peered":"2024-09-12T01:56:04.893118+0000","last_unstale":"2024-09-12T01:56:33.257516+0000","last_undegraded":"2024-09-12T01:56:33.257516+0000","last_fullsized":"2024-09-12T01:56:33.257516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265985+0000","last_change":"2024-09-12T01:55:07.615493+0000","last_active":"2024-09-12T01:56:33.265985+0000","last_peered":"2024-09-12T01:56:33.265985+0000","last_clean":"2024-09-12T01:56:33.265985+0000","last_became_active":"2024-09-12T01:55:07.615124+0000","last_became_peered":"2024-09-12T01:55:07.615124+0000","last_unstale":"2024-09-12T01:56:33.265985+0000","last_undegraded":"2024-09-12T01:56:33.265985+0000","last_fullsized":"2024-09-12T01:56:33.265985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264913+0000","last_change":"2024-09-12T01:56:04.892867+0000","last_active":"2024-09-12T01:56:33.264913+0000","last_peered":"2024-09-12T01:56:33.264913+0000","last_clean":"2024-09-12T01:56:33.264913+0000","last_became_active":"2024-09-12T01:56:04.892499+0000","last_became_peered":"2024-09-12T01:56:04.892499+0000","last_unstale":"2024-09-12T01:56:33.264913+0000","last_undegraded":"2024-09-12T01:56:33.264913+0000","last_fullsized":"2024-09-12T01:56:33.264913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.624607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264090+0000","last_change":"2024-09-12T01:55:07.596237+0000","last_active":"2024-09-12T01:56:33.264090+0000","last_peered":"2024-09-12T01:56:33.264090+0000","last_clean":"2024-09-12T01:56:33.264090+0000","last_became_active":"2024-09-12T01:55:07.595868+0000","last_became_peered":"2024-09-12T01:55:07.595868+0000","last_unstale":"2024-09-12T01:56:33.264090+0000","last_undegraded":"2024-09-12T01:56:33.264090+0000","last_fullsized":"2024-09-12T01:56:33.264090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:54.868028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265264+0000","last_change":"2024-09-12T01:55:07.606017+0000","last_active":"2024-09-12T01:56:33.265264+0000","last_peered":"2024-09-12T01:56:33.265264+0000","last_clean":"2024-09-12T01:56:33.265264+0000","last_became_active":"2024-09-12T01:55:07.605720+0000","last_became_peered":"2024-09-12T01:55:07.605720+0000","last_unstale":"2024-09-12T01:56:33.265264+0000","last_undegraded":"2024-09-12T01:56:33.265264+0000","last_fullsized":"2024-09-12T01:56:33.265264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:01.048666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252429+0000","last_change":"2024-09-12T01:55:07.606533+0000","last_active":"2024-09-12T01:56:33.252429+0000","last_peered":"2024-09-12T01:56:33.252429+0000","last_clean":"2024-09-12T01:56:33.252429+0000","last_became_active":"2024-09-12T01:55:07.606227+0000","last_became_peered":"2024-09-12T01:55:07.606227+0000","last_unstale":"2024-09-12T01:56:33.252429+0000","last_undegraded":"2024-09-12T01:56:33.252429+0000","last_fullsized":"2024-09-12T01:56:33.252429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:55.526609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264215+0000","last_change":"2024-09-12T01:55:07.610146+0000","last_active":"2024-09-12T01:56:33.264215+0000","last_peered":"2024-09-12T01:56:33.264215+0000","last_clean":"2024-09-12T01:56:33.264215+0000","last_became_active":"2024-09-12T01:55:07.609786+0000","last_became_peered":"2024-09-12T01:55:07.609786+0000","last_unstale":"2024-09-12T01:56:33.264215+0000","last_undegraded":"2024-09-12T01:56:33.264215+0000","last_fullsized":"2024-09-12T01:56:33.264215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:06.447370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264355+0000","last_change":"2024-09-12T01:55:07.605778+0000","last_active":"2024-09-12T01:56:33.264355+0000","last_peered":"2024-09-12T01:56:33.264355+0000","last_clean":"2024-09-12T01:56:33.264355+0000","last_became_active":"2024-09-12T01:55:07.605446+0000","last_became_peered":"2024-09-12T01:55:07.605446+0000","last_unstale":"2024-09-12T01:56:33.264355+0000","last_undegraded":"2024-09-12T01:56:33.264355+0000","last_fullsized":"2024-09-12T01:56:33.264355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:44.711514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266117+0000","last_change":"2024-09-12T01:55:07.606970+0000","last_active":"2024-09-12T01:56:33.266117+0000","last_peered":"2024-09-12T01:56:33.266117+0000","last_clean":"2024-09-12T01:56:33.266117+0000","last_became_active":"2024-09-12T01:55:07.606623+0000","last_became_peered":"2024-09-12T01:55:07.606623+0000","last_unstale":"2024-09-12T01:56:33.266117+0000","last_undegraded":"2024-09-12T01:56:33.266117+0000","last_fullsized":"2024-09-12T01:56:33.266117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:04.699252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249326+0000","last_change":"2024-09-12T01:55:07.604635+0000","last_active":"2024-09-12T01:56:33.249326+0000","last_peered":"2024-09-12T01:56:33.249326+0000","last_clean":"2024-09-12T01:56:33.249326+0000","last_became_active":"2024-09-12T01:55:07.604331+0000","last_became_peered":"2024-09-12T01:55:07.604331+0000","last_unstale":"2024-09-12T01:56:33.249326+0000","last_undegraded":"2024-09-12T01:56:33.249326+0000","last_fullsized":"2024-09-12T01:56:33.249326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:38.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.240419+0000","last_change":"2024-09-12T01:55:07.610157+0000","last_active":"2024-09-12T01:56:33.240419+0000","last_peered":"2024-09-12T01:56:33.240419+0000","last_clean":"2024-09-12T01:56:33.240419+0000","last_became_active":"2024-09-12T01:55:07.609825+0000","last_became_peered":"2024-09-12T01:55:07.609825+0000","last_unstale":"2024-09-12T01:56:33.240419+0000","last_undegraded":"2024-09-12T01:56:33.240419+0000","last_fullsized":"2024-09-12T01:56:33.240419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:24.824174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252785+0000","last_change":"2024-09-12T01:55:07.605980+0000","last_active":"2024-09-12T01:56:33.252785+0000","last_peered":"2024-09-12T01:56:33.252785+0000","last_clean":"2024-09-12T01:56:33.252785+0000","last_became_active":"2024-09-12T01:55:07.605677+0000","last_became_peered":"2024-09-12T01:55:07.605677+0000","last_unstale":"2024-09-12T01:56:33.252785+0000","last_undegraded":"2024-09-12T01:56:33.252785+0000","last_fullsized":"2024-09-12T01:56:33.252785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:52.222955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265694+0000","last_change":"2024-09-12T01:55:07.610252+0000","last_active":"2024-09-12T01:56:33.265694+0000","last_peered":"2024-09-12T01:56:33.265694+0000","last_clean":"2024-09-12T01:56:33.265694+0000","last_became_active":"2024-09-12T01:55:07.609842+0000","last_became_peered":"2024-09-12T01:55:07.609842+0000","last_unstale":"2024-09-12T01:56:33.265694+0000","last_undegraded":"2024-09-12T01:56:33.265694+0000","last_fullsized":"2024-09-12T01:56:33.265694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.392808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252935+0000","last_change":"2024-09-12T01:55:07.607905+0000","last_active":"2024-09-12T01:56:33.252935+0000","last_peered":"2024-09-12T01:56:33.252935+0000","last_clean":"2024-09-12T01:56:33.252935+0000","last_became_active":"2024-09-12T01:55:07.607593+0000","last_became_peered":"2024-09-12T01:55:07.607593+0000","last_unstale":"2024-09-12T01:56:33.252935+0000","last_undegraded":"2024-09-12T01:56:33.252935+0000","last_fullsized":"2024-09-12T01:56:33.252935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:42.095651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250670+0000","last_change":"2024-09-12T01:55:07.602172+0000","last_active":"2024-09-12T01:56:33.250670+0000","last_peered":"2024-09-12T01:56:33.250670+0000","last_clean":"2024-09-12T01:56:33.250670+0000","last_became_active":"2024-09-12T01:55:07.601849+0000","last_became_peered":"2024-09-12T01:55:07.601849+0000","last_unstale":"2024-09-12T01:56:33.250670+0000","last_undegraded":"2024-09-12T01:56:33.250670+0000","last_fullsized":"2024-09-12T01:56:33.250670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.145024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252158+0000","last_change":"2024-09-12T01:55:07.613630+0000","last_active":"2024-09-12T01:56:33.252158+0000","last_peered":"2024-09-12T01:56:33.252158+0000","last_clean":"2024-09-12T01:56:33.252158+0000","last_became_active":"2024-09-12T01:55:07.613330+0000","last_became_peered":"2024-09-12T01:55:07.613330+0000","last_unstale":"2024-09-12T01:56:33.252158+0000","last_undegraded":"2024-09-12T01:56:33.252158+0000","last_fullsized":"2024-09-12T01:56:33.252158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:27.165035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264890+0000","last_change":"2024-09-12T01:55:07.603874+0000","last_active":"2024-09-12T01:56:33.264890+0000","last_peered":"2024-09-12T01:56:33.264890+0000","last_clean":"2024-09-12T01:56:33.264890+0000","last_became_active":"2024-09-12T01:55:07.602846+0000","last_became_peered":"2024-09-12T01:55:07.602846+0000","last_unstale":"2024-09-12T01:56:33.264890+0000","last_undegraded":"2024-09-12T01:56:33.264890+0000","last_fullsized":"2024-09-12T01:56:33.264890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:51.302289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.601258+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.600937+0000","last_became_peered":"2024-09-12T01:55:07.600937+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:41.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251958+0000","last_change":"2024-09-12T01:55:07.600921+0000","last_active":"2024-09-12T01:56:33.251958+0000","last_peered":"2024-09-12T01:56:33.251958+0000","last_clean":"2024-09-12T01:56:33.251958+0000","last_became_active":"2024-09-12T01:55:07.600616+0000","last_became_peered":"2024-09-12T01:55:07.600616+0000","last_unstale":"2024-09-12T01:56:33.251958+0000","last_undegraded":"2024-09-12T01:56:33.251958+0000","last_fullsized":"2024-09-12T01:56:33.251958+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:28.731992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251599+0000","last_change":"2024-09-12T01:55:07.608574+0000","last_active":"2024-09-12T01:56:33.251599+0000","last_peered":"2024-09-12T01:56:33.251599+0000","last_clean":"2024-09-12T01:56:33.251599+0000","last_became_active":"2024-09-12T01:55:07.608146+0000","last_became_peered":"2024-09-12T01:55:07.608146+0000","last_unstale":"2024-09-12T01:56:33.251599+0000","last_undegraded":"2024-09-12T01:56:33.251599+0000","last_fullsized":"2024-09-12T01:56:33.251599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:05.706333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.248193+0000","last_change":"2024-09-12T01:55:07.606805+0000","last_active":"2024-09-12T01:56:33.248193+0000","last_peered":"2024-09-12T01:56:33.248193+0000","last_clean":"2024-09-12T01:56:33.248193+0000","last_became_active":"2024-09-12T01:55:07.606482+0000","last_became_peered":"2024-09-12T01:55:07.606482+0000","last_unstale":"2024-09-12T01:56:33.248193+0000","last_undegraded":"2024-09-12T01:56:33.248193+0000","last_fullsized":"2024-09-12T01:56:33.248193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:44.050871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256329+0000","last_change":"2024-09-12T01:55:07.611977+0000","last_active":"2024-09-12T01:56:33.256329+0000","last_peered":"2024-09-12T01:56:33.256329+0000","last_clean":"2024-09-12T01:56:33.256329+0000","last_became_active":"2024-09-12T01:55:07.611674+0000","last_became_peered":"2024-09-12T01:55:07.611674+0000","last_unstale":"2024-09-12T01:56:33.256329+0000","last_undegraded":"2024-09-12T01:56:33.256329+0000","last_fullsized":"2024-09-12T01:56:33.256329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:05.118195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254308+0000","last_change":"2024-09-12T01:55:07.610417+0000","last_active":"2024-09-12T01:56:33.254308+0000","last_peered":"2024-09-12T01:56:33.254308+0000","last_clean":"2024-09-12T01:56:33.254308+0000","last_became_active":"2024-09-12T01:55:07.609206+0000","last_became_peered":"2024-09-12T01:55:07.609206+0000","last_unstale":"2024-09-12T01:56:33.254308+0000","last_undegraded":"2024-09-12T01:56:33.254308+0000","last_fullsized":"2024-09-12T01:56:33.254308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:08.458964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.243195+0000","last_change":"2024-09-12T01:55:07.606549+0000","last_active":"2024-09-12T01:56:33.243195+0000","last_peered":"2024-09-12T01:56:33.243195+0000","last_clean":"2024-09-12T01:56:33.243195+0000","last_became_active":"2024-09-12T01:55:07.606252+0000","last_became_peered":"2024-09-12T01:55:07.606252+0000","last_unstale":"2024-09-12T01:56:33.243195+0000","last_undegraded":"2024-09-12T01:56:33.243195+0000","last_fullsized":"2024-09-12T01:56:33.243195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:02.880626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":140,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:02.828937+0000","last_change":"2024-09-12T01:55:05.545519+0000","last_active":"2024-09-12T01:57:02.828937+0000","last_peered":"2024-09-12T01:57:02.828937+0000","last_clean":"2024-09-12T01:57:02.828937+0000","last_became_active":"2024-09-12T01:55:05.545195+0000","last_became_peered":"2024-09-12T01:55:05.545195+0000","last_unstale":"2024-09-12T01:57:02.828937+0000","last_undegraded":"2024-09-12T01:57:02.828937+0000","last_fullsized":"2024-09-12T01:57:02.828937+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:05.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.252396+0000","last_change":"2024-09-12T01:55:07.600133+0000","last_active":"2024-09-12T01:56:33.252396+0000","last_peered":"2024-09-12T01:56:33.252396+0000","last_clean":"2024-09-12T01:56:33.252396+0000","last_became_active":"2024-09-12T01:55:07.599711+0000","last_became_peered":"2024-09-12T01:55:07.599711+0000","last_unstale":"2024-09-12T01:56:33.252396+0000","last_undegraded":"2024-09-12T01:56:33.252396+0000","last_fullsized":"2024-09-12T01:56:33.252396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:48.838035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.894801+0000","last_change":"2024-09-12T01:56:04.894801+0000","last_active":"2024-09-12T01:56:04.894801+0000","last_peered":"2024-09-12T01:56:04.894801+0000","last_clean":"2024-09-12T01:56:04.894801+0000","last_became_active":"2024-09-12T01:56:04.891754+0000","last_became_peered":"2024-09-12T01:56:04.891754+0000","last_unstale":"2024-09-12T01:56:04.894801+0000","last_undegraded":"2024-09-12T01:56:04.894801+0000","last_fullsized":"2024-09-12T01:56:04.894801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:21.330544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887786+0000","last_change":"2024-09-12T01:55:05.540943+0000","last_active":"2024-09-12T01:56:04.887786+0000","last_peered":"2024-09-12T01:56:04.887786+0000","last_clean":"2024-09-12T01:56:04.887786+0000","last_became_active":"2024-09-12T01:55:05.539400+0000","last_became_peered":"2024-09-12T01:55:05.539400+0000","last_unstale":"2024-09-12T01:56:04.887786+0000","last_undegraded":"2024-09-12T01:56:04.887786+0000","last_fullsized":"2024-09-12T01:56:04.887786+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:01.295961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251630+0000","last_change":"2024-09-12T01:55:07.611218+0000","last_active":"2024-09-12T01:56:33.251630+0000","last_peered":"2024-09-12T01:56:33.251630+0000","last_clean":"2024-09-12T01:56:33.251630+0000","last_became_active":"2024-09-12T01:55:07.609631+0000","last_became_peered":"2024-09-12T01:55:07.609631+0000","last_unstale":"2024-09-12T01:56:33.251630+0000","last_undegraded":"2024-09-12T01:56:33.251630+0000","last_fullsized":"2024-09-12T01:56:33.251630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.910916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524094+0000","last_change":"2024-09-12T01:55:05.544901+0000","last_active":"2024-09-12T01:56:05.524094+0000","last_peered":"2024-09-12T01:56:05.524094+0000","last_clean":"2024-09-12T01:56:05.524094+0000","last_became_active":"2024-09-12T01:55:05.544581+0000","last_became_peered":"2024-09-12T01:55:05.544581+0000","last_unstale":"2024-09-12T01:56:05.524094+0000","last_undegraded":"2024-09-12T01:56:05.524094+0000","last_fullsized":"2024-09-12T01:56:05.524094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:01.579100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.265171+0000","last_change":"2024-09-12T01:55:07.605738+0000","last_active":"2024-09-12T01:56:33.265171+0000","last_peered":"2024-09-12T01:56:33.265171+0000","last_clean":"2024-09-12T01:56:33.265171+0000","last_became_active":"2024-09-12T01:55:07.605408+0000","last_became_peered":"2024-09-12T01:55:07.605408+0000","last_unstale":"2024-09-12T01:56:33.265171+0000","last_undegraded":"2024-09-12T01:56:33.265171+0000","last_fullsized":"2024-09-12T01:56:33.265171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:46.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:03.829732+0000","last_change":"2024-09-12T01:55:05.545645+0000","last_active":"2024-09-12T01:57:03.829732+0000","last_peered":"2024-09-12T01:57:03.829732+0000","last_clean":"2024-09-12T01:57:03.829732+0000","last_became_active":"2024-09-12T01:55:05.545271+0000","last_became_peered":"2024-09-12T01:55:05.545271+0000","last_unstale":"2024-09-12T01:57:03.829732+0000","last_undegraded":"2024-09-12T01:57:03.829732+0000","last_fullsized":"2024-09-12T01:57:03.829732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:59.850195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263659+0000","last_change":"2024-09-12T01:55:07.596605+0000","last_active":"2024-09-12T01:56:33.263659+0000","last_peered":"2024-09-12T01:56:33.263659+0000","last_clean":"2024-09-12T01:56:33.263659+0000","last_became_active":"2024-09-12T01:55:07.596235+0000","last_became_peered":"2024-09-12T01:55:07.596235+0000","last_unstale":"2024-09-12T01:56:33.263659+0000","last_undegraded":"2024-09-12T01:56:33.263659+0000","last_fullsized":"2024-09-12T01:56:33.263659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:45.705074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187838+0000","last_change":"2024-09-12T01:55:05.542174+0000","last_active":"2024-09-12T01:56:05.187838+0000","last_peered":"2024-09-12T01:56:05.187838+0000","last_clean":"2024-09-12T01:56:05.187838+0000","last_became_active":"2024-09-12T01:55:05.541818+0000","last_became_peered":"2024-09-12T01:55:05.541818+0000","last_unstale":"2024-09-12T01:56:05.187838+0000","last_undegraded":"2024-09-12T01:56:05.187838+0000","last_fullsized":"2024-09-12T01:56:05.187838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:22.981302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.250617+0000","last_change":"2024-09-12T01:56:05.524535+0000","last_active":"2024-09-12T01:56:33.250617+0000","last_peered":"2024-09-12T01:56:33.250617+0000","last_clean":"2024-09-12T01:56:33.250617+0000","last_became_active":"2024-09-12T01:56:05.524188+0000","last_became_peered":"2024-09-12T01:56:05.524188+0000","last_unstale":"2024-09-12T01:56:33.250617+0000","last_undegraded":"2024-09-12T01:56:33.250617+0000","last_fullsized":"2024-09-12T01:56:33.250617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.751204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523900+0000","last_change":"2024-09-12T01:55:05.540656+0000","last_active":"2024-09-12T01:56:05.523900+0000","last_peered":"2024-09-12T01:56:05.523900+0000","last_clean":"2024-09-12T01:56:05.523900+0000","last_became_active":"2024-09-12T01:55:05.540315+0000","last_became_peered":"2024-09-12T01:55:05.540315+0000","last_unstale":"2024-09-12T01:56:05.523900+0000","last_undegraded":"2024-09-12T01:56:05.523900+0000","last_fullsized":"2024-09-12T01:56:05.523900+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:10.307609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266041+0000","last_change":"2024-09-12T01:55:07.603912+0000","last_active":"2024-09-12T01:56:33.266041+0000","last_peered":"2024-09-12T01:56:33.266041+0000","last_clean":"2024-09-12T01:56:33.266041+0000","last_became_active":"2024-09-12T01:55:07.603493+0000","last_became_peered":"2024-09-12T01:55:07.603493+0000","last_unstale":"2024-09-12T01:56:33.266041+0000","last_undegraded":"2024-09-12T01:56:33.266041+0000","last_fullsized":"2024-09-12T01:56:33.266041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:23.329664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":288,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:04.831994+0000","last_change":"2024-09-12T01:55:05.544332+0000","last_active":"2024-09-12T01:57:04.831994+0000","last_peered":"2024-09-12T01:57:04.831994+0000","last_clean":"2024-09-12T01:57:04.831994+0000","last_became_active":"2024-09-12T01:55:05.543853+0000","last_became_peered":"2024-09-12T01:55:05.543853+0000","last_unstale":"2024-09-12T01:57:04.831994+0000","last_undegraded":"2024-09-12T01:57:04.831994+0000","last_fullsized":"2024-09-12T01:57:04.831994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:27.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":182,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251331+0000","last_change":"2024-09-12T01:55:07.605313+0000","last_active":"2024-09-12T01:56:33.251331+0000","last_peered":"2024-09-12T01:56:33.251331+0000","last_clean":"2024-09-12T01:56:33.251331+0000","last_became_active":"2024-09-12T01:55:07.605010+0000","last_became_peered":"2024-09-12T01:55:07.605010+0000","last_unstale":"2024-09-12T01:56:33.251331+0000","last_undegraded":"2024-09-12T01:56:33.251331+0000","last_fullsized":"2024-09-12T01:56:33.251331+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:01.743407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887861+0000","last_change":"2024-09-12T01:55:05.541594+0000","last_active":"2024-09-12T01:56:04.887861+0000","last_peered":"2024-09-12T01:56:04.887861+0000","last_clean":"2024-09-12T01:56:04.887861+0000","last_became_active":"2024-09-12T01:55:05.540594+0000","last_became_peered":"2024-09-12T01:55:05.540594+0000","last_unstale":"2024-09-12T01:56:04.887861+0000","last_undegraded":"2024-09-12T01:56:04.887861+0000","last_fullsized":"2024-09-12T01:56:04.887861+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:29.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249779+0000","last_change":"2024-09-12T01:55:07.606777+0000","last_active":"2024-09-12T01:56:33.249779+0000","last_peered":"2024-09-12T01:56:33.249779+0000","last_clean":"2024-09-12T01:56:33.249779+0000","last_became_active":"2024-09-12T01:55:07.606472+0000","last_became_peered":"2024-09-12T01:55:07.606472+0000","last_unstale":"2024-09-12T01:56:33.249779+0000","last_undegraded":"2024-09-12T01:56:33.249779+0000","last_fullsized":"2024-09-12T01:56:33.249779+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:53.386361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523780+0000","last_change":"2024-09-12T01:55:05.540508+0000","last_active":"2024-09-12T01:56:05.523780+0000","last_peered":"2024-09-12T01:56:05.523780+0000","last_clean":"2024-09-12T01:56:05.523780+0000","last_became_active":"2024-09-12T01:55:05.540149+0000","last_became_peered":"2024-09-12T01:55:05.540149+0000","last_unstale":"2024-09-12T01:56:05.523780+0000","last_undegraded":"2024-09-12T01:56:05.523780+0000","last_fullsized":"2024-09-12T01:56:05.523780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:03.077743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261653+0000","last_change":"2024-09-12T01:55:07.613217+0000","last_active":"2024-09-12T01:56:33.261653+0000","last_peered":"2024-09-12T01:56:33.261653+0000","last_clean":"2024-09-12T01:56:33.261653+0000","last_became_active":"2024-09-12T01:55:07.612806+0000","last_became_peered":"2024-09-12T01:55:07.612806+0000","last_unstale":"2024-09-12T01:56:33.261653+0000","last_undegraded":"2024-09-12T01:56:33.261653+0000","last_fullsized":"2024-09-12T01:56:33.261653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:00.829469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:03.864726+0000","last_change":"2024-09-12T01:55:05.540536+0000","last_active":"2024-09-12T01:57:03.864726+0000","last_peered":"2024-09-12T01:57:03.864726+0000","last_clean":"2024-09-12T01:57:03.864726+0000","last_became_active":"2024-09-12T01:55:05.540127+0000","last_became_peered":"2024-09-12T01:55:05.540127+0000","last_unstale":"2024-09-12T01:57:03.864726+0000","last_undegraded":"2024-09-12T01:57:03.864726+0000","last_fullsized":"2024-09-12T01:57:03.864726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:24.113101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.261797+0000","last_change":"2024-09-12T01:55:07.607936+0000","last_active":"2024-09-12T01:56:33.261797+0000","last_peered":"2024-09-12T01:56:33.261797+0000","last_clean":"2024-09-12T01:56:33.261797+0000","last_became_active":"2024-09-12T01:55:07.607605+0000","last_became_peered":"2024-09-12T01:55:07.607605+0000","last_unstale":"2024-09-12T01:56:33.261797+0000","last_undegraded":"2024-09-12T01:56:33.261797+0000","last_fullsized":"2024-09-12T01:56:33.261797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:12.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.534793+0000","last_change":"2024-09-12T01:56:05.534793+0000","last_active":"2024-09-12T01:56:05.534793+0000","last_peered":"2024-09-12T01:56:05.534793+0000","last_clean":"2024-09-12T01:56:05.534793+0000","last_became_active":"2024-09-12T01:56:05.525244+0000","last_became_peered":"2024-09-12T01:56:05.525244+0000","last_unstale":"2024-09-12T01:56:05.534793+0000","last_undegraded":"2024-09-12T01:56:05.534793+0000","last_fullsized":"2024-09-12T01:56:05.534793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:08.922935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253792+0000","last_change":"2024-09-12T01:55:07.597861+0000","last_active":"2024-09-12T01:56:33.253792+0000","last_peered":"2024-09-12T01:56:33.253792+0000","last_clean":"2024-09-12T01:56:33.253792+0000","last_became_active":"2024-09-12T01:55:07.597536+0000","last_became_peered":"2024-09-12T01:55:07.597536+0000","last_unstale":"2024-09-12T01:56:33.253792+0000","last_undegraded":"2024-09-12T01:56:33.253792+0000","last_fullsized":"2024-09-12T01:56:33.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:00.918590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.891279+0000","last_change":"2024-09-12T01:55:05.542593+0000","last_active":"2024-09-12T01:56:04.891279+0000","last_peered":"2024-09-12T01:56:04.891279+0000","last_clean":"2024-09-12T01:56:04.891279+0000","last_became_active":"2024-09-12T01:55:05.542174+0000","last_became_peered":"2024-09-12T01:55:05.542174+0000","last_unstale":"2024-09-12T01:56:04.891279+0000","last_undegraded":"2024-09-12T01:56:04.891279+0000","last_fullsized":"2024-09-12T01:56:04.891279+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:50.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.244258+0000","last_change":"2024-09-12T01:55:07.609713+0000","last_active":"2024-09-12T01:56:33.244258+0000","last_peered":"2024-09-12T01:56:33.244258+0000","last_clean":"2024-09-12T01:56:33.244258+0000","last_became_active":"2024-09-12T01:55:07.609344+0000","last_became_peered":"2024-09-12T01:55:07.609344+0000","last_unstale":"2024-09-12T01:56:33.244258+0000","last_undegraded":"2024-09-12T01:56:33.244258+0000","last_fullsized":"2024-09-12T01:56:33.244258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:38.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.888286+0000","last_change":"2024-09-12T01:55:05.539658+0000","last_active":"2024-09-12T01:56:04.888286+0000","last_peered":"2024-09-12T01:56:04.888286+0000","last_clean":"2024-09-12T01:56:04.888286+0000","last_became_active":"2024-09-12T01:55:05.539338+0000","last_became_peered":"2024-09-12T01:55:05.539338+0000","last_unstale":"2024-09-12T01:56:04.888286+0000","last_undegraded":"2024-09-12T01:56:04.888286+0000","last_fullsized":"2024-09-12T01:56:04.888286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.441916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258609+0000","last_change":"2024-09-12T01:55:07.610954+0000","last_active":"2024-09-12T01:56:33.258609+0000","last_peered":"2024-09-12T01:56:33.258609+0000","last_clean":"2024-09-12T01:56:33.258609+0000","last_became_active":"2024-09-12T01:55:07.608713+0000","last_became_peered":"2024-09-12T01:55:07.608713+0000","last_unstale":"2024-09-12T01:56:33.258609+0000","last_undegraded":"2024-09-12T01:56:33.258609+0000","last_fullsized":"2024-09-12T01:56:33.258609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:31.239939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.523949+0000","last_change":"2024-09-12T01:55:05.540043+0000","last_active":"2024-09-12T01:56:05.523949+0000","last_peered":"2024-09-12T01:56:05.523949+0000","last_clean":"2024-09-12T01:56:05.523949+0000","last_became_active":"2024-09-12T01:55:05.539617+0000","last_became_peered":"2024-09-12T01:55:05.539617+0000","last_unstale":"2024-09-12T01:56:05.523949+0000","last_undegraded":"2024-09-12T01:56:05.523949+0000","last_fullsized":"2024-09-12T01:56:05.523949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:16.036748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.256962+0000","last_change":"2024-09-12T01:55:07.604191+0000","last_active":"2024-09-12T01:56:33.256962+0000","last_peered":"2024-09-12T01:56:33.256962+0000","last_clean":"2024-09-12T01:56:33.256962+0000","last_became_active":"2024-09-12T01:55:07.603839+0000","last_became_peered":"2024-09-12T01:55:07.603839+0000","last_unstale":"2024-09-12T01:56:33.256962+0000","last_undegraded":"2024-09-12T01:56:33.256962+0000","last_fullsized":"2024-09-12T01:56:33.256962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:57.036166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887820+0000","last_change":"2024-09-12T01:55:05.780870+0000","last_active":"2024-09-12T01:56:04.887820+0000","last_peered":"2024-09-12T01:56:04.887820+0000","last_clean":"2024-09-12T01:56:04.887820+0000","last_became_active":"2024-09-12T01:55:05.780466+0000","last_became_peered":"2024-09-12T01:55:05.780466+0000","last_unstale":"2024-09-12T01:56:04.887820+0000","last_undegraded":"2024-09-12T01:56:04.887820+0000","last_fullsized":"2024-09-12T01:56:04.887820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:18.673788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266394+0000","last_change":"2024-09-12T01:55:07.612087+0000","last_active":"2024-09-12T01:56:33.266394+0000","last_peered":"2024-09-12T01:56:33.266394+0000","last_clean":"2024-09-12T01:56:33.266394+0000","last_became_active":"2024-09-12T01:55:07.611704+0000","last_became_peered":"2024-09-12T01:55:07.611704+0000","last_unstale":"2024-09-12T01:56:33.266394+0000","last_undegraded":"2024-09-12T01:56:33.266394+0000","last_fullsized":"2024-09-12T01:56:33.266394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:49.836012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":336,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187632+0000","last_change":"2024-09-12T01:53:52.233173+0000","last_active":"2024-09-12T01:56:05.187632+0000","last_peered":"2024-09-12T01:56:05.187632+0000","last_clean":"2024-09-12T01:56:05.187632+0000","last_became_active":"2024-09-12T01:53:52.232678+0000","last_became_peered":"2024-09-12T01:53:52.232678+0000","last_unstale":"2024-09-12T01:56:05.187632+0000","last_undegraded":"2024-09-12T01:56:05.187632+0000","last_fullsized":"2024-09-12T01:56:05.187632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:50:23.670487+0000","last_clean_scrub_stamp":"2024-09-12T01:50:23.670487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:34.008251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.886878+0000","last_change":"2024-09-12T01:55:05.540612+0000","last_active":"2024-09-12T01:56:04.886878+0000","last_peered":"2024-09-12T01:56:04.886878+0000","last_clean":"2024-09-12T01:56:04.886878+0000","last_became_active":"2024-09-12T01:55:05.540091+0000","last_became_peered":"2024-09-12T01:55:05.540091+0000","last_unstale":"2024-09-12T01:56:04.886878+0000","last_undegraded":"2024-09-12T01:56:04.886878+0000","last_fullsized":"2024-09-12T01:56:04.886878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.898848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263831+0000","last_change":"2024-09-12T01:55:07.604815+0000","last_active":"2024-09-12T01:56:33.263831+0000","last_peered":"2024-09-12T01:56:33.263831+0000","last_clean":"2024-09-12T01:56:33.263831+0000","last_became_active":"2024-09-12T01:55:07.604489+0000","last_became_peered":"2024-09-12T01:55:07.604489+0000","last_unstale":"2024-09-12T01:56:33.263831+0000","last_undegraded":"2024-09-12T01:56:33.263831+0000","last_fullsized":"2024-09-12T01:56:33.263831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.081494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187580+0000","last_change":"2024-09-12T01:55:05.546030+0000","last_active":"2024-09-12T01:56:05.187580+0000","last_peered":"2024-09-12T01:56:05.187580+0000","last_clean":"2024-09-12T01:56:05.187580+0000","last_became_active":"2024-09-12T01:55:05.545690+0000","last_became_peered":"2024-09-12T01:55:05.545690+0000","last_unstale":"2024-09-12T01:56:05.187580+0000","last_undegraded":"2024-09-12T01:56:05.187580+0000","last_fullsized":"2024-09-12T01:56:05.187580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:11.885905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.242423+0000","last_change":"2024-09-12T01:55:07.599849+0000","last_active":"2024-09-12T01:56:33.242423+0000","last_peered":"2024-09-12T01:56:33.242423+0000","last_clean":"2024-09-12T01:56:33.242423+0000","last_became_active":"2024-09-12T01:55:07.599495+0000","last_became_peered":"2024-09-12T01:55:07.599495+0000","last_unstale":"2024-09-12T01:56:33.242423+0000","last_undegraded":"2024-09-12T01:56:33.242423+0000","last_fullsized":"2024-09-12T01:56:33.242423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:19.833648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":135,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:57:04.865879+0000","last_change":"2024-09-12T01:55:05.538484+0000","last_active":"2024-09-12T01:57:04.865879+0000","last_peered":"2024-09-12T01:57:04.865879+0000","last_clean":"2024-09-12T01:57:04.865879+0000","last_became_active":"2024-09-12T01:55:05.538070+0000","last_became_peered":"2024-09-12T01:55:05.538070+0000","last_unstale":"2024-09-12T01:57:04.865879+0000","last_undegraded":"2024-09-12T01:57:04.865879+0000","last_fullsized":"2024-09-12T01:57:04.865879+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:39.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.254876+0000","last_change":"2024-09-12T01:55:07.598859+0000","last_active":"2024-09-12T01:56:33.254876+0000","last_peered":"2024-09-12T01:56:33.254876+0000","last_clean":"2024-09-12T01:56:33.254876+0000","last_became_active":"2024-09-12T01:55:07.598504+0000","last_became_peered":"2024-09-12T01:55:07.598504+0000","last_unstale":"2024-09-12T01:56:33.254876+0000","last_undegraded":"2024-09-12T01:56:33.254876+0000","last_fullsized":"2024-09-12T01:56:33.254876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:34.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.187722+0000","last_change":"2024-09-12T01:55:05.544426+0000","last_active":"2024-09-12T01:56:05.187722+0000","last_peered":"2024-09-12T01:56:05.187722+0000","last_clean":"2024-09-12T01:56:05.187722+0000","last_became_active":"2024-09-12T01:55:05.544019+0000","last_became_peered":"2024-09-12T01:55:05.544019+0000","last_unstale":"2024-09-12T01:56:05.187722+0000","last_undegraded":"2024-09-12T01:56:05.187722+0000","last_fullsized":"2024-09-12T01:56:05.187722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:47.457102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264457+0000","last_change":"2024-09-12T01:55:07.604918+0000","last_active":"2024-09-12T01:56:33.264457+0000","last_peered":"2024-09-12T01:56:33.264457+0000","last_clean":"2024-09-12T01:56:33.264457+0000","last_became_active":"2024-09-12T01:55:07.604420+0000","last_became_peered":"2024-09-12T01:55:07.604420+0000","last_unstale":"2024-09-12T01:56:33.264457+0000","last_undegraded":"2024-09-12T01:56:33.264457+0000","last_fullsized":"2024-09-12T01:56:33.264457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:20.044111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889110+0000","last_change":"2024-09-12T01:55:05.539370+0000","last_active":"2024-09-12T01:56:04.889110+0000","last_peered":"2024-09-12T01:56:04.889110+0000","last_clean":"2024-09-12T01:56:04.889110+0000","last_became_active":"2024-09-12T01:55:05.539068+0000","last_became_peered":"2024-09-12T01:55:05.539068+0000","last_unstale":"2024-09-12T01:56:04.889110+0000","last_undegraded":"2024-09-12T01:56:04.889110+0000","last_fullsized":"2024-09-12T01:56:04.889110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:41.497640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.262600+0000","last_change":"2024-09-12T01:55:07.602515+0000","last_active":"2024-09-12T01:56:33.262600+0000","last_peered":"2024-09-12T01:56:33.262600+0000","last_clean":"2024-09-12T01:56:33.262600+0000","last_became_active":"2024-09-12T01:55:07.601897+0000","last_became_peered":"2024-09-12T01:55:07.601897+0000","last_unstale":"2024-09-12T01:56:33.262600+0000","last_undegraded":"2024-09-12T01:56:33.262600+0000","last_fullsized":"2024-09-12T01:56:33.262600+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:33.065615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.899251+0000","last_change":"2024-09-12T01:56:04.898877+0000","last_active":"2024-09-12T01:56:04.899251+0000","last_peered":"2024-09-12T01:56:04.899251+0000","last_clean":"2024-09-12T01:56:04.899251+0000","last_became_active":"2024-09-12T01:56:04.893652+0000","last_became_peered":"2024-09-12T01:56:04.893652+0000","last_unstale":"2024-09-12T01:56:04.899251+0000","last_undegraded":"2024-09-12T01:56:04.899251+0000","last_fullsized":"2024-09-12T01:56:04.899251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:18.499812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.247948+0000","last_change":"2024-09-12T01:55:07.600997+0000","last_active":"2024-09-12T01:56:33.247948+0000","last_peered":"2024-09-12T01:56:33.247948+0000","last_clean":"2024-09-12T01:56:33.247948+0000","last_became_active":"2024-09-12T01:55:07.600707+0000","last_became_peered":"2024-09-12T01:55:07.600707+0000","last_unstale":"2024-09-12T01:56:33.247948+0000","last_undegraded":"2024-09-12T01:56:33.247948+0000","last_fullsized":"2024-09-12T01:56:33.247948+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:53.271667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.606372+0000","last_change":"2024-09-12T01:55:05.539133+0000","last_active":"2024-09-12T01:56:33.606372+0000","last_peered":"2024-09-12T01:56:33.606372+0000","last_clean":"2024-09-12T01:56:33.606372+0000","last_became_active":"2024-09-12T01:55:05.538737+0000","last_became_peered":"2024-09-12T01:55:05.538737+0000","last_unstale":"2024-09-12T01:56:33.606372+0000","last_undegraded":"2024-09-12T01:56:33.606372+0000","last_fullsized":"2024-09-12T01:56:33.606372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:07.871771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.258168+0000","last_change":"2024-09-12T01:55:07.603421+0000","last_active":"2024-09-12T01:56:33.258168+0000","last_peered":"2024-09-12T01:56:33.258168+0000","last_clean":"2024-09-12T01:56:33.258168+0000","last_became_active":"2024-09-12T01:55:07.603091+0000","last_became_peered":"2024-09-12T01:55:07.603091+0000","last_unstale":"2024-09-12T01:56:33.258168+0000","last_undegraded":"2024-09-12T01:56:33.258168+0000","last_fullsized":"2024-09-12T01:56:33.258168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:40.743741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.887834+0000","last_change":"2024-09-12T01:55:05.780524+0000","last_active":"2024-09-12T01:56:04.887834+0000","last_peered":"2024-09-12T01:56:04.887834+0000","last_clean":"2024-09-12T01:56:04.887834+0000","last_became_active":"2024-09-12T01:55:05.780166+0000","last_became_peered":"2024-09-12T01:55:05.780166+0000","last_unstale":"2024-09-12T01:56:04.887834+0000","last_undegraded":"2024-09-12T01:56:04.887834+0000","last_fullsized":"2024-09-12T01:56:04.887834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:42.128785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.251173+0000","last_change":"2024-09-12T01:55:07.602019+0000","last_active":"2024-09-12T01:56:33.251173+0000","last_peered":"2024-09-12T01:56:33.251173+0000","last_clean":"2024-09-12T01:56:33.251173+0000","last_became_active":"2024-09-12T01:55:07.601699+0000","last_became_peered":"2024-09-12T01:55:07.601699+0000","last_unstale":"2024-09-12T01:56:33.251173+0000","last_undegraded":"2024-09-12T01:56:33.251173+0000","last_fullsized":"2024-09-12T01:56:33.251173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:29.261770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:05.524200+0000","last_change":"2024-09-12T01:55:05.541901+0000","last_active":"2024-09-12T01:56:05.524200+0000","last_peered":"2024-09-12T01:56:05.524200+0000","last_clean":"2024-09-12T01:56:05.524200+0000","last_became_active":"2024-09-12T01:55:05.541414+0000","last_became_peered":"2024-09-12T01:55:05.541414+0000","last_unstale":"2024-09-12T01:56:05.524200+0000","last_undegraded":"2024-09-12T01:56:05.524200+0000","last_fullsized":"2024-09-12T01:56:05.524200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:35.235769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.223179+0000","last_change":"2024-09-12T01:55:07.610418+0000","last_active":"2024-09-12T01:56:33.223179+0000","last_peered":"2024-09-12T01:56:33.223179+0000","last_clean":"2024-09-12T01:56:33.223179+0000","last_became_active":"2024-09-12T01:55:07.610064+0000","last_became_peered":"2024-09-12T01:55:07.610064+0000","last_unstale":"2024-09-12T01:56:33.223179+0000","last_undegraded":"2024-09-12T01:56:33.223179+0000","last_fullsized":"2024-09-12T01:56:33.223179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.520127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890848+0000","last_change":"2024-09-12T01:55:05.540092+0000","last_active":"2024-09-12T01:56:04.890848+0000","last_peered":"2024-09-12T01:56:04.890848+0000","last_clean":"2024-09-12T01:56:04.890848+0000","last_became_active":"2024-09-12T01:55:05.539727+0000","last_became_peered":"2024-09-12T01:55:05.539727+0000","last_unstale":"2024-09-12T01:56:04.890848+0000","last_undegraded":"2024-09-12T01:56:04.890848+0000","last_fullsized":"2024-09-12T01:56:04.890848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:53.910510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.249887+0000","last_change":"2024-09-12T01:55:07.611219+0000","last_active":"2024-09-12T01:56:33.249887+0000","last_peered":"2024-09-12T01:56:33.249887+0000","last_clean":"2024-09-12T01:56:33.249887+0000","last_became_active":"2024-09-12T01:55:07.610724+0000","last_became_peered":"2024-09-12T01:55:07.610724+0000","last_unstale":"2024-09-12T01:56:33.249887+0000","last_undegraded":"2024-09-12T01:56:33.249887+0000","last_fullsized":"2024-09-12T01:56:33.249887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:56.162312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.896929+0000","last_change":"2024-09-12T01:56:04.896521+0000","last_active":"2024-09-12T01:56:04.896929+0000","last_peered":"2024-09-12T01:56:04.896929+0000","last_clean":"2024-09-12T01:56:04.896929+0000","last_became_active":"2024-09-12T01:56:04.893540+0000","last_became_peered":"2024-09-12T01:56:04.893540+0000","last_unstale":"2024-09-12T01:56:04.896929+0000","last_undegraded":"2024-09-12T01:56:04.896929+0000","last_fullsized":"2024-09-12T01:56:04.896929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:52.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263863+0000","last_change":"2024-09-12T01:55:07.605017+0000","last_active":"2024-09-12T01:56:33.263863+0000","last_peered":"2024-09-12T01:56:33.263863+0000","last_clean":"2024-09-12T01:56:33.263863+0000","last_became_active":"2024-09-12T01:55:07.604535+0000","last_became_peered":"2024-09-12T01:55:07.604535+0000","last_unstale":"2024-09-12T01:56:33.263863+0000","last_undegraded":"2024-09-12T01:56:33.263863+0000","last_fullsized":"2024-09-12T01:56:33.263863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.459144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890755+0000","last_change":"2024-09-12T01:55:05.544640+0000","last_active":"2024-09-12T01:56:04.890755+0000","last_peered":"2024-09-12T01:56:04.890755+0000","last_clean":"2024-09-12T01:56:04.890755+0000","last_became_active":"2024-09-12T01:55:05.544325+0000","last_became_peered":"2024-09-12T01:55:05.544325+0000","last_unstale":"2024-09-12T01:56:04.890755+0000","last_undegraded":"2024-09-12T01:56:04.890755+0000","last_fullsized":"2024-09-12T01:56:04.890755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:29.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266449+0000","last_change":"2024-09-12T01:55:07.613223+0000","last_active":"2024-09-12T01:56:33.266449+0000","last_peered":"2024-09-12T01:56:33.266449+0000","last_clean":"2024-09-12T01:56:33.266449+0000","last_became_active":"2024-09-12T01:55:07.612571+0000","last_became_peered":"2024-09-12T01:55:07.612571+0000","last_unstale":"2024-09-12T01:56:33.266449+0000","last_undegraded":"2024-09-12T01:56:33.266449+0000","last_fullsized":"2024-09-12T01:56:33.266449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:07.953645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.264228+0000","last_change":"2024-09-12T01:55:07.598755+0000","last_active":"2024-09-12T01:56:33.264228+0000","last_peered":"2024-09-12T01:56:33.264228+0000","last_clean":"2024-09-12T01:56:33.264228+0000","last_became_active":"2024-09-12T01:55:07.598443+0000","last_became_peered":"2024-09-12T01:55:07.598443+0000","last_unstale":"2024-09-12T01:56:33.264228+0000","last_undegraded":"2024-09-12T01:56:33.264228+0000","last_fullsized":"2024-09-12T01:56:33.264228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:41.110122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890924+0000","last_change":"2024-09-12T01:55:05.544275+0000","last_active":"2024-09-12T01:56:04.890924+0000","last_peered":"2024-09-12T01:56:04.890924+0000","last_clean":"2024-09-12T01:56:04.890924+0000","last_became_active":"2024-09-12T01:55:05.542658+0000","last_became_peered":"2024-09-12T01:55:05.542658+0000","last_unstale":"2024-09-12T01:56:04.890924+0000","last_undegraded":"2024-09-12T01:56:04.890924+0000","last_fullsized":"2024-09-12T01:56:04.890924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:26.202661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.266190+0000","last_change":"2024-09-12T01:55:07.605998+0000","last_active":"2024-09-12T01:56:33.266190+0000","last_peered":"2024-09-12T01:56:33.266190+0000","last_clean":"2024-09-12T01:56:33.266190+0000","last_became_active":"2024-09-12T01:55:07.605667+0000","last_became_peered":"2024-09-12T01:55:07.605667+0000","last_unstale":"2024-09-12T01:56:33.266190+0000","last_undegraded":"2024-09-12T01:56:33.266190+0000","last_fullsized":"2024-09-12T01:56:33.266190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.830760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.890790+0000","last_change":"2024-09-12T01:55:05.542246+0000","last_active":"2024-09-12T01:56:04.890790+0000","last_peered":"2024-09-12T01:56:04.890790+0000","last_clean":"2024-09-12T01:56:04.890790+0000","last_became_active":"2024-09-12T01:55:05.541915+0000","last_became_peered":"2024-09-12T01:55:05.541915+0000","last_unstale":"2024-09-12T01:56:04.890790+0000","last_undegraded":"2024-09-12T01:56:04.890790+0000","last_fullsized":"2024-09-12T01:56:04.890790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:37.719668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.263851+0000","last_change":"2024-09-12T01:55:07.611783+0000","last_active":"2024-09-12T01:56:33.263851+0000","last_peered":"2024-09-12T01:56:33.263851+0000","last_clean":"2024-09-12T01:56:33.263851+0000","last_became_active":"2024-09-12T01:55:07.611444+0000","last_became_peered":"2024-09-12T01:55:07.611444+0000","last_unstale":"2024-09-12T01:56:33.263851+0000","last_undegraded":"2024-09-12T01:56:33.263851+0000","last_fullsized":"2024-09-12T01:56:33.263851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:53.364383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.892320+0000","last_change":"2024-09-12T01:55:05.541032+0000","last_active":"2024-09-12T01:56:04.892320+0000","last_peered":"2024-09-12T01:56:04.892320+0000","last_clean":"2024-09-12T01:56:04.892320+0000","last_became_active":"2024-09-12T01:55:05.540726+0000","last_became_peered":"2024-09-12T01:55:05.540726+0000","last_unstale":"2024-09-12T01:56:04.892320+0000","last_undegraded":"2024-09-12T01:56:04.892320+0000","last_fullsized":"2024-09-12T01:56:04.892320+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:32.574848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:33.253949+0000","last_change":"2024-09-12T01:55:07.605586+0000","last_active":"2024-09-12T01:56:33.253949+0000","last_peered":"2024-09-12T01:56:33.253949+0000","last_clean":"2024-09-12T01:56:33.253949+0000","last_became_active":"2024-09-12T01:55:07.605282+0000","last_became_peered":"2024-09-12T01:55:07.605282+0000","last_unstale":"2024-09-12T01:56:33.253949+0000","last_undegraded":"2024-09-12T01:56:33.253949+0000","last_fullsized":"2024-09-12T01:56:33.253949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:06.561629+0000","last_clean_scrub_stamp":"2024-09-12T01:55:06.561629+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:00.996986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:56:04.889848+0000","last_change":"2024-09-12T01:55:05.540217+0000","last_active":"2024-09-12T01:56:04.889848+0000","last_peered":"2024-09-12T01:56:04.889848+0000","last_clean":"2024-09-12T01:56:04.889848+0000","last_became_active":"2024-09-12T01:55:05.539907+0000","last_became_peered":"2024-09-12T01:55:05.539907+0000","last_unstale":"2024-09-12T01:56:04.889848+0000","last_undegraded":"2024-09-12T01:56:04.889848+0000","last_fullsized":"2024-09-12T01:56:04.889848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:55:04.520890+0000","last_clean_scrub_stamp":"2024-09-12T01:55:04.520890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:00.649071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72384,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":682,"num_read_kb":419,"num_write":175,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":217152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":288347,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579942,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":438514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1098213,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":438728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":438626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1030721,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659199,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":438117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888131,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":1030405,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018953,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":438554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":438428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444116,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":506784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":505124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35019,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36658,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":70012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:57:09.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:09.620 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:09.871 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:09 smithi039 ceph-mon[31204]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:09.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:09 smithi044 ceph-mon[35259]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:10.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:09 smithi172 ceph-mon[35073]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 -- 172.21.15.39:0/3568441272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0106f10 msgr2=0x7f9cb010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3568441272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0106f10 0x7f9cb010ea90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009900 tx=0x7f9ca802a410 comp rx=0 tx=0).stop 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 -- 172.21.15.39:0/3568441272 shutdown_connections 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3568441272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0106f10 0x7f9cb010ea90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3568441272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0102790 0x7f9cb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3568441272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0101de0 0x7f9cb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 -- 172.21.15.39:0/3568441272 >> 172.21.15.39:0/3568441272 conn(0x7f9cb00fd8c0 msgr2=0x7f9cb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 -- 172.21.15.39:0/3568441272 shutdown_connections 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 -- 172.21.15.39:0/3568441272 wait complete. 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.112+0000 7f9cb5902640 1 Processor -- start 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 -- start start 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0102790 0x7f9cb0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 0x7f9cb0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0112010 con 0x7f9cb0101de0 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0111e90 con 0x7f9cb0102790 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cb5902640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0112190 con 0x7f9cb0106f10 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43294/0 (socket says 172.21.15.39:43294) 2024-09-12T01:57:10.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 -- 172.21.15.39:0/3810445483 learned_addr learned my addr 172.21.15.39:0/3810445483 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9cae7fc640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0102790 0x7f9cb0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caf7fe640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 0x7f9cb0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 -- 172.21.15.39:0/3810445483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 msgr2=0x7f9cb0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 0x7f9cb0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 -- 172.21.15.39:0/3810445483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0102790 msgr2=0x7f9cb0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0102790 0x7f9cb0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caeffd640 1 -- 172.21.15.39:0/3810445483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb01a6a70 con 0x7f9cb0101de0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.113+0000 7f9caf7fe640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 0x7f9cb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9caeffd640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000ba50 tx=0x7f9ca000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0019070 con 0x7f9cb0101de0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ca0014440 con 0x7f9cb0101de0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb01a6d60 con 0x7f9cb0101de0 2024-09-12T01:57:10.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00075d0 con 0x7f9cb0101de0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.114+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01a7240 con 0x7f9cb0101de0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.115+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb0102240 con 0x7f9cb0101de0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.116+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9ca001c070 con 0x7f9cb0101de0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.117+0000 7f9cb4900640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.117+0000 7f9cae7fc640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.117+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9ca00ceae0 con 0x7f9cb0101de0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.117+0000 7f9cae7fc640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 0x7f9c980a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0075f80 tx=0x7f9ca4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.120+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ca009ba50 con 0x7f9cb0101de0 2024-09-12T01:57:10.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.334+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb0075a20 con 0x7f9cb0101de0 2024-09-12T01:57:10.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.335+0000 7f9cb4900640 1 -- 172.21.15.39:0/3810445483 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f9ca009b350 con 0x7f9cb0101de0 2024-09-12T01:57:10.335 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:10.335 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:10.336 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:10.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.337+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 msgr2=0x7f9c980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:10.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.337+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 0x7f9c980a5040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0075f80 tx=0x7f9ca4009110 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.337+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 msgr2=0x7f9cb00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.337+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000ba50 tx=0x7f9ca000be50 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 shutdown_connections 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c980a2b80 0x7f9c980a5040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cb0106f10 0x7f9cb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cb0102790 0x7f9cb0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 --2- 172.21.15.39:0/3810445483 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9cb0101de0 0x7f9cb00744f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 >> 172.21.15.39:0/3810445483 conn(0x7f9cb00fd8c0 msgr2=0x7f9cb00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 shutdown_connections 2024-09-12T01:57:10.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:10.338+0000 7f9cb5902640 1 -- 172.21.15.39:0/3810445483 wait complete. 2024-09-12T01:57:10.768 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:10 smithi039 ceph-mon[31204]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T01:57:10.768 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:10 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3810445483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:10 smithi044 ceph-mon[35259]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T01:57:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:10 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3810445483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:10 smithi172 ceph-mon[35073]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T01:57:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:10 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3810445483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:11.102 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:11.365 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.846+0000 7fa775096640 1 -- 172.21.15.39:0/69194490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770100e20 msgr2=0x7fa770101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.846+0000 7fa775096640 1 --2- 172.21.15.39:0/69194490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770100e20 0x7fa770101200 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa760009900 tx=0x7fa76002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.846+0000 7fa775096640 1 -- 172.21.15.39:0/69194490 shutdown_connections 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 --2- 172.21.15.39:0/69194490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 --2- 172.21.15.39:0/69194490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770102570 0x7fa7701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 --2- 172.21.15.39:0/69194490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770100e20 0x7fa770101200 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 -- 172.21.15.39:0/69194490 >> 172.21.15.39:0/69194490 conn(0x7fa7700fc7d0 msgr2=0x7fa7700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 -- 172.21.15.39:0/69194490 shutdown_connections 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 -- 172.21.15.39:0/69194490 wait complete. 2024-09-12T01:57:11.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 Processor -- start 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.847+0000 7fa775096640 1 -- start start 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770100e20 0x7fa7701984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7701120a0 con 0x7fa770102570 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa770111f20 con 0x7fa770100e20 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa775096640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa770112220 con 0x7fa770102ef0 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43320/0 (socket says 172.21.15.39:43320) 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 -- 172.21.15.39:0/2432120580 learned_addr learned my addr 172.21.15.39:0/2432120580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76f59e640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:11.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76ed9d640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770100e20 0x7fa7701984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 -- 172.21.15.39:0/2432120580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 msgr2=0x7fa77019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 -- 172.21.15.39:0/2432120580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770100e20 msgr2=0x7fa7701984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770100e20 0x7fa7701984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 -- 172.21.15.39:0/2432120580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77019d450 con 0x7fa770102570 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76f59e640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.848+0000 7fa76e59c640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa76400e9f0 tx=0x7fa76400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.849+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76400cd80 con 0x7fa770102570 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.849+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77019d740 con 0x7fa770102570 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.849+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7701a5020 con 0x7fa770102570 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.849+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa764010910 con 0x7fa770102570 2024-09-12T01:57:11.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.849+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa764018980 con 0x7fa770102570 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.850+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c005290 con 0x7fa770102570 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.851+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa764010ac0 con 0x7fa770102570 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.851+0000 7fa757fff640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 0x7fa7580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.851+0000 7fa76ed9d640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 0x7fa7580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.852+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7640cf3e0 con 0x7fa770102570 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.852+0000 7fa76ed9d640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 0x7fa7580a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa760005ab0 tx=0x7fa760005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:11.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:11.855+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa76409c350 con 0x7fa770102570 2024-09-12T01:57:12.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.066+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa75c005580 con 0x7fa770102570 2024-09-12T01:57:12.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.067+0000 7fa757fff640 1 -- 172.21.15.39:0/2432120580 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7fa76409bc50 con 0x7fa770102570 2024-09-12T01:57:12.067 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:12.067 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:12.067 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 msgr2=0x7fa7580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 0x7fa7580a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa760005ab0 tx=0x7fa760005a20 comp rx=0 tx=0).stop 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 msgr2=0x7fa7701989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa76400e9f0 tx=0x7fa76400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 shutdown_connections 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7580a2b80 0x7fa7580a5040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa770102ef0 0x7fa77019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa770102570 0x7fa7701989e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 --2- 172.21.15.39:0/2432120580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa770100e20 0x7fa7701984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:12.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 >> 172.21.15.39:0/2432120580 conn(0x7fa7700fc7d0 msgr2=0x7fa7700fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:12.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 shutdown_connections 2024-09-12T01:57:12.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:12.069+0000 7fa775096640 1 -- 172.21.15.39:0/2432120580 wait complete. 2024-09-12T01:57:12.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:12 smithi039 ceph-mon[31204]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T01:57:12.720 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:12 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2432120580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:12.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:57:12.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:12 smithi044 ceph-mon[35259]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T01:57:12.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:12 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2432120580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:12 smithi172 ceph-mon[35073]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-12T01:57:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:12 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2432120580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:13.010 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:13.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- 172.21.15.39:0/3238698339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c100a80 msgr2=0x7efd9c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 --2- 172.21.15.39:0/3238698339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c100a80 0x7efd9c100ee0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009930 tx=0x7efd8c02a420 comp rx=0 tx=0).stop 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- 172.21.15.39:0/3238698339 shutdown_connections 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 --2- 172.21.15.39:0/3238698339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c101420 0x7efd9c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 --2- 172.21.15.39:0/3238698339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c100a80 0x7efd9c100ee0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 --2- 172.21.15.39:0/3238698339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c106a80 0x7efd9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- 172.21.15.39:0/3238698339 >> 172.21.15.39:0/3238698339 conn(0x7efd9c0fc7a0 msgr2=0x7efd9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- 172.21.15.39:0/3238698339 shutdown_connections 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- 172.21.15.39:0/3238698339 wait complete. 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 Processor -- start 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.528+0000 7efda3866640 1 -- start start 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c100a80 0x7efd9c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:13.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 0x7efd9c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c110e80 con 0x7efd9c101420 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c110d00 con 0x7efd9c106a80 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda3866640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c111000 con 0x7efd9c100a80 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49544/0 (socket says 172.21.15.39:49544) 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 -- 172.21.15.39:0/1954623851 learned_addr learned my addr 172.21.15.39:0/1954623851 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda1602640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c100a80 0x7efd9c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda1e03640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 0x7efd9c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 -- 172.21.15.39:0/1954623851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c100a80 msgr2=0x7efd9c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c100a80 0x7efd9c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 -- 172.21.15.39:0/1954623851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 msgr2=0x7efd9c1a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 0x7efd9c1a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 -- 172.21.15.39:0/1954623851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1a48d0 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda1e03640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 0x7efd9c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efda0e01640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009230 tx=0x7efd8c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.529+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c03f030 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.530+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c1a4aa0 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.530+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c004440 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.530+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c035070 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.530+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1a4f50 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.531+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c100ee0 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.532+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efd8c042030 con 0x7efd9c101420 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.533+0000 7efd927fc640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 0x7efd880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.533+0000 7efda1602640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 0x7efd880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:13.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.533+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efd8c0ef400 con 0x7efd9c101420 2024-09-12T01:57:13.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.533+0000 7efda1602640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 0x7efd880a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd98009b50 tx=0x7efd98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:13.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.537+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd8c0bc370 con 0x7efd9c101420 2024-09-12T01:57:13.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.716+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd9c108ff0 con 0x7efd9c101420 2024-09-12T01:57:13.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.718+0000 7efd927fc640 1 -- 172.21.15.39:0/1954623851 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22679 (secure 0 0 0) 0x7efd8c0bbc70 con 0x7efd9c101420 2024-09-12T01:57:13.718 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:13.719 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":82,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T01:56:04.883161+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 msgr2=0x7efd880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 0x7efd880a5040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd98009b50 tx=0x7efd98005f90 comp rx=0 tx=0).stop 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 msgr2=0x7efd9c199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009230 tx=0x7efd8c004040 comp rx=0 tx=0).stop 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 shutdown_connections 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c106a80 0x7efd9c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c101420 0x7efd9c199850 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efd880a2b80 0x7efd880a5040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 --2- 172.21.15.39:0/1954623851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c100a80 0x7efd9c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:13.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 >> 172.21.15.39:0/1954623851 conn(0x7efd9c0fc7a0 msgr2=0x7efd9c0fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:13.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 shutdown_connections 2024-09-12T01:57:13.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:13.720+0000 7efda3866640 1 -- 172.21.15.39:0/1954623851 wait complete. 2024-09-12T01:57:14.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T01:57:14.616 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:14.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:14 smithi039 ceph-mon[31204]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:57:14.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:14 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1954623851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:14.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:14 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:14 smithi044 ceph-mon[35259]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:57:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:14 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1954623851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:14 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:14.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:14 smithi172 ceph-mon[35073]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:57:14.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:14 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1954623851' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:57:14.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:14 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 -- 172.21.15.39:0/2774161127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4102610 msgr2=0x7f15d4108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 --2- 172.21.15.39:0/2774161127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4102610 0x7f15d4108ea0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ca0 tx=0x7f15cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 -- 172.21.15.39:0/2774161127 shutdown_connections 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 --2- 172.21.15.39:0/2774161127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4102610 0x7f15d4108ea0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 --2- 172.21.15.39:0/2774161127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4101c50 0x7f15d41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 --2- 172.21.15.39:0/2774161127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4100a60 0x7f15d4100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.278+0000 7f15dad52640 1 -- 172.21.15.39:0/2774161127 >> 172.21.15.39:0/2774161127 conn(0x7f15d40fc1e0 msgr2=0x7f15d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- 172.21.15.39:0/2774161127 shutdown_connections 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- 172.21.15.39:0/2774161127 wait complete. 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 Processor -- start 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- start start 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 0x7f15d4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 0x7f15d419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f15d410c790 con 0x7f15d4101c50 2024-09-12T01:57:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d410c610 con 0x7f15d4102610 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15dad52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15d410c910 con 0x7f15d4100a60 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49558/0 (socket says 172.21.15.39:49558) 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.279+0000 7f15d3fff640 1 -- 172.21.15.39:0/1452903362 learned_addr learned my addr 172.21.15.39:0/1452903362 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d92ef640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 0x7f15d419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d8aee640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 0x7f15d4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 -- 172.21.15.39:0/1452903362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 msgr2=0x7f15d4197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 0x7f15d4197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 -- 172.21.15.39:0/1452903362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 msgr2=0x7f15d419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 0x7f15d419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 -- 172.21.15.39:0/1452903362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d419fa60 con 0x7f15d4101c50 2024-09-12T01:57:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d92ef640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 0x7f15d419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d8aee640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 0x7f15d4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b4a0 tx=0x7f15c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d1ffb640 1 -- 172.21.15.39:0/1452903362 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0014070 con 0x7f15d4101c50 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d419fd50 con 0x7f15d4101c50 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d1ffb640 1 -- 172.21.15.39:0/1452903362 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0010af0 con 0x7f15d4101c50 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15d1ffb640 1 -- 172.21.15.39:0/1452903362 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0017d10 con 0x7f15d4101c50 2024-09-12T01:57:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.280+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a0240 con 0x7f15d4101c50 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.282+0000 7f15d1ffb640 1 -- 172.21.15.39:0/1452903362 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f15c0017070 con 0x7f15d4101c50 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 Processor -- start 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 -- start start 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x562761643da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x562761648da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5627615a72f0 con 0x562761649370 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56276154f270 con 0x5627616439a0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627615a32b0 con 0x5627616442e0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d1ffb640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 0x7f15c40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49564/0 (socket says 172.21.15.39:49564) 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d3fff640 1 -- 172.21.15.39:0/510178876 learned_addr learned my addr 172.21.15.39:0/510178876 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d8aee640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x562761648da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d92ef640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x562761643da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d92ef640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 0x7f15c40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d1ffb640 1 -- 172.21.15.39:0/1452903362 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15c00ce450 con 0x7f15d4101c50 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d8aee640 1 -- 172.21.15.39:0/510178876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 msgr2=0x562761643da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d8aee640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x562761643da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.283+0000 7f15d8aee640 1 -- 172.21.15.39:0/510178876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 msgr2=0x56276164b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15d8aee640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15d8aee640 1 -- 172.21.15.39:0/510178876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276154e340 con 0x5627616442e0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15d3fff640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15d92ef640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 0x7f15c40a50f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15cc031c10 tx=0x7f15cc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15d8aee640 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x562761648da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15c8005d00 tx=0x7f15c800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd7a2200c4dee66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15beffd640 1 -- 172.21.15.39:0/510178876 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8016070 con 0x5627616442e0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15beffd640 1 -- 172.21.15.39:0/510178876 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c8011950 con 0x5627616442e0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.284+0000 7f15beffd640 1 -- 172.21.15.39:0/510178876 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80107d0 con 0x5627616442e0 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- 172.21.15.39:0/510178876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 msgr2=0x562761648da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x562761648da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f15c8005d00 tx=0x7f15c800e6c0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- 172.21.15.39:0/510178876 shutdown_connections 2024-09-12T01:57:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x56276164b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x562761648da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/510178876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x562761643da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- 172.21.15.39:0/510178876 >> 172.21.15.39:0/510178876 conn(0x56276163f010 msgr2=0x56276163f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- 172.21.15.39:0/510178876 shutdown_connections 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- 172.21.15.39:0/510178876 wait complete. 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 -- start start 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.285+0000 7f15ddbc9740 1 Processor -- start 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x56276164dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x56276164e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56276164c340 con 0x562761649370 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562761530290 con 0x5627616439a0 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56276164c4c0 con 0x5627616442e0 2024-09-12T01:57:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15ddbc9740 10 client.0 _ll_register_callbacks cb 0x562761561140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49572/0 (socket says 172.21.15.39:49572) 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 -- 172.21.15.39:0/2478648653 learned_addr learned my addr 172.21.15.39:0/2478648653 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d3fff640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x56276164e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d8aee640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x56276164dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 -- 172.21.15.39:0/2478648653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 msgr2=0x56276164e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x56276164e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 -- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 msgr2=0x56276164dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x56276164dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 -- 172.21.15.39:0/2478648653 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627612ba210 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d3fff640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x56276164e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15d92ef640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15cc035000 tx=0x7f15cc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99018e1e065a2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.286+0000 7f15b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc051030 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15cc047070 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c8011950 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15cc0047d0 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 10 client.15294 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562761386620 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c8011950 con 0x562761649370 2024-09-12T01:57:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15cc04a050 con 0x562761649370 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 10 client.15294 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 20 client.15294 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616597f0 0x56276165bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 4 client.15294 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627615b4a20 con 0x5627616597f0 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.287+0000 7f15d8aee640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616597f0 0x56276165bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.288+0000 7f15d8aee640 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616597f0 0x56276165bbe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5d08e9c47511d5 server_cookie=5250358f56994503 in_seq=0 out_seq=0 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.288+0000 7f15b3fff640 10 client.15294 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.288+0000 7f15b3fff640 1 -- 172.21.15.39:0/2478648653 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627615b4a20 con 0x5627616597f0 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.288+0000 7f15b3fff640 10 client.15294 handle_command_reply: tid=0 2024-09-12T01:57:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.288+0000 7f15ddbc9740 1 client.15294 shutdown 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 msgr2=0x5627616550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15cc035000 tx=0x7f15cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 shutdown_connections 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616597f0 0x56276165bbe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x5627616550e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616442e0 0x56276164e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15b3fff640 0 client.15294 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/2478648653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616439a0 0x56276164dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 >> 172.21.15.39:0/2478648653 conn(0x56276163f010 msgr2=0x562761640820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 shutdown_connections 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 1 -- 172.21.15.39:0/2478648653 wait complete. 2024-09-12T01:57:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.289+0000 7f15ddbc9740 20 client.15294 trim_cache size 0 max 16384 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.303+0000 7f15ddbc9740 1 Processor -- start 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.303+0000 7f15ddbc9740 1 -- start start 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x56276163e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562761649370 0x5627616604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ab970 con 0x5627616442e0 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a9240 con 0x562761649370 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a7090 con 0x5627616439a0 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49586/0 (socket says 172.21.15.39:49586) 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 -- 172.21.15.39:0/1555358590 learned_addr learned my addr 172.21.15.39:0/1555358590 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d8aee640 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x56276163e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d92ef640 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562761649370 0x5627616604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.309 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 -- 172.21.15.39:0/1555358590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 msgr2=0x56276163e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x56276163e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 -- 172.21.15.39:0/1555358590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562761649370 msgr2=0x5627616604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562761649370 0x5627616604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 -- 172.21.15.39:0/1555358590 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276165bf50 con 0x5627616442e0 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15d3fff640 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f15c0097690 tx=0x7f15c00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a0533d7ef13439 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15be7fc640 1 -- 172.21.15.39:0/1555358590 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c001e040 con 0x5627616442e0 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15be7fc640 1 -- 172.21.15.39:0/1555358590 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0098fc0 con 0x5627616442e0 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.304+0000 7f15be7fc640 1 -- 172.21.15.39:0/1555358590 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00ce0f0 con 0x5627616442e0 2024-09-12T01:57:15.310 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- 172.21.15.39:0/1555358590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 msgr2=0x5627616550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f15c0097690 tx=0x7f15c00047d0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- 172.21.15.39:0/1555358590 shutdown_connections 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562761649370 0x5627616604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5627616442e0 0x5627616550a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/1555358590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x56276163e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- 172.21.15.39:0/1555358590 >> 172.21.15.39:0/1555358590 conn(0x56276163f010 msgr2=0x56276163d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- 172.21.15.39:0/1555358590 shutdown_connections 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- 172.21.15.39:0/1555358590 wait complete. 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 -- start start 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.305+0000 7f15ddbc9740 1 Processor -- start 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x562761652760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.311 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a7700 con 0x562761649370 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a8b70 con 0x5627616442e0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41a7dd0 con 0x5627616439a0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15ddbc9740 10 client.0 _ll_register_callbacks cb 0x7f15cc02f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d92ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d8aee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x562761652760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:46892/0 (socket says 172.21.15.39:46892) 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d8aee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x562761652760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:35232/0 (socket says 172.21.15.39:35232) 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d92ef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49600/0 (socket says 172.21.15.39:49600) 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 -- 172.21.15.39:0/4229918663 learned_addr learned my addr 172.21.15.39:0/4229918663 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:15.312 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 -- 172.21.15.39:0/4229918663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 msgr2=0x562761652760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x562761652760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 -- 172.21.15.39:0/4229918663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 msgr2=0x562761653cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d3fff640 1 -- 172.21.15.39:0/4229918663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627616542c0 con 0x5627616442e0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.306+0000 7f15d92ef640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15d3fff640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15c0097120 tx=0x7f15c00a3ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e48734633ef7b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00b7020 con 0x5627616442e0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15c0017360 con 0x5627616442e0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0098fc0 con 0x5627616442e0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15c001e070 con 0x5627616442e0 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 10 client.24956 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627616c44c0 con 0x5627616442e0 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0098fc0 con 0x5627616442e0 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15c0063030 con 0x5627616442e0 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 10 client.24956 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 10 client.24956 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 20 client.24956 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616c4e40 0x5627616c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 4 client.24956 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5627615aed70 con 0x5627616c4e40 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.307+0000 7f15d8aee640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616c4e40 0x5627616c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.308+0000 7f15d8aee640 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616c4e40 0x5627616c7260 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f60c50836ccc035 server_cookie=432ff05473d80171 in_seq=0 out_seq=0 2024-09-12T01:57:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.308+0000 7f15b3fff640 10 client.24956 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.316+0000 7f15b3fff640 1 -- 172.21.15.39:0/4229918663 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627615aed70 con 0x5627616c4e40 2024-09-12T01:57:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.316+0000 7f15b3fff640 10 client.24956 handle_command_reply: tid=0 2024-09-12T01:57:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.316+0000 7f15ddbc9740 1 client.24956 shutdown 2024-09-12T01:57:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 msgr2=0x562761652ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15c0097120 tx=0x7f15c00a3ab0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 shutdown_connections 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5627616c4e40 0x5627616c7260 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562761649370 0x562761653cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627616442e0 0x562761652ca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 --2- 172.21.15.39:0/4229918663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627616439a0 0x562761652760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15b3fff640 0 client.24956 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 >> 172.21.15.39:0/4229918663 conn(0x56276163f010 msgr2=0x56276163e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 shutdown_connections 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 1 -- 172.21.15.39:0/4229918663 wait complete. 2024-09-12T01:57:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.317+0000 7f15ddbc9740 20 client.24956 trim_cache size 0 max 16384 2024-09-12T01:57:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:57:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:57:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:57:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 msgr2=0x7f15c40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 0x7f15c40a50f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f15cc031c10 tx=0x7f15cc0095c0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 msgr2=0x7f15d4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b4a0 tx=0x7f15c000b960 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 shutdown_connections 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d4102610 0x7f15d419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15d4101c50 0x7f15d4198380 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f15c40a2c30 0x7f15c40a50f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 --2- 172.21.15.39:0/1452903362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15d4100a60 0x7f15d4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 >> 172.21.15.39:0/1452903362 conn(0x7f15d40fc1e0 msgr2=0x7f15d40fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 shutdown_connections 2024-09-12T01:57:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:15.318+0000 7f15dad52640 1 -- 172.21.15.39:0/1452903362 wait complete. 2024-09-12T01:57:15.815 INFO:teuthology.orchestra.run.smithi039.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T01:57:15.815 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T01:57:15.816 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T01:57:15.816 DEBUG:tasks.quiescer:Yielding 2024-09-12T01:57:15.816 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:57:15.831 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:57:15.831 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:57:15.831 INFO:tasks.workunit:timeout=3h 2024-09-12T01:57:15.831 INFO:tasks.workunit:cleanup=True 2024-09-12T01:57:15.831 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:15.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 01:55:26.663220709 +0000 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 01:55:26.663220709 +0000 2024-09-12T01:57:15.851 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 01:56:53.346469223 +0000 2024-09-12T01:57:15.852 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 01:55:26.663220709 +0000 2024-09-12T01:57:15.852 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:57:15.852 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T01:57:15.926 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:57:15.982 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:57:16.685 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:17.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:16 smithi039 ceph-mon[31204]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:57:17.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.135 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:16 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:16 smithi044 ceph-mon[35259]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:57:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:16 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 -- 172.21.15.39:0/680732305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 msgr2=0x7efdc0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 --2- 172.21.15.39:0/680732305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0101200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009900 tx=0x7efdb002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 -- 172.21.15.39:0/680732305 shutdown_connections 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 --2- 172.21.15.39:0/680732305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102ef0 0x7efdc010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 --2- 172.21.15.39:0/680732305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102570 0x7efdc01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 --2- 172.21.15.39:0/680732305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0101200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 -- 172.21.15.39:0/680732305 >> 172.21.15.39:0/680732305 conn(0x7efdc00fc7d0 msgr2=0x7efdc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 -- 172.21.15.39:0/680732305 shutdown_connections 2024-09-12T01:57:17.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.224+0000 7efdc4d40640 1 -- 172.21.15.39:0/680732305 wait complete. 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 Processor -- start 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 -- start start 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102570 0x7efdc0103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 0x7efdc01041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0110f80 con 0x7efdc0100e20 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0110e00 con 0x7efdc0102570 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdc4d40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0111100 con 0x7efdc0102ef0 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdbe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdbe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49616/0 (socket says 172.21.15.39:49616) 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdbe59c640 1 -- 172.21.15.39:0/1907463705 learned_addr learned my addr 172.21.15.39:0/1907463705 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:17.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.225+0000 7efdbdd9b640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102570 0x7efdc0103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbed9d640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 0x7efdc01041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 -- 172.21.15.39:0/1907463705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 msgr2=0x7efdc01041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 0x7efdc01041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 -- 172.21.15.39:0/1907463705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102570 msgr2=0x7efdc0103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102570 0x7efdc0103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 -- 172.21.15.39:0/1907463705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc01a6a30 con 0x7efdc0100e20 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbed9d640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 0x7efdc01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdbe59c640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efdb0006010 tx=0x7efdb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb003f070 con 0x7efdc0100e20 2024-09-12T01:57:17.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc01a6cc0 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb0031c30 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0035030 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.226+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc01a71a0 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.227+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc0101200 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.228+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efdb0042070 con 0x7efdc0100e20 2024-09-12T01:57:17.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.229+0000 7efdaf7fe640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 0x7efda80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.229+0000 7efdbdd9b640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 0x7efda80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.229+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdb00ef8a0 con 0x7efdc0100e20 2024-09-12T01:57:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.230+0000 7efdbdd9b640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 0x7efda80a5040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdc00ffd80 tx=0x7efdb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:17.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.234+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdb0031de0 con 0x7efdc0100e20 2024-09-12T01:57:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:16 smithi172 ceph-mon[35073]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:57:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:16 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:17.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.458+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdc01a7400 con 0x7efdc0100e20 2024-09-12T01:57:17.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.459+0000 7efdaf7fe640 1 -- 172.21.15.39:0/1907463705 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7efdb00bc810 con 0x7efdc0100e20 2024-09-12T01:57:17.459 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:17.459 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:17.459 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 msgr2=0x7efda80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 0x7efda80a5040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efdc00ffd80 tx=0x7efdb400b390 comp rx=0 tx=0).stop 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 msgr2=0x7efdc0103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efdb0006010 tx=0x7efdb0003c10 comp rx=0 tx=0).stop 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 shutdown_connections 2024-09-12T01:57:17.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efda80a2b80 0x7efda80a5040 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc0102ef0 0x7efdc01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc0102570 0x7efdc0103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 --2- 172.21.15.39:0/1907463705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc0100e20 0x7efdc0103750 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 >> 172.21.15.39:0/1907463705 conn(0x7efdc00fc7d0 msgr2=0x7efdc006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 shutdown_connections 2024-09-12T01:57:17.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:17.461+0000 7efdc4d40640 1 -- 172.21.15.39:0/1907463705 wait complete. 2024-09-12T01:57:18.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:17 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1907463705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:17 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:17 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:17 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:57:18.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:55:08.326488+0000', 'modified': '2024-09-12T01:56:54.025226+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24503, 'mds_1': 24467, 'mds_2': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1679490719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1679490719}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1679490719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/4061596538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4061596538}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 4061596538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/2267029874', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2267029874}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2267029874}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6839/3543698961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3543698961}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3543698961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.44:6837/3549353612', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 3549353612}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 3549353612}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/321221291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 321221291}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 321221291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24503, 'qdb_cluster': [24503, 24467, 24463]} 2024-09-12T01:57:18.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T01:57:18.133 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:57:18.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:17 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1907463705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:17 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:17 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:17 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:57:18.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:17 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1907463705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:18.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:17 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:17 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:18.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:17 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:57:18.429 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:18.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 -- 172.21.15.39:0/2864970809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38101de0 msgr2=0x7fac381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 --2- 172.21.15.39:0/2864970809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38101de0 0x7fac381021c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fac28009900 tx=0x7fac2802a410 comp rx=0 tx=0).stop 2024-09-12T01:57:18.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 -- 172.21.15.39:0/2864970809 shutdown_connections 2024-09-12T01:57:18.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 --2- 172.21.15.39:0/2864970809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38106f10 0x7fac3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 --2- 172.21.15.39:0/2864970809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38102790 0x7fac381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 --2- 172.21.15.39:0/2864970809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38101de0 0x7fac381021c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 -- 172.21.15.39:0/2864970809 >> 172.21.15.39:0/2864970809 conn(0x7fac380fd8c0 msgr2=0x7fac380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 -- 172.21.15.39:0/2864970809 shutdown_connections 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.935+0000 7fac3e318640 1 -- 172.21.15.39:0/2864970809 wait complete. 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 Processor -- start 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 -- start start 2024-09-12T01:57:18.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38101de0 0x7fac38198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38106f10 0x7fac3819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac38111f70 con 0x7fac38102790 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac38111df0 con 0x7fac38106f10 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3e318640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac381120f0 con 0x7fac38101de0 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49624/0 (socket says 172.21.15.39:49624) 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 -- 172.21.15.39:0/4181137856 learned_addr learned my addr 172.21.15.39:0/4181137856 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac37fff640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38101de0 0x7fac38198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38106f10 0x7fac3819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 -- 172.21.15.39:0/4181137856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38101de0 msgr2=0x7fac38198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38101de0 0x7fac38198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 -- 172.21.15.39:0/4181137856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38106f10 msgr2=0x7fac3819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38106f10 0x7fac3819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 -- 172.21.15.39:0/4181137856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3819d3e0 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.936+0000 7fac2ffff640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fac2000d950 tx=0x7fac2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.937+0000 7fac35ffb640 1 -- 172.21.15.39:0/4181137856 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20017030 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.937+0000 7fac35ffb640 1 -- 172.21.15.39:0/4181137856 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac20004020 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.937+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3819d6d0 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.937+0000 7fac35ffb640 1 -- 172.21.15.39:0/4181137856 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac200047a0 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.937+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac381a4fb0 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.939+0000 7fac35ffb640 1 -- 172.21.15.39:0/4181137856 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fac200041d0 con 0x7fac38102790 2024-09-12T01:57:18.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.939+0000 7fac406f1740 1 Processor -- start 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.939+0000 7fac406f1740 1 -- start start 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc327f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc32803670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc3275f090 con 0x55bc32803bb0 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc32706a70 con 0x55bc327f89d0 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac406f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc3275b050 con 0x55bc327f92f0 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49632/0 (socket says 172.21.15.39:49632) 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac3c8b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc327f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 -- 172.21.15.39:0/1568222848 learned_addr learned my addr 172.21.15.39:0/1568222848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac37fff640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc32803670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac35ffb640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 0x7fac240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 -- 172.21.15.39:0/1568222848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 msgr2=0x55bc32803670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc32803670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 -- 172.21.15.39:0/1568222848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 msgr2=0x55bc327f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc327f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac2ffff640 1 -- 172.21.15.39:0/1568222848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc32713130 con 0x55bc32803bb0 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc327f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac37fff640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc32803670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 0x7fac240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.940+0000 7fac35ffb640 1 -- 172.21.15.39:0/4181137856 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac200ceaf0 con 0x7fac38102790 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac2ffff640 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac2004caf0 tx=0x7fac20021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8eeb17c19ea58e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac2e7fc640 1 -- 172.21.15.39:0/1568222848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac200d6040 con 0x55bc32803bb0 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 0x7fac240a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac30005fd0 tx=0x7fac30004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac2e7fc640 1 -- 172.21.15.39:0/1568222848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac2004a7a0 con 0x55bc32803bb0 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac2e7fc640 1 -- 172.21.15.39:0/1568222848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2001bc20 con 0x55bc32803bb0 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 -- 172.21.15.39:0/1568222848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 msgr2=0x55bc32805fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac2004caf0 tx=0x7fac20021000 comp rx=0 tx=0).stop 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 -- 172.21.15.39:0/1568222848 shutdown_connections 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32805fa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc32803670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.941+0000 7fac406f1740 1 --2- 172.21.15.39:0/1568222848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc327f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- 172.21.15.39:0/1568222848 >> 172.21.15.39:0/1568222848 conn(0x55bc327f4f60 msgr2=0x55bc327f5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- 172.21.15.39:0/1568222848 shutdown_connections 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- 172.21.15.39:0/1568222848 wait complete. 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- start start 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 Processor -- start 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc328033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f92f0 0x55bc32800710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc32806780 con 0x55bc32803bb0 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc32719f20 con 0x55bc327f92f0 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc32806900 con 0x55bc327f89d0 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.942+0000 7fac406f1740 10 client.0 _ll_register_callbacks cb 0x55bc326e3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49634/0 (socket says 172.21.15.39:49634) 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f92f0 0x55bc32800710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 -- 172.21.15.39:0/2531884813 learned_addr learned my addr 172.21.15.39:0/2531884813 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 -- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 msgr2=0x55bc328033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc328033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 -- 172.21.15.39:0/2531884813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f92f0 msgr2=0x55bc32800710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f92f0 0x55bc32800710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 -- 172.21.15.39:0/2531884813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc324d02b0 con 0x55bc32803bb0 2024-09-12T01:57:18.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac300137c0 tx=0x7fac30004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb438b4691cf1956 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac177fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3001eb60 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac3001ed00 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.943+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc3276c600 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac30023860 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 10 client.15318 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc32812070 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55bc3276c600 con 0x55bc32803bb0 2024-09-12T01:57:18.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac3000f040 con 0x55bc32803bb0 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 10 client.15318 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 10 client.15318 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 20 client.15318 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32814700 0x55bc32815b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 4 client.15318 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc32766b10 con 0x55bc32814700 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.944+0000 7fac37fff640 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32814700 0x55bc32815b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.945+0000 7fac37fff640 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32814700 0x55bc32815b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bd94081b8d09064 server_cookie=dda301007aa4ff7a in_seq=0 out_seq=0 2024-09-12T01:57:18.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.945+0000 7fac177fe640 10 client.15318 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac177fe640 1 -- 172.21.15.39:0/2531884813 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc32766b10 con 0x55bc32814700 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac177fe640 10 client.15318 handle_command_reply: tid=0 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 client.15318 shutdown 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 msgr2=0x55bc32800c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac300137c0 tx=0x7fac30004ab0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 shutdown_connections 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32814700 0x55bc32815b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc32800c50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f92f0 0x55bc32800710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 --2- 172.21.15.39:0/2531884813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc328033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 >> 172.21.15.39:0/2531884813 conn(0x55bc327f4f60 msgr2=0x55bc327fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac177fe640 0 client.15318 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:18.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 shutdown_connections 2024-09-12T01:57:18.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 1 -- 172.21.15.39:0/2531884813 wait complete. 2024-09-12T01:57:18.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.946+0000 7fac406f1740 20 client.15318 trim_cache size 0 max 16384 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 Processor -- start 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 -- start start 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc327fd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc327fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc32813eb0 con 0x55bc32803bb0 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc32814580 con 0x55bc327f89d0 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.964+0000 7fac406f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc32814c50 con 0x55bc327f92f0 2024-09-12T01:57:18.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc327fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac37fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac37fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:46952/0 (socket says 172.21.15.39:46952) 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac37fff640 1 -- 172.21.15.39:0/1437815377 learned_addr learned my addr 172.21.15.39:0/1437815377 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac2ffff640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc327fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 -- 172.21.15.39:0/1437815377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 msgr2=0x55bc327fd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc327fd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 -- 172.21.15.39:0/1437815377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 msgr2=0x55bc32815b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 -- 172.21.15.39:0/1437815377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc32806890 con 0x55bc32803bb0 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac2ffff640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc327fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac37fff640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc327fdeb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac30009b60 tx=0x7fac300115f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aeeb1f24e2772c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac2dffb640 1 -- 172.21.15.39:0/1437815377 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30023a00 con 0x55bc32803bb0 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac2dffb640 1 -- 172.21.15.39:0/1437815377 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3003b020 con 0x55bc32803bb0 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.965+0000 7fac2dffb640 1 -- 172.21.15.39:0/1437815377 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3001eb30 con 0x55bc32803bb0 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- 172.21.15.39:0/1437815377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 msgr2=0x55bc327fdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc327fdeb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac30009b60 tx=0x7fac300115f0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- 172.21.15.39:0/1437815377 shutdown_connections 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc32803bb0 0x55bc327fdeb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f92f0 0x55bc327fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 --2- 172.21.15.39:0/1437815377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc327f89d0 0x55bc32815b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- 172.21.15.39:0/1437815377 >> 172.21.15.39:0/1437815377 conn(0x55bc327f4f60 msgr2=0x55bc327fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- 172.21.15.39:0/1437815377 shutdown_connections 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- 172.21.15.39:0/1437815377 wait complete. 2024-09-12T01:57:18.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.966+0000 7fac406f1740 1 -- start start 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 Processor -- start 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc32816e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc32803bb0 0x55bc32817890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc328159f0 con 0x55bc327f92f0 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc32815320 con 0x55bc32803bb0 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc328160c0 con 0x55bc327f89d0 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac406f1740 10 client.0 _ll_register_callbacks cb 0x7fac300134c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49654/0 (socket says 172.21.15.39:49654) 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 -- 172.21.15.39:0/3616035029 learned_addr learned my addr 172.21.15.39:0/3616035029 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac37fff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc32816e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac3c8b5640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc32803bb0 0x55bc32817890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 -- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 msgr2=0x55bc32816e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc32816e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 -- 172.21.15.39:0/3616035029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc32803bb0 msgr2=0x55bc32817890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc32803bb0 0x55bc32817890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 -- 172.21.15.39:0/3616035029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc3287d050 con 0x55bc327f92f0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac2ffff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac200977c0 tx=0x7fac2001bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a628e05972a15e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.967+0000 7fac177fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2009b130 con 0x55bc327f92f0 2024-09-12T01:57:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac200979d0 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac3003b020 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fac2009acc0 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 10 client.15324 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc3287e350 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac3003b020 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fac200970b0 con 0x55bc327f92f0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 10 client.15324 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 10 client.15324 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 20 client.15324 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32882ae0 0x55bc328817f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 4 client.15324 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.968+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "status"}) -- 0x55bc326e30e0 con 0x55bc32882ae0 2024-09-12T01:57:18.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac37fff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32882ae0 0x55bc328817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac177fe640 10 client.15324 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac37fff640 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32882ae0 0x55bc328817f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4064963d15f5ed48 server_cookie=96425ac063a122d1 in_seq=0 out_seq=0 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac177fe640 1 -- 172.21.15.39:0/3616035029 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55bc326e30e0 con 0x55bc32882ae0 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac177fe640 10 client.15324 handle_command_reply: tid=0 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 client.15324 shutdown 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 msgr2=0x55bc32817350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac200977c0 tx=0x7fac2001bf00 comp rx=0 tx=0).stop 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 shutdown_connections 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55bc32882ae0 0x55bc328817f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc32803bb0 0x55bc32817890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc327f92f0 0x55bc32817350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac406f1740 1 --2- 172.21.15.39:0/3616035029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc327f89d0 0x55bc32816e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.969+0000 7fac177fe640 0 client.15324 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 >> 172.21.15.39:0/3616035029 conn(0x55bc327f4f60 msgr2=0x55bc327fb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 shutdown_connections 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac406f1740 1 -- 172.21.15.39:0/3616035029 wait complete. 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac406f1740 20 client.15324 trim_cache size 0 max 16384 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:18.977 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24463, 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:57:18.978 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 122.31688364, 2024-09-12T01:57:18.979 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 25, 2024-09-12T01:57:18.979 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:57:18.979 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:57:18.979 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 150.31260190500001 2024-09-12T01:57:18.979 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 msgr2=0x7fac240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 0x7fac240a5040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fac30005fd0 tx=0x7fac30004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 msgr2=0x7fac38198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fac2000d950 tx=0x7fac2000de10 comp rx=0 tx=0).stop 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 shutdown_connections 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac38106f10 0x7fac3819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac38102790 0x7fac38198970 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac240a2b80 0x7fac240a5040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 --2- 172.21.15.39:0/4181137856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38101de0 0x7fac38198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 >> 172.21.15.39:0/4181137856 conn(0x7fac380fd8c0 msgr2=0x7fac380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 shutdown_connections 2024-09-12T01:57:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:18.970+0000 7fac3e318640 1 -- 172.21.15.39:0/4181137856 wait complete. 2024-09-12T01:57:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:18 smithi039 ceph-mon[31204]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T01:57:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:19.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:18 smithi044 ceph-mon[35259]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T01:57:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:18 smithi172 ceph-mon[35073]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-12T01:57:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:57:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:57:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:57:19.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:57:19.898 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:20.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 -- 172.21.15.39:0/1005099107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd588102d40 msgr2=0x7fd588103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 --2- 172.21.15.39:0/1005099107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd588102d40 0x7fd588103120 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd578009900 tx=0x7fd57802a480 comp rx=0 tx=0).stop 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 -- 172.21.15.39:0/1005099107 shutdown_connections 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 --2- 172.21.15.39:0/1005099107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd58810c170 0x7fd58810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 --2- 172.21.15.39:0/1005099107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 0x7fd58810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 --2- 172.21.15.39:0/1005099107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd588102d40 0x7fd588103120 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.411+0000 7fd58cf98640 1 -- 172.21.15.39:0/1005099107 >> 172.21.15.39:0/1005099107 conn(0x7fd5880fc7a0 msgr2=0x7fd5880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 -- 172.21.15.39:0/1005099107 shutdown_connections 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 -- 172.21.15.39:0/1005099107 wait complete. 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 Processor -- start 2024-09-12T01:57:20.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 -- start start 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 0x7fd588198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 0x7fd5881989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.412+0000 7fd58cf98640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58cf98640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd588111f70 con 0x7fd58810c170 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58cf98640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd588111df0 con 0x7fd588103660 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58cf98640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881120f0 con 0x7fd588102d40 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49680/0 (socket says 172.21.15.39:49680) 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 -- 172.21.15.39:0/533854449 learned_addr learned my addr 172.21.15.39:0/533854449 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd585d9b640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 0x7fd5881989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58659c640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 0x7fd588198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 -- 172.21.15.39:0/533854449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 msgr2=0x7fd588198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 0x7fd588198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 -- 172.21.15.39:0/533854449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 msgr2=0x7fd5881989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 0x7fd5881989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 -- 172.21.15.39:0/533854449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58819d420 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58659c640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 0x7fd588198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd586d9d640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cad0 tx=0x7fd58000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd5777fe640 1 -- 172.21.15.39:0/533854449 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58000ae20 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58819d710 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd5777fe640 1 -- 172.21.15.39:0/533854449 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd580005020 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd5777fe640 1 -- 172.21.15.39:0/533854449 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58000f6f0 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.413+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881a4ff0 con 0x7fd58810c170 2024-09-12T01:57:20.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd5777fe640 1 -- 172.21.15.39:0/533854449 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd5800051d0 con 0x7fd58810c170 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 Processor -- start 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 -- start start 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa13ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55adaa0a4090 con 0x55adaa13e2f0 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55adaa04ba70 con 0x55adaa148bb0 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.416+0000 7fd58f371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adaa0a0050 con 0x55adaa13d9d0 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd5777fe640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 0x7fd5700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49684/0 (socket says 172.21.15.39:49684) 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 -- 172.21.15.39:0/1482465070 learned_addr learned my addr 172.21.15.39:0/1482465070 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd586d9d640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 0x7fd5700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa13ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd5777fe640 1 -- 172.21.15.39:0/533854449 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd5800cf080 con 0x7fd58810c170 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 -- 172.21.15.39:0/1482465070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 msgr2=0x55adaa13ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa13ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 -- 172.21.15.39:0/1482465070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 msgr2=0x55adaa14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 -- 172.21.15.39:0/1482465070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adaa058130 con 0x55adaa13e2f0 2024-09-12T01:57:20.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd58659c640 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f12bf6c1387fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd586d9d640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 0x7fd5700a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd58000a6e0 tx=0x7fd58006d8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.417+0000 7fd574ff9640 1 -- 172.21.15.39:0/1482465070 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57803f070 con 0x55adaa13e2f0 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd574ff9640 1 -- 172.21.15.39:0/1482465070 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5780317b0 con 0x55adaa13e2f0 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd574ff9640 1 -- 172.21.15.39:0/1482465070 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578035070 con 0x55adaa13e2f0 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 -- 172.21.15.39:0/1482465070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 msgr2=0x55adaa148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd578000c00 tx=0x7fd578032d70 comp rx=0 tx=0).stop 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 -- 172.21.15.39:0/1482465070 shutdown_connections 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa148670 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 --2- 172.21.15.39:0/1482465070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa13ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 -- 172.21.15.39:0/1482465070 >> 172.21.15.39:0/1482465070 conn(0x55adaa139f60 msgr2=0x55adaa13a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 -- 172.21.15.39:0/1482465070 shutdown_connections 2024-09-12T01:57:20.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.418+0000 7fd58f371740 1 -- 172.21.15.39:0/1482465070 wait complete. 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 -- start start 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 Processor -- start 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 0x55adaa145720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa145c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55adaa14b780 con 0x55adaa13d9d0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55adaa05ef20 con 0x55adaa148bb0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adaa14b900 con 0x55adaa13e2f0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58f371740 10 client.0 _ll_register_callbacks cb 0x55adaa028030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49694/0 (socket says 172.21.15.39:49694) 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 -- 172.21.15.39:0/2848853001 learned_addr learned my addr 172.21.15.39:0/2848853001 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd58659c640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 0x55adaa145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 -- 172.21.15.39:0/2848853001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 msgr2=0x55adaa145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 0x55adaa145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 -- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 msgr2=0x55adaa145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.419+0000 7fd585d9b640 1 -- 172.21.15.39:0/2848853001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada9e152b0 con 0x55adaa13d9d0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58659c640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 0x55adaa145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd585d9b640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd57c010ec0 tx=0x7fd57c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44948313d203736 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c004020 con 0x55adaa13d9d0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd57c0041c0 con 0x55adaa13d9d0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5780317b0 con 0x55adaa13d9d0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd57c0043c0 con 0x55adaa13d9d0 2024-09-12T01:57:20.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 10 client.15336 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55adaa157110 con 0x55adaa13d9d0 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5780317b0 con 0x55adaa13d9d0 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd57c020790 con 0x55adaa13d9d0 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 10 client.15336 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 10 client.15336 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.420+0000 7fd58f371740 20 client.15336 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa159730 0x55adaa15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd58f371740 4 client.15336 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adaa0b1600 con 0x55adaa159730 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd58659c640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa159730 0x55adaa15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd58659c640 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa159730 0x55adaa15aba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34581f98b9a52638 server_cookie=c6c28b79819ed9fd in_seq=0 out_seq=0 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.421+0000 7fd56dffb640 10 client.15336 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:20.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd56dffb640 1 -- 172.21.15.39:0/2848853001 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adaa0b1600 con 0x55adaa159730 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd56dffb640 10 client.15336 handle_command_reply: tid=0 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 client.15336 shutdown 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 msgr2=0x55adaa1483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd57c010ec0 tx=0x7fd57c004730 comp rx=0 tx=0).stop 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 shutdown_connections 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa159730 0x55adaa15aba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13e2f0 0x55adaa145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 --2- 172.21.15.39:0/2848853001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa1483d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd56dffb640 0 client.15336 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 >> 172.21.15.39:0/2848853001 conn(0x55adaa139f60 msgr2=0x55adaa13fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 shutdown_connections 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 1 -- 172.21.15.39:0/2848853001 wait complete. 2024-09-12T01:57:20.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.422+0000 7fd58f371740 20 client.15336 trim_cache size 0 max 16384 2024-09-12T01:57:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.440+0000 7fd58f371740 1 Processor -- start 2024-09-12T01:57:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 -- start start 2024-09-12T01:57:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa13e2f0 0x55adaa1456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa148bb0 0x55adaa145c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55adaa158ee0 con 0x55adaa13d9d0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55adaa1595b0 con 0x55adaa13e2f0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58f371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adaa159c80 con 0x55adaa148bb0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49708/0 (socket says 172.21.15.39:49708) 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 -- 172.21.15.39:0/372073845 learned_addr learned my addr 172.21.15.39:0/372073845 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd58659c640 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa13e2f0 0x55adaa1456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa148bb0 0x55adaa145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 -- 172.21.15.39:0/372073845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa148bb0 msgr2=0x55adaa145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa148bb0 0x55adaa145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 -- 172.21.15.39:0/372073845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa13e2f0 msgr2=0x55adaa1456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa13e2f0 0x55adaa1456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 -- 172.21.15.39:0/372073845 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adaa13e120 con 0x55adaa13d9d0 2024-09-12T01:57:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.441+0000 7fd585d9b640 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd57c015010 tx=0x7fd57c00ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd3d038b8c7bab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd56ffff640 1 -- 172.21.15.39:0/372073845 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c020d00 con 0x55adaa13d9d0 2024-09-12T01:57:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd56ffff640 1 -- 172.21.15.39:0/372073845 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c014070 con 0x55adaa13d9d0 2024-09-12T01:57:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd56ffff640 1 -- 172.21.15.39:0/372073845 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0035f0 con 0x55adaa13d9d0 2024-09-12T01:57:20.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd58f371740 1 -- 172.21.15.39:0/372073845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 msgr2=0x55adaa15aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd58f371740 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd57c015010 tx=0x7fd57c00ab20 comp rx=0 tx=0).stop 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.442+0000 7fd58f371740 1 -- 172.21.15.39:0/372073845 shutdown_connections 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa148bb0 0x55adaa145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa13e2f0 0x55adaa1456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- 172.21.15.39:0/372073845 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13d9d0 0x55adaa15aba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- 172.21.15.39:0/372073845 >> 172.21.15.39:0/372073845 conn(0x55adaa139f60 msgr2=0x55adaa13a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- 172.21.15.39:0/372073845 shutdown_connections 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- 172.21.15.39:0/372073845 wait complete. 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- start start 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 Processor -- start 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa15e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa1c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55adaa15aa20 con 0x55adaa13e2f0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55adaa15a350 con 0x55adaa148bb0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55adaa15b0f0 con 0x55adaa13d9d0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58f371740 10 client.0 _ll_register_callbacks cb 0x7fd57c00ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49724/0 (socket says 172.21.15.39:49724) 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd58659c640 1 -- 172.21.15.39:0/1825656305 learned_addr learned my addr 172.21.15.39:0/1825656305 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.443+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa1c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 -- 172.21.15.39:0/1825656305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 msgr2=0x55adaa15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 -- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 msgr2=0x55adaa1c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa1c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 -- 172.21.15.39:0/1825656305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adaa1c2370 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58659c640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55adaa13adc0 tx=0x7fd578032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9a3321cac10626 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd56dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57803f050 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd578031930 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c014070 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd578035040 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58f371740 10 client.15342 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.444+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55adaa1c3580 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c014070 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd578003b50 con 0x55adaa13e2f0 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 10 client.15342 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 10 client.15342 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 20 client.15342 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa1c7cf0 0x55adaa1c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 4 client.15342 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "status"}) -- 0x55adaa0abb10 con 0x55adaa1c7cf0 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.445+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa1c7cf0 0x55adaa1c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd585d9b640 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa1c7cf0 0x55adaa1c6a00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b5f3fa1871a63b0 server_cookie=6e3ddb610525c65d in_seq=0 out_seq=0 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd56dffb640 10 client.15342 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd56dffb640 1 -- 172.21.15.39:0/1825656305 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55adaa0abb10 con 0x55adaa1c7cf0 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd56dffb640 10 client.15342 handle_command_reply: tid=0 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 client.15342 shutdown 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 msgr2=0x55adaa15e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55adaa13adc0 tx=0x7fd578032f90 comp rx=0 tx=0).stop 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 shutdown_connections 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55adaa1c7cf0 0x55adaa1c6a00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adaa148bb0 0x55adaa1c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55adaa13e2f0 0x55adaa15e7a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 --2- 172.21.15.39:0/1825656305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adaa13d9d0 0x55adaa15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 >> 172.21.15.39:0/1825656305 conn(0x55adaa139f60 msgr2=0x55adaa1456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd56dffb640 0 client.15342 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 shutdown_connections 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 1 -- 172.21.15.39:0/1825656305 wait complete. 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.446+0000 7fd58f371740 20 client.15342 trim_cache size 0 max 16384 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24467, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 124.804385512, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 25, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 154.374743102 2024-09-12T01:57:20.453 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 msgr2=0x7fd5700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 0x7fd5700a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd58000a6e0 tx=0x7fd58006d8a0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 msgr2=0x7fd58819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cad0 tx=0x7fd58000cf90 comp rx=0 tx=0).stop 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 shutdown_connections 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd58810c170 0x7fd58819cd40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588103660 0x7fd5881989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd5700a2b80 0x7fd5700a5040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 --2- 172.21.15.39:0/533854449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd588102d40 0x7fd588198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:20.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 >> 172.21.15.39:0/533854449 conn(0x7fd5880fc7a0 msgr2=0x7fd5880fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:20.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 shutdown_connections 2024-09-12T01:57:20.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:20.447+0000 7fd58cf98640 1 -- 172.21.15.39:0/533854449 wait complete. 2024-09-12T01:57:21.117 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:20 smithi039 ceph-mon[31204]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T01:57:21.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:57:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:20 smithi044 ceph-mon[35259]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T01:57:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:20 smithi172 ceph-mon[35073]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T01:57:21.402 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:21.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/713171924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 msgr2=0x7f0f58106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/713171924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f58106e60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009930 tx=0x7f0f4802a420 comp rx=0 tx=0).stop 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/713171924 shutdown_connections 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/713171924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 0x7f0f5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/713171924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/713171924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f58106e60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/713171924 >> 172.21.15.39:0/713171924 conn(0x7f0f580fc7a0 msgr2=0x7f0f580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/713171924 shutdown_connections 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.878+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/713171924 wait complete. 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.879+0000 7f0f5d2c5640 1 Processor -- start 2024-09-12T01:57:21.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.879+0000 7f0f5d2c5640 1 -- start start 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.879+0000 7f0f5d2c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f5d2c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 0x7f0f58197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f5d2c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f5d2c5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58110e80 con 0x7f0f58106a80 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f5d2c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58110d00 con 0x7f0f58100a80 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f5d2c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58111000 con 0x7f0f58101420 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49746/0 (socket says 172.21.15.39:49746) 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 -- 172.21.15.39:0/3417940480 learned_addr learned my addr 172.21.15.39:0/3417940480 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f567fc640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 0x7f0f58197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 -- 172.21.15.39:0/3417940480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 msgr2=0x7f0f58197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 0x7f0f58197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 -- 172.21.15.39:0/3417940480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 msgr2=0x7f0f58197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 -- 172.21.15.39:0/3417940480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5819c2d0 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f577fe640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000cce0 tx=0x7f0f5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.880+0000 7f0f3ffff640 1 -- 172.21.15.39:0/3417940480 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000f450 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.881+0000 7f0f3ffff640 1 -- 172.21.15.39:0/3417940480 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5000fad0 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.881+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5819c5c0 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.881+0000 7f0f3ffff640 1 -- 172.21.15.39:0/3417940480 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50018c10 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.881+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f581a3ea0 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 Processor -- start 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f3ffff640 1 -- 172.21.15.39:0/3417940480 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0f5000f5f0 con 0x7f0f58106a80 2024-09-12T01:57:21.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 -- start start 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b0c027090 con 0x564b0c0c0810 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b0bfcea70 con 0x564b0c0cddc0 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b0c023050 con 0x564b0c0c1130 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49748/0 (socket says 172.21.15.39:49748) 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f567fc640 1 -- 172.21.15.39:0/1555747880 learned_addr learned my addr 172.21.15.39:0/1555747880 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.884+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 -- 172.21.15.39:0/1555747880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 msgr2=0x564b0c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f3ffff640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 0x7f0f400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 -- 172.21.15.39:0/1555747880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 msgr2=0x564b0c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c0d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 -- 172.21.15.39:0/1555747880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0bfdb130 con 0x564b0c0c0810 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f577fe640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 0x7f0f400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0124c0 tx=0x7f0f4c00c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc247ef88f89f3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f3ffff640 1 -- 172.21.15.39:0/3417940480 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0f500cf6b0 con 0x7f0f58106a80 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f3d7fa640 1 -- 172.21.15.39:0/1555747880 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c018030 con 0x564b0c0c0810 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f3d7fa640 1 -- 172.21.15.39:0/1555747880 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f4c00da30 con 0x564b0c0c0810 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.885+0000 7f0f3d7fa640 1 -- 172.21.15.39:0/1555747880 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00fab0 con 0x564b0c0c0810 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1555747880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 msgr2=0x564b0c0c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f577fe640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 0x7f0f400a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ccb0 tx=0x7f0f50091400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0124c0 tx=0x7f0f4c00c5c0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1555747880 shutdown_connections 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1555747880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0c0bf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1555747880 >> 172.21.15.39:0/1555747880 conn(0x564b0c0bcf60 msgr2=0x564b0c0bd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1555747880 shutdown_connections 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1555747880 wait complete. 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 -- start start 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 Processor -- start 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c0810 0x564b0c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.886+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 0x564b0c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0d0990 con 0x564b0c0cddc0 2024-09-12T01:57:21.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b0bfe1f20 con 0x564b0c0c1130 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0d0b10 con 0x564b0c0c0810 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 10 client.0 _ll_register_callbacks cb 0x564b0bfab030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49756/0 (socket says 172.21.15.39:49756) 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 -- 172.21.15.39:0/1214588130 learned_addr learned my addr 172.21.15.39:0/1214588130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 0x564b0c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c0810 0x564b0c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 -- 172.21.15.39:0/1214588130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c0810 msgr2=0x564b0c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c0810 0x564b0c0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 -- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 msgr2=0x564b0c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 0x564b0c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 -- 172.21.15.39:0/1214588130 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0bd982b0 con 0x564b0c0cddc0 2024-09-12T01:57:21.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 0x564b0c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00f550 tx=0x7f0f4c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d46c4796d143db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c018070 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0f4c004020 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f4c00da30 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c004220 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 10 client.15354 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.887+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b0c0dc320 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f4c00da30 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c00fac0 con 0x564b0c0cddc0 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 10 client.15354 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 20 client.15354 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:21.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c0de4e0 0x564b0c0df950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 4 client.15354 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b0c034600 con 0x564b0c0de4e0 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.888+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c0de4e0 0x564b0c0df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.889+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c0de4e0 0x564b0c0df950 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3094bacda695dd08 server_cookie=c17ff1c1e7b53d67 in_seq=0 out_seq=0 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.889+0000 7f0f3aff5640 10 client.15354 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.889+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1214588130 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b0c034600 con 0x564b0c0de4e0 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.889+0000 7f0f3aff5640 10 client.15354 handle_command_reply: tid=0 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 client.15354 shutdown 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 msgr2=0x564b0c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00f550 tx=0x7f0f4c014040 comp rx=0 tx=0).stop 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 shutdown_connections 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c0de4e0 0x564b0c0df950 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0cddc0 0x564b0c0caf10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c1130 0x564b0c0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f3aff5640 0 client.15354 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1214588130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c0810 0x564b0c0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 >> 172.21.15.39:0/1214588130 conn(0x564b0c0bcf60 msgr2=0x564b0c0c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 shutdown_connections 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1214588130 wait complete. 2024-09-12T01:57:21.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.890+0000 7f0f5f69e740 20 client.15354 trim_cache size 0 max 16384 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 Processor -- start 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 -- start start 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c0810 0x564b0c0dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0cddc0 0x564b0c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0ddc90 con 0x564b0c0c1130 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0de360 con 0x564b0c0c0810 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0dea30 con 0x564b0c0cddc0 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f56ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49772/0 (socket says 172.21.15.39:49772) 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f56ffd640 1 -- 172.21.15.39:0/1603868965 learned_addr learned my addr 172.21.15.39:0/1603868965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c0810 0x564b0c0dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.908+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0cddc0 0x564b0c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 -- 172.21.15.39:0/1603868965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0cddc0 msgr2=0x564b0c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0cddc0 0x564b0c0c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 -- 172.21.15.39:0/1603868965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c0810 msgr2=0x564b0c0dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c0810 0x564b0c0dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 -- 172.21.15.39:0/1603868965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0c0cd9b0 con 0x564b0c0c1130 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0f480096c0 tx=0x7f0f48032b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbfed2c85dbc749 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f3cff9640 1 -- 172.21.15.39:0/1603868965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48035040 con 0x564b0c0c1130 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f3cff9640 1 -- 172.21.15.39:0/1603868965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f48005500 con 0x564b0c0c1130 2024-09-12T01:57:21.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.909+0000 7f0f3cff9640 1 -- 172.21.15.39:0/1603868965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48004d60 con 0x564b0c0c1130 2024-09-12T01:57:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1603868965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 msgr2=0x564b0c0debb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0f480096c0 tx=0x7f0f48032b30 comp rx=0 tx=0).stop 2024-09-12T01:57:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1603868965 shutdown_connections 2024-09-12T01:57:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0cddc0 0x564b0c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c1130 0x564b0c0debb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1603868965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0c0810 0x564b0c0dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1603868965 >> 172.21.15.39:0/1603868965 conn(0x564b0c0bcf60 msgr2=0x564b0c0ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1603868965 shutdown_connections 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1603868965 wait complete. 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- start start 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 Processor -- start 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0df7d0 con 0x564b0c0c0810 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0df100 con 0x564b0c0cddc0 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.910+0000 7f0f5f69e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b0c0dfea0 con 0x564b0c0c1130 2024-09-12T01:57:21.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f5f69e740 10 client.0 _ll_register_callbacks cb 0x7f0f4c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49776/0 (socket says 172.21.15.39:49776) 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 -- 172.21.15.39:0/1028569425 learned_addr learned my addr 172.21.15.39:0/1028569425 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 -- 172.21.15.39:0/1028569425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 msgr2=0x564b0c0e16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 -- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 msgr2=0x564b0c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 -- 172.21.15.39:0/1028569425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0c147120 con 0x564b0c0c0810 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f567fc640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00fe90 tx=0x7f0f4c00f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677a9ef9a8cf604 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:21.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c018040 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0f4c004910 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f48005500 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c041050 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.911+0000 7f0f5f69e740 10 client.15360 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b0c148330 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f48005500 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c02c960 con 0x564b0c0c0810 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 10 client.15360 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 10 client.15360 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 20 client.15360 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c14cdd0 0x564b0c14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 4 client.15360 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "status"}) -- 0x564b0c02eb10 con 0x564b0c14cdd0 2024-09-12T01:57:21.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.912+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c14cdd0 0x564b0c14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f56ffd640 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c14cdd0 0x564b0c14bae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=173c875830c1c292 server_cookie=13006ecf36d48ba0 in_seq=0 out_seq=0 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f3aff5640 10 client.15360 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f3aff5640 1 -- 172.21.15.39:0/1028569425 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564b0c02eb10 con 0x564b0c14cdd0 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f3aff5640 10 client.15360 handle_command_reply: tid=0 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 client.15360 shutdown 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 msgr2=0x564b0c0e1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00fe90 tx=0x7f0f4c00f6f0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 shutdown_connections 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b0c14cdd0 0x564b0c14bae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b0c0cddc0 0x564b0c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b0c0c1130 0x564b0c0e16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 --2- 172.21.15.39:0/1028569425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b0c0c0810 0x564b0c0e1160 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 >> 172.21.15.39:0/1028569425 conn(0x564b0c0bcf60 msgr2=0x564b0c0c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f3aff5640 0 client.15360 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:21.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 shutdown_connections 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 1 -- 172.21.15.39:0/1028569425 wait complete. 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.913+0000 7f0f5f69e740 20 client.15360 trim_cache size 0 max 16384 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d27de812-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24503, 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T01:57:21.920 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 133.32694639100001, 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 25, 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 82, 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 82, 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 144.110776507 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:21.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 msgr2=0x7f0f400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 0x7f0f400a5040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000ccb0 tx=0x7f0f50091400 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 msgr2=0x7f0f5819bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000cce0 tx=0x7f0f5000a620 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 shutdown_connections 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f58106a80 0x7f0f5819bbf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0f400a2b80 0x7f0f400a5040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f58101420 0x7f0f58197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 --2- 172.21.15.39:0/3417940480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f58100a80 0x7f0f58197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 >> 172.21.15.39:0/3417940480 conn(0x7f0f580fc7a0 msgr2=0x7f0f580fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 shutdown_connections 2024-09-12T01:57:21.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:21.914+0000 7f0f5d2c5640 1 -- 172.21.15.39:0/3417940480 wait complete. 2024-09-12T01:57:22.645 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T01:57:22.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:22 smithi039 ceph-mon[31204]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:22 smithi044 ceph-mon[35259]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:23.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:22 smithi172 ceph-mon[35073]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:24 smithi039 ceph-mon[31204]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:24 smithi044 ceph-mon[35259]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:24 smithi172 ceph-mon[35073]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:27.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:26 smithi039 ceph-mon[31204]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:26 smithi044 ceph-mon[35259]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:26 smithi172 ceph-mon[35073]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-12T01:57:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 -- 172.21.15.39:0/2182019467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 msgr2=0x7f69e01049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 --2- 172.21.15.39:0/2182019467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e01049d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009900 tx=0x7f69dc02a410 comp rx=0 tx=0).stop 2024-09-12T01:57:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 -- 172.21.15.39:0/2182019467 shutdown_connections 2024-09-12T01:57:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 --2- 172.21.15.39:0/2182019467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0107840 0x7f69e0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 --2- 172.21.15.39:0/2182019467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0104f10 0x7f69e0107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 --2- 172.21.15.39:0/2182019467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e01049d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 -- 172.21.15.39:0/2182019467 >> 172.21.15.39:0/2182019467 conn(0x7f69e00fc1e0 msgr2=0x7f69e00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 -- 172.21.15.39:0/2182019467 shutdown_connections 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.418+0000 7f69e7749640 1 -- 172.21.15.39:0/2182019467 wait complete. 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 Processor -- start 2024-09-12T01:57:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 -- start start 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0104f10 0x7f69e0100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0107840 0x7f69e0100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010d840 con 0x7f69e01025e0 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010d6c0 con 0x7f69e0104f10 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e7749640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010d9c0 con 0x7f69e0107840 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57070/0 (socket says 172.21.15.39:57070) 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 -- 172.21.15.39:0/3956344465 learned_addr learned my addr 172.21.15.39:0/3956344465 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0107840 0x7f69e0100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0104f10 0x7f69e0100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 -- 172.21.15.39:0/3956344465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0107840 msgr2=0x7f69e0100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0107840 0x7f69e0100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 -- 172.21.15.39:0/3956344465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0104f10 msgr2=0x7f69e0100590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0104f10 0x7f69e0100590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.419+0000 7f69e54e5640 1 -- 172.21.15.39:0/3956344465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e0101360 con 0x7f69e01025e0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69e54e5640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009230 tx=0x7f69dc031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69d67fc640 1 -- 172.21.15.39:0/3956344465 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc03f030 con 0x7f69e01025e0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69d67fc640 1 -- 172.21.15.39:0/3956344465 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69dc003ad0 con 0x7f69e01025e0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e01a1f50 con 0x7f69e01025e0 2024-09-12T01:57:28.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69d67fc640 1 -- 172.21.15.39:0/3956344465 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc035070 con 0x7f69e01025e0 2024-09-12T01:57:28.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.420+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e01a2360 con 0x7f69e01025e0 2024-09-12T01:57:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.422+0000 7f69d67fc640 1 -- 172.21.15.39:0/3956344465 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f69dc042030 con 0x7f69e01025e0 2024-09-12T01:57:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 Processor -- start 2024-09-12T01:57:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 -- start start 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564820b6a2f0 con 0x564820c0c370 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564820b12270 con 0x564820c069a0 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.423+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564820b662b0 con 0x564820c072e0 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:38750/0 (socket says 172.21.15.39:38750) 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 -- 172.21.15.39:0/142754020 learned_addr learned my addr 172.21.15.39:0/142754020 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57078/0 (socket says 172.21.15.39:57078) 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69d67fc640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 0x7f69cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e54e5640 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 0x7f69cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 -- 172.21.15.39:0/142754020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 msgr2=0x564820c0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 -- 172.21.15.39:0/142754020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 msgr2=0x564820c06da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 -- 172.21.15.39:0/142754020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564820b11340 con 0x564820c0c370 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69d67fc640 1 -- 172.21.15.39:0/3956344465 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f69dc0ef520 con 0x7f69e01025e0 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f69d0005fd0 tx=0x7f69d000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3342d7e00794bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 0x7f69cc0a50f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009fd0 tx=0x7f69d8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.424+0000 7f69cb7fe640 1 -- 172.21.15.39:0/142754020 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0003ba0 con 0x564820c0c370 2024-09-12T01:57:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69cb7fe640 1 -- 172.21.15.39:0/142754020 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d0015070 con 0x564820c0c370 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69cb7fe640 1 -- 172.21.15.39:0/142754020 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0004d20 con 0x564820c0c370 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 -- 172.21.15.39:0/142754020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 msgr2=0x564820c0e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f69d0005fd0 tx=0x7f69d000bb20 comp rx=0 tx=0).stop 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 -- 172.21.15.39:0/142754020 shutdown_connections 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c0e830 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/142754020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c06da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 -- 172.21.15.39:0/142754020 >> 172.21.15.39:0/142754020 conn(0x564820c02010 msgr2=0x564820c02410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 -- 172.21.15.39:0/142754020 shutdown_connections 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.425+0000 7f69ea5bc740 1 -- 172.21.15.39:0/142754020 wait complete. 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 -- start start 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 Processor -- start 2024-09-12T01:57:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c10bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c11100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564820c0f340 con 0x564820c0c370 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564820af3290 con 0x564820c069a0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564820c0f4c0 con 0x564820c072e0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69ea5bc740 10 client.0 _ll_register_callbacks cb 0x564820b24140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69e5ce6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69e5ce6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57084/0 (socket says 172.21.15.39:57084) 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69e5ce6640 1 -- 172.21.15.39:0/1070970739 learned_addr learned my addr 172.21.15.39:0/1070970739 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.426+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c11100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e54e5640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c10bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 -- 172.21.15.39:0/1070970739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 msgr2=0x564820c11100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c11100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 -- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 msgr2=0x564820c10bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c10bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 -- 172.21.15.39:0/1070970739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56482087d210 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c11100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009990 tx=0x7f69d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb94ad1aad925cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8025070 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f69d8010dc0 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d0015070 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69d8021440 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69ea5bc740 10 client.15372 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564820949620 con 0x564820c0c370 2024-09-12T01:57:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.427+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69d0015070 con 0x564820c0c370 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69d80207e0 con 0x564820c0c370 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 10 client.15372 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 10 client.15372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 20 client.15372 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c1c8b0 0x564820c1ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 4 client.15372 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564820b77a20 con 0x564820c1c8b0 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69e54e5640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c1c8b0 0x564820c1ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69c8ff9640 10 client.15372 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:28.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.428+0000 7f69e54e5640 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c1c8b0 0x564820c1ece0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a3a9492cf0025e server_cookie=aadd45ae1ea0eac0 in_seq=0 out_seq=0 2024-09-12T01:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69c8ff9640 1 -- 172.21.15.39:0/1070970739 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564820b77a20 con 0x564820c1c8b0 2024-09-12T01:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69c8ff9640 10 client.15372 handle_command_reply: tid=0 2024-09-12T01:57:28.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 client.15372 shutdown 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 msgr2=0x564820c18140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009990 tx=0x7f69d8004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 shutdown_connections 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c1c8b0 0x564820c1ece0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c0c370 0x564820c18140 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c11100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69c8ff9640 0 client.15372 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/1070970739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c069a0 0x564820c10bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 >> 172.21.15.39:0/1070970739 conn(0x564820c02010 msgr2=0x564820c03820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 shutdown_connections 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.429+0000 7f69ea5bc740 1 -- 172.21.15.39:0/1070970739 wait complete. 2024-09-12T01:57:28.437 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.430+0000 7f69ea5bc740 20 client.15372 trim_cache size 0 max 16384 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 Processor -- start 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 -- start start 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c18100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c03400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01ada20 con 0x564820c069a0 2024-09-12T01:57:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01ab2f0 con 0x564820c0c370 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.444+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01a9140 con 0x564820c072e0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57088/0 (socket says 172.21.15.39:57088) 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 -- 172.21.15.39:0/4229400344 learned_addr learned my addr 172.21.15.39:0/4229400344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 -- 172.21.15.39:0/4229400344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 msgr2=0x564820c18100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 -- 172.21.15.39:0/4229400344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 msgr2=0x564820c03400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c03400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 -- 172.21.15.39:0/4229400344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564820c0eba0 con 0x564820c069a0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69e54e5640 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009a20 tx=0x7f69dc0bbce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910fd6c3097c3db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69caffd640 1 -- 172.21.15.39:0/4229400344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc049070 con 0x564820c069a0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69caffd640 1 -- 172.21.15.39:0/4229400344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69dc0ba0e0 con 0x564820c069a0 2024-09-12T01:57:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.445+0000 7f69caffd640 1 -- 172.21.15.39:0/4229400344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b85d0 con 0x564820c069a0 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- 172.21.15.39:0/4229400344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 msgr2=0x564820c02ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009a20 tx=0x7f69dc0bbce0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- 172.21.15.39:0/4229400344 shutdown_connections 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c03400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c072e0 0x564820c18100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/4229400344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c069a0 0x564820c02ec0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- 172.21.15.39:0/4229400344 >> 172.21.15.39:0/4229400344 conn(0x564820c02010 msgr2=0x564820c10bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- 172.21.15.39:0/4229400344 shutdown_connections 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- 172.21.15.39:0/4229400344 wait complete. 2024-09-12T01:57:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 -- start start 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.446+0000 7f69ea5bc740 1 Processor -- start 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c069a0 0x564820c15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c16dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01a97b0 con 0x564820c072e0 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01aac20 con 0x564820c0c370 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e01a9e80 con 0x564820c069a0 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69ea5bc740 10 client.0 _ll_register_callbacks cb 0x7f69d8013660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57100/0 (socket says 172.21.15.39:57100) 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 -- 172.21.15.39:0/661952868 learned_addr learned my addr 172.21.15.39:0/661952868 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e54e5640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c069a0 0x564820c15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e5ce6640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c16dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 -- 172.21.15.39:0/661952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c069a0 msgr2=0x564820c15880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c069a0 0x564820c15880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 -- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 msgr2=0x564820c16dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c16dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 -- 172.21.15.39:0/661952868 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564820c173e0 con 0x564820c072e0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69e4ce4640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f69d0004580 tx=0x7f69d000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67276c58fe0d20c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0011440 con 0x564820c072e0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.447+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f69d00115e0 con 0x564820c072e0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69dc0ba0e0 con 0x564820c072e0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69d00117e0 con 0x564820c072e0 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 10 client.15378 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564820c87680 con 0x564820c072e0 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69dc0ba0e0 con 0x564820c072e0 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69d002e9b0 con 0x564820c072e0 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 10 client.15378 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 20 client.15378 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c87c90 0x564820c8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 4 client.15378 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564820b71d70 con 0x564820c87c90 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.448+0000 7f69e54e5640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c87c90 0x564820c8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.449+0000 7f69c8ff9640 10 client.15378 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.449+0000 7f69e54e5640 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c87c90 0x564820c8a080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afaf0fb9dda97b2a server_cookie=6b498d12a674f524 in_seq=0 out_seq=0 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.456+0000 7f69c8ff9640 1 -- 172.21.15.39:0/661952868 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564820b71d70 con 0x564820c87c90 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.456+0000 7f69c8ff9640 10 client.15378 handle_command_reply: tid=0 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.456+0000 7f69ea5bc740 1 client.15378 shutdown 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 msgr2=0x564820c15dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f69d0004580 tx=0x7f69d000bfa0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 shutdown_connections 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564820c87c90 0x564820c8a080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564820c0c370 0x564820c16dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564820c072e0 0x564820c15dc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 --2- 172.21.15.39:0/661952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564820c069a0 0x564820c15880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69c8ff9640 0 client.15378 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 >> 172.21.15.39:0/661952868 conn(0x564820c02010 msgr2=0x564820c02ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 shutdown_connections 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 1 -- 172.21.15.39:0/661952868 wait complete. 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69ea5bc740 20 client.15378 trim_cache size 0 max 16384 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:57:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:57:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 msgr2=0x7f69cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 0x7f69cc0a50f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009fd0 tx=0x7f69d8004ab0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 msgr2=0x7f69e0101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009230 tx=0x7f69dc031b60 comp rx=0 tx=0).stop 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 shutdown_connections 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f69cc0a2c30 0x7f69cc0a50f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e0107840 0x7f69e0100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69e0104f10 0x7f69e0100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 --2- 172.21.15.39:0/3956344465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e01025e0 0x7f69e0101f50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.457+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 >> 172.21.15.39:0/3956344465 conn(0x7f69e00fc1e0 msgr2=0x7f69e0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.458+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 shutdown_connections 2024-09-12T01:57:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:28.458+0000 7f69e7749640 1 -- 172.21.15.39:0/3956344465 wait complete. 2024-09-12T01:57:29.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:28 smithi039 ceph-mon[31204]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:28 smithi044 ceph-mon[35259]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:28 smithi172 ceph-mon[35073]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T01:57:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:30 smithi039 ceph-mon[31204]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T01:57:31.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:30 smithi044 ceph-mon[35259]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T01:57:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:30 smithi172 ceph-mon[35073]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-12T01:57:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:32 smithi039 ceph-mon[31204]: pgmap v356: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-12T01:57:33.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:32 smithi044 ceph-mon[35259]: pgmap v356: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-12T01:57:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:32 smithi172 ceph-mon[35073]: pgmap v356: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-12T01:57:35.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:34 smithi039 ceph-mon[31204]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:34 smithi044 ceph-mon[35259]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:34 smithi172 ceph-mon[35073]: pgmap v357: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-12T01:57:36.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:57:36.644 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:36.921 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:36 smithi039 ceph-mon[31204]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:57:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:36 smithi044 ceph-mon[35259]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/1463377536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44100e20 msgr2=0x7f9d44101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/1463377536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44100e20 0x7f9d44101200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009900 tx=0x7f9d4002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/1463377536 shutdown_connections 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/1463377536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102ef0 0x7f9d4410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/1463377536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44102570 0x7f9d441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/1463377536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44100e20 0x7f9d44101200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/1463377536 >> 172.21.15.39:0/1463377536 conn(0x7f9d440fc7d0 msgr2=0x7f9d440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/1463377536 shutdown_connections 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.167+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/1463377536 wait complete. 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 Processor -- start 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 -- start start 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44100e20 0x7f9d441993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102570 0x7f9d44199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44110f80 con 0x7f9d44102ef0 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44110e00 con 0x7f9d44100e20 2024-09-12T01:57:37.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4bb1c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44111100 con 0x7f9d44102570 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34120/0 (socket says 172.21.15.39:34120) 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/8116043 learned_addr learned my addr 172.21.15.39:0/8116043 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d490b7640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102570 0x7f9d44199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.168+0000 7f9d498b8640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44100e20 0x7f9d441993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/8116043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102570 msgr2=0x7f9d44199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102570 0x7f9d44199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/8116043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44100e20 msgr2=0x7f9d441993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44100e20 0x7f9d441993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/8116043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d441a4990 con 0x7f9d44102ef0 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00eaa0 tx=0x7f9d3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d3affd640 1 -- 172.21.15.39:0/8116043 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00cdb0 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d3affd640 1 -- 172.21.15.39:0/8116043 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d3c005020 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d441a4b60 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d3affd640 1 -- 172.21.15.39:0/8116043 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0116b0 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.169+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d44197450 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.172+0000 7f9d4def5740 1 Processor -- start 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d3affd640 1 -- 172.21.15.39:0/8116043 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d3c005560 con 0x7f9d44102ef0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 -- start start 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe117c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe117c680 0x557fe117ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557fe10d72e0 con 0x557fe11714a0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557fe107ece0 con 0x557fe117c680 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d4def5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fe10d32a0 con 0x557fe1171dc0 2024-09-12T01:57:37.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d490b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d490b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34128/0 (socket says 172.21.15.39:34128) 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.173+0000 7f9d490b7640 1 -- 172.21.15.39:0/1509887058 learned_addr learned my addr 172.21.15.39:0/1509887058 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe117c680 0x557fe117ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d498b8640 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe117c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 -- 172.21.15.39:0/1509887058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 msgr2=0x557fe117c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe117c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 -- 172.21.15.39:0/1509887058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe117c680 msgr2=0x557fe117ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe117c680 0x557fe117ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 -- 172.21.15.39:0/1509887058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe1063440 con 0x557fe11714a0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b6c0 tx=0x7f9d3400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6854414945f878c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d3affd640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 0x7f9d300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d498b8640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 0x7f9d300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d3affd640 1 -- 172.21.15.39:0/8116043 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d3c0cf120 con 0x7f9d44102ef0 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d2ffff640 1 -- 172.21.15.39:0/1509887058 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34005020 con 0x557fe11714a0 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.174+0000 7f9d2ffff640 1 -- 172.21.15.39:0/1509887058 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d340047a0 con 0x557fe11714a0 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.175+0000 7f9d2ffff640 1 -- 172.21.15.39:0/1509887058 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400f6c0 con 0x557fe11714a0 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.175+0000 7f9d4def5740 1 -- 172.21.15.39:0/1509887058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 msgr2=0x557fe1171880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.175+0000 7f9d498b8640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 0x7f9d300a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009230 tx=0x7f9d40043040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.175+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b6c0 tx=0x7f9d3400b650 comp rx=0 tx=0).stop 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 -- 172.21.15.39:0/1509887058 shutdown_connections 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe117c680 0x557fe117ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe117c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1509887058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe11714a0 0x557fe1171880 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 -- 172.21.15.39:0/1509887058 >> 172.21.15.39:0/1509887058 conn(0x557fe116da30 msgr2=0x557fe116de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 -- 172.21.15.39:0/1509887058 shutdown_connections 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 -- 172.21.15.39:0/1509887058 wait complete. 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 -- start start 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.176+0000 7f9d4def5740 1 Processor -- start 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe11714a0 0x557fe117bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe1171dc0 0x557fe11791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557fe117f2a0 con 0x557fe117c680 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557fe1092050 con 0x557fe1171dc0 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fe117f420 con 0x557fe11714a0 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4def5740 10 client.0 _ll_register_callbacks cb 0x557fe10d2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34130/0 (socket says 172.21.15.39:34130) 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/2491455153 learned_addr learned my addr 172.21.15.39:0/2491455153 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d498b8640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe11714a0 0x557fe117bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/2491455153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe11714a0 msgr2=0x557fe117bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe11714a0 0x557fe117bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe1171dc0 msgr2=0x557fe11791c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe1171dc0 0x557fe11791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/2491455153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe0e483c0 con 0x557fe117c680 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0a40d0 tx=0x7f9d3c09bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc50ff6d2245f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.177+0000 7f9d2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c01f040 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d340047a0 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d3c0a4370 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d3c0b4b90 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557fe118ac60 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d340047a0 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d3c00f040 con 0x557fe117c680 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 20 client.15390 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe118c070 0x557fe118e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 4 client.15390 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.178+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fe10e4850 con 0x557fe118c070 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.179+0000 7f9d498b8640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe118c070 0x557fe118e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.180+0000 7f9d498b8640 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe118c070 0x557fe118e4e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e1864b3cea7de1 server_cookie=96c5caea4c050d7c in_seq=0 out_seq=0 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.180+0000 7f9d2d7fa640 10 client.15390 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/2491455153 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fe10e4850 con 0x557fe118c070 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d2d7fa640 10 client.15390 handle_command_reply: tid=0 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 client.15390 shutdown 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 msgr2=0x557fe1179700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0a40d0 tx=0x7f9d3c09bb80 comp rx=0 tx=0).stop 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 shutdown_connections 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe118c070 0x557fe118e4e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe1179700 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe1171dc0 0x557fe11791c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d2d7fa640 0 client.15390 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:37.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 --2- 172.21.15.39:0/2491455153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe11714a0 0x557fe117bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 >> 172.21.15.39:0/2491455153 conn(0x557fe116da30 msgr2=0x557fe1173710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 shutdown_connections 2024-09-12T01:57:37.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 1 -- 172.21.15.39:0/2491455153 wait complete. 2024-09-12T01:57:37.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.181+0000 7f9d4def5740 20 client.15390 trim_cache size 0 max 16384 2024-09-12T01:57:37.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 Processor -- start 2024-09-12T01:57:37.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 -- start start 2024-09-12T01:57:37.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1188500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe1193db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441add10 con 0x557fe117c680 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441ab5e0 con 0x557fe11714a0 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4def5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441a9430 con 0x557fe1171dc0 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4a0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34134/0 (socket says 172.21.15.39:34134) 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.216+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/3376269991 learned_addr learned my addr 172.21.15.39:0/3376269991 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d498b8640 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1188500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/3376269991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 msgr2=0x557fe1193db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe1193db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/3376269991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 msgr2=0x557fe1188500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1188500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 -- 172.21.15.39:0/3376269991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe116d860 con 0x557fe117c680 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0ccc80 tx=0x7f9d3c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36797fbf6b7ea708 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d2f7fe640 1 -- 172.21.15.39:0/3376269991 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c01f030 con 0x557fe117c680 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d2f7fe640 1 -- 172.21.15.39:0/3376269991 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d3c0a4600 con 0x557fe117c680 2024-09-12T01:57:37.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.217+0000 7f9d2f7fe640 1 -- 172.21.15.39:0/3376269991 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c097790 con 0x557fe117c680 2024-09-12T01:57:37.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 -- 172.21.15.39:0/3376269991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 msgr2=0x557fe11942f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0ccc80 tx=0x7f9d3c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 -- 172.21.15.39:0/3376269991 shutdown_connections 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe117c680 0x557fe11942f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe1171dc0 0x557fe1193db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 --2- 172.21.15.39:0/3376269991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1188500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 -- 172.21.15.39:0/3376269991 >> 172.21.15.39:0/3376269991 conn(0x557fe116da30 msgr2=0x557fe1177a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.218+0000 7f9d4def5740 1 -- 172.21.15.39:0/3376269991 shutdown_connections 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.219+0000 7f9d4def5740 1 -- 172.21.15.39:0/3376269991 wait complete. 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.219+0000 7f9d4def5740 1 -- start start 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.219+0000 7f9d4def5740 1 Processor -- start 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1184670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d490b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d490b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34146/0 (socket says 172.21.15.39:34146) 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d490b7640 1 -- 172.21.15.39:0/1289653147 learned_addr learned my addr 172.21.15.39:0/1289653147 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe117c680 0x557fe1181640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d498b8640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1184670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441a9aa0 con 0x557fe1171dc0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441aaf10 con 0x557fe11714a0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441aa170 con 0x557fe117c680 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.220+0000 7f9d4a0b9640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe117c680 0x557fe1181640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d4def5740 10 client.0 _ll_register_callbacks cb 0x7f9d3c097ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 -- 172.21.15.39:0/1289653147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe117c680 msgr2=0x557fe1181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe117c680 0x557fe1181640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 -- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 msgr2=0x557fe1184670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:37.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1184670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe1177090 con 0x557fe1171dc0 2024-09-12T01:57:37.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d498b8640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1184670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:37.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d3c0a4600 con 0x557fe1171dc0 2024-09-12T01:57:37.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d490b7640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b6c0 tx=0x7f9d34005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa32ba7528168097 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d2d7fa640 10 client.15396 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/1289653147 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3402d060 con 0x557fe1171dc0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/1289653147 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d34005020 con 0x557fe1171dc0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/1289653147 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d340052a0 con 0x557fe1171dc0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d4def5740 10 client.15396 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.221+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557fe11f70a0 con 0x557fe1171dc0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/1289653147 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d34005440 con 0x557fe1171dc0 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 10 client.15396 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 20 client.15396 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe11f75a0 0x557fe11f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:37.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 4 client.15396 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fe10ded60 con 0x557fe11f75a0 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.222+0000 7f9d498b8640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe11f75a0 0x557fe11f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d498b8640 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe11f75a0 0x557fe11f99c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c5f73122bb566d server_cookie=740f9e4f8a8830c6 in_seq=0 out_seq=0 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d2d7fa640 10 client.15396 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d2d7fa640 1 -- 172.21.15.39:0/1289653147 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557fe10ded60 con 0x557fe11f75a0 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d2d7fa640 10 client.15396 handle_command_reply: tid=0 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 client.15396 shutdown 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 msgr2=0x557fe1184bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b6c0 tx=0x7f9d34005b00 comp rx=0 tx=0).stop 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 shutdown_connections 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557fe11f75a0 0x557fe11f99c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fe117c680 0x557fe1181640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557fe1171dc0 0x557fe1184bb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 --2- 172.21.15.39:0/1289653147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557fe11714a0 0x557fe1184670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 >> 172.21.15.39:0/1289653147 conn(0x557fe116da30 msgr2=0x557fe117aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.223+0000 7f9d2d7fa640 0 client.15396 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 shutdown_connections 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4def5740 1 -- 172.21.15.39:0/1289653147 wait complete. 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4def5740 20 client.15396 trim_cache size 0 max 16384 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2024-09-12T01:57:37.229 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:37.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 msgr2=0x7f9d300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 0x7f9d300a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009230 tx=0x7f9d40043040 comp rx=0 tx=0).stop 2024-09-12T01:57:37.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 msgr2=0x7f9d441a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:37.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00eaa0 tx=0x7f9d3c00ef60 comp rx=0 tx=0).stop 2024-09-12T01:57:37.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 shutdown_connections 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d44102ef0 0x7f9d441a4450 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d300a2b80 0x7f9d300a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d44102570 0x7f9d44199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 --2- 172.21.15.39:0/8116043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d44100e20 0x7f9d441993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.224+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 >> 172.21.15.39:0/8116043 conn(0x7f9d440fc7d0 msgr2=0x7f9d440fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.225+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 shutdown_connections 2024-09-12T01:57:37.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:37.225+0000 7f9d4bb1c640 1 -- 172.21.15.39:0/8116043 wait complete. 2024-09-12T01:57:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:36 smithi172 ceph-mon[35073]: pgmap v358: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:57:37.645 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T01:57:37.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:37.906 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:57:37.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:37.949 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:38.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 -- 172.21.15.39:0/4042354397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260102790 msgr2=0x7f02601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 --2- 172.21.15.39:0/4042354397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260102790 0x7f02601067e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0254009900 tx=0x7f025402a410 comp rx=0 tx=0).stop 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 -- 172.21.15.39:0/4042354397 shutdown_connections 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 --2- 172.21.15.39:0/4042354397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260106f10 0x7f026010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 --2- 172.21.15.39:0/4042354397 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260102790 0x7f02601067e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 --2- 172.21.15.39:0/4042354397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260101de0 0x7f02601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 -- 172.21.15.39:0/4042354397 >> 172.21.15.39:0/4042354397 conn(0x7f02600fd880 msgr2=0x7f02600ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 -- 172.21.15.39:0/4042354397 shutdown_connections 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.462+0000 7f0265e5c640 1 -- 172.21.15.39:0/4042354397 wait complete. 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 Processor -- start 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 -- start start 2024-09-12T01:57:38.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260101de0 0x7f026019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260102790 0x7f026019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0260111f70 con 0x7f0260106f10 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0260111df0 con 0x7f0260102790 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f0265e5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02601120f0 con 0x7f0260101de0 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f025ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f025ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34170/0 (socket says 172.21.15.39:34170) 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f025ffff640 1 -- 172.21.15.39:0/3278889022 learned_addr learned my addr 172.21.15.39:0/3278889022 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f025effd640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260102790 0x7f026019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.463+0000 7f025f7fe640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260101de0 0x7f026019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 -- 172.21.15.39:0/3278889022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260101de0 msgr2=0x7f026019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260101de0 0x7f026019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 -- 172.21.15.39:0/3278889022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260102790 msgr2=0x7f026019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260102790 0x7f026019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 -- 172.21.15.39:0/3278889022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026019f5a0 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025ffff640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f025800cce0 tx=0x7f025800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025800f450 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026019f890 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025800fad0 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258018c10 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.464+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02601a7170 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.465+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02601032c0 con 0x7f0260106f10 2024-09-12T01:57:38.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.467+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f025800f5f0 con 0x7f0260106f10 2024-09-12T01:57:38.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.468+0000 7f025cff9640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 0x7f02480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:38.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.468+0000 7f025f7fe640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 0x7f02480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:38.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.468+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f02580cf610 con 0x7f0260106f10 2024-09-12T01:57:38.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.468+0000 7f025f7fe640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 0x7f02480a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f025000bbe0 tx=0x7f025000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:38.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.473+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0258014030 con 0x7f0260106f10 2024-09-12T01:57:38.536 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:38.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.711+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02601021c0 con 0x7f0260106f10 2024-09-12T01:57:38.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.712+0000 7f025cff9640 1 -- 172.21.15.39:0/3278889022 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f02601021c0 con 0x7f0260106f10 2024-09-12T01:57:38.713 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:38.713 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:38.714 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 msgr2=0x7f02480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 0x7f02480a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f025000bbe0 tx=0x7f025000b390 comp rx=0 tx=0).stop 2024-09-12T01:57:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 msgr2=0x7f026019eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:38.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f025800cce0 tx=0x7f025800a620 comp rx=0 tx=0).stop 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 shutdown_connections 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0260106f10 0x7f026019eec0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0260102790 0x7f026019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f02480a2b80 0x7f02480a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 --2- 172.21.15.39:0/3278889022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0260101de0 0x7f026019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 >> 172.21.15.39:0/3278889022 conn(0x7f02600fd880 msgr2=0x7f02600feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.714+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 shutdown_connections 2024-09-12T01:57:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:38.715+0000 7f0265e5c640 1 -- 172.21.15.39:0/3278889022 wait complete. 2024-09-12T01:57:38.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:38 smithi039 ceph-mon[31204]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:38.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:38 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3278889022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:38 smithi044 ceph-mon[35259]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:38 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3278889022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:38 smithi172 ceph-mon[35073]: pgmap v359: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:38 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3278889022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 -- 172.21.15.39:0/434379180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102570 msgr2=0x7f10941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 --2- 172.21.15.39:0/434379180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102570 0x7f10941029b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1080009900 tx=0x7f108002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 -- 172.21.15.39:0/434379180 shutdown_connections 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 --2- 172.21.15.39:0/434379180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094102ef0 0x7f109410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 --2- 172.21.15.39:0/434379180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102570 0x7f10941029b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 --2- 172.21.15.39:0/434379180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094100e20 0x7f1094101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 -- 172.21.15.39:0/434379180 >> 172.21.15.39:0/434379180 conn(0x7f10940fc7d0 msgr2=0x7f10940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 -- 172.21.15.39:0/434379180 shutdown_connections 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.232+0000 7f109abf3640 1 -- 172.21.15.39:0/434379180 wait complete. 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 Processor -- start 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 -- start start 2024-09-12T01:57:39.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 0x7f109419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094102570 0x7f109419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1094110f80 con 0x7f1094102ef0 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1094110e00 con 0x7f1094102570 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f109abf3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1094111100 con 0x7f1094100e20 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.233+0000 7f1099190640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f1099190640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34180/0 (socket says 172.21.15.39:34180) 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f1099190640 1 -- 172.21.15.39:0/1119612006 learned_addr learned my addr 172.21.15.39:0/1119612006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 0x7f109419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f1093fff640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094102570 0x7f109419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 -- 172.21.15.39:0/1119612006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094102570 msgr2=0x7f109419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094102570 0x7f109419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 -- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 msgr2=0x7f109419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 -- 172.21.15.39:0/1119612006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109419f650 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f1099190640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109898f640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 0x7f109419a6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f108800d6d0 tx=0x7f108800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088017070 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.234+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109419f940 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.235+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1088009820 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.235+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088004cd0 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.235+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10941a7220 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.236+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1094101200 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.237+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f10880099d0 con 0x7f1094100e20 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.237+0000 7f1091ffb640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 0x7f10840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.238+0000 7f1093fff640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 0x7f10840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.238+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f10880ceb20 con 0x7f1094100e20 2024-09-12T01:57:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.238+0000 7f1093fff640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 0x7f10840a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1080009230 tx=0x7f10800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.242+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f108809b440 con 0x7f1094100e20 2024-09-12T01:57:39.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.474+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10941a73f0 con 0x7f1094100e20 2024-09-12T01:57:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.475+0000 7f1091ffb640 1 -- 172.21.15.39:0/1119612006 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f108809f740 con 0x7f1094100e20 2024-09-12T01:57:39.476 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:39.476 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:39.476 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 msgr2=0x7f10840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 0x7f10840a5040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1080009230 tx=0x7f10800058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 msgr2=0x7f109419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 0x7f109419a6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f108800d6d0 tx=0x7f108800db90 comp rx=0 tx=0).stop 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 shutdown_connections 2024-09-12T01:57:39.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1094102ef0 0x7f109419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1094102570 0x7f109419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f10840a2b80 0x7f10840a5040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 --2- 172.21.15.39:0/1119612006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1094100e20 0x7f109419a6a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 >> 172.21.15.39:0/1119612006 conn(0x7f10940fc7d0 msgr2=0x7f109406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 shutdown_connections 2024-09-12T01:57:39.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:39.477+0000 7f109abf3640 1 -- 172.21.15.39:0/1119612006 wait complete. 2024-09-12T01:57:39.688 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T01:57:39.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T01:57:40.055 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:39 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1119612006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:40.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:39 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1119612006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:40.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:39 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1119612006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:40.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:57:40.447 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 -- 172.21.15.39:0/473890911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f41049a0 msgr2=0x7f89f41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/473890911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f41049a0 0x7f89f41089f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009900 tx=0x7f89e802a400 comp rx=0 tx=0).stop 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 -- 172.21.15.39:0/473890911 shutdown_connections 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/473890911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f4109120 0x7f89f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/473890911 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f41049a0 0x7f89f41089f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/473890911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4103ff0 0x7f89f41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 -- 172.21.15.39:0/473890911 >> 172.21.15.39:0/473890911 conn(0x7f89f40ffab0 msgr2=0x7f89f4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 -- 172.21.15.39:0/473890911 shutdown_connections 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.989+0000 7f89fa1ed640 1 -- 172.21.15.39:0/473890911 wait complete. 2024-09-12T01:57:40.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.990+0000 7f89fa1ed640 1 Processor -- start 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.990+0000 7f89fa1ed640 1 -- start start 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 0x7f89f41a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4109120 0x7f89f419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4114270 con 0x7f89f4103ff0 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41140f0 con 0x7f89f41049a0 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89fa1ed640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41143f0 con 0x7f89f4109120 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34196/0 (socket says 172.21.15.39:34196) 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 -- 172.21.15.39:0/4156238989 learned_addr learned my addr 172.21.15.39:0/4156238989 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 0x7f89f41a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f3fff640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4109120 0x7f89f419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 -- 172.21.15.39:0/4156238989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4109120 msgr2=0x7f89f419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4109120 0x7f89f419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 -- 172.21.15.39:0/4156238989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 msgr2=0x7f89f41a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 0x7f89f41a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f37fe640 1 -- 172.21.15.39:0/4156238989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f419af10 con 0x7f89f4103ff0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.991+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 0x7f89f41a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b4a0 tx=0x7f89e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89f0ff9640 1 -- 172.21.15.39:0/4156238989 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4014070 con 0x7f89f4103ff0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89f0ff9640 1 -- 172.21.15.39:0/4156238989 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e4010af0 con 0x7f89f4103ff0 2024-09-12T01:57:40.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f419b200 con 0x7f89f4103ff0 2024-09-12T01:57:40.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89f0ff9640 1 -- 172.21.15.39:0/4156238989 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4017d10 con 0x7f89f4103ff0 2024-09-12T01:57:40.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.992+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41a73a0 con 0x7f89f4103ff0 2024-09-12T01:57:40.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.995+0000 7f89f0ff9640 1 -- 172.21.15.39:0/4156238989 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f89e4017070 con 0x7f89f4103ff0 2024-09-12T01:57:40.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:40 smithi039 ceph-mon[31204]: pgmap v360: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:40.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.995+0000 7f89fc5c6740 1 Processor -- start 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.995+0000 7f89fc5c6740 1 -- start start 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.995+0000 7f89f0ff9640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 0x7f89dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f0ff9640 1 -- 172.21.15.39:0/4156238989 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89e40ce1f0 con 0x7f89f4103ff0 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fc1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ef26f1c2a0 con 0x55ef26fb6760 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ef26ec3b10 con 0x55ef26fb7080 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ef26f18260 con 0x55ef26fc1940 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34210/0 (socket says 172.21.15.39:34210) 2024-09-12T01:57:40.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 -- 172.21.15.39:0/90411885 learned_addr learned my addr 172.21.15.39:0/90411885 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:40.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f3fff640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 0x7f89dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fc1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:40.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 -- 172.21.15.39:0/90411885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 msgr2=0x55ef26fc3d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc3d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 -- 172.21.15.39:0/90411885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 msgr2=0x55ef26fc1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fc1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f37fe640 1 -- 172.21.15.39:0/90411885 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef26c8db90 con 0x55ef26fb6760 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.996+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fc1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.997+0000 7f89f37fe640 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f89e4096ec0 tx=0x7f89e40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b339f4ba76ffb77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.997+0000 7f89f3fff640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 0x7f89dc0a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009fb0 tx=0x7f89ec00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.997+0000 7f89d9ffb640 1 -- 172.21.15.39:0/90411885 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e401e070 con 0x55ef26fb6760 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.997+0000 7f89d9ffb640 1 -- 172.21.15.39:0/90411885 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e40a36d0 con 0x55ef26fb6760 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.997+0000 7f89d9ffb640 1 -- 172.21.15.39:0/90411885 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e409a110 con 0x55ef26fb6760 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 -- 172.21.15.39:0/90411885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 msgr2=0x55ef26fb6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:40.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f89e4096ec0 tx=0x7f89e40047d0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 -- 172.21.15.39:0/90411885 shutdown_connections 2024-09-12T01:57:41.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fc1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/90411885 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb6760 0x55ef26fb6b40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 -- 172.21.15.39:0/90411885 >> 172.21.15.39:0/90411885 conn(0x55ef26fb2cf0 msgr2=0x55ef26fb30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 -- 172.21.15.39:0/90411885 shutdown_connections 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.998+0000 7f89fc5c6740 1 -- 172.21.15.39:0/90411885 wait complete. 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 -- start start 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 Processor -- start 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fbed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ef26fc44b0 con 0x55ef26fc1940 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ef26ea46e0 con 0x55ef26fb7080 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:40.999+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ef26fc4630 con 0x55ef26fb6760 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89fc5c6740 10 client.0 _ll_register_callbacks cb 0x55ef26ec8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34220/0 (socket says 172.21.15.39:34220) 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 -- 172.21.15.39:0/2017844515 learned_addr learned my addr 172.21.15.39:0/2017844515 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fbed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 -- 172.21.15.39:0/2017844515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 msgr2=0x55ef26fbe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 -- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 msgr2=0x55ef26fbed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fbed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 -- 172.21.15.39:0/2017844515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef26fcda00 con 0x55ef26fc1940 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89f3fff640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0070b0 tx=0x7f89ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4378398f86365dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.000+0000 7f89d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec015d00 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89ec017030 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e40a36d0 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89ec017230 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89fc5c6740 10 client.15420 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.001+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef26fd0360 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e40a36d0 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89ec016570 con 0x55ef26fc1940 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89fc5c6740 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89fc5c6740 10 client.15420 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89fc5c6740 20 client.15420 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:41.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.002+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef26fd3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.003+0000 7f89fc5c6740 4 client.15420 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.003+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef26f299d0 con 0x55ef26fd1810 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.003+0000 7f89f37fe640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef26fd3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.003+0000 7f89f37fe640 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef26fd3c30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4370fc964feb113 server_cookie=63ec8d4b6eafe76b in_seq=0 out_seq=0 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.003+0000 7f89d2ffd640 10 client.15420 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.004+0000 7f89d2ffd640 1 -- 172.21.15.39:0/2017844515 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef26f299d0 con 0x55ef26fd1810 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.004+0000 7f89d2ffd640 10 client.15420 handle_command_reply: tid=0 2024-09-12T01:57:41.006 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.004+0000 7f89fc5c6740 1 client.15420 shutdown 2024-09-12T01:57:41.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.004+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 msgr2=0x55ef26fbf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.004+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0070b0 tx=0x7f89ec004a40 comp rx=0 tx=0).stop 2024-09-12T01:57:41.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 shutdown_connections 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef26fd3c30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fc1940 0x55ef26fbf2d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89d2ffd640 0 client.15420 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb7080 0x55ef26fbed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/2017844515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 >> 172.21.15.39:0/2017844515 conn(0x55ef26fb2cf0 msgr2=0x55ef26fb8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 shutdown_connections 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 1 -- 172.21.15.39:0/2017844515 wait complete. 2024-09-12T01:57:41.008 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.005+0000 7f89fc5c6740 20 client.15420 trim_cache size 0 max 16384 2024-09-12T01:57:41.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.027+0000 7f89fc5c6740 1 Processor -- start 2024-09-12T01:57:41.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.027+0000 7f89fc5c6740 1 -- start start 2024-09-12T01:57:41.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.027+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fb88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 0x55ef26fd94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fb88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fb88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34228/0 (socket says 172.21.15.39:34228) 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f2ffd640 1 -- 172.21.15.39:0/3402466681 learned_addr learned my addr 172.21.15.39:0/3402466681 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0010cc0 con 0x55ef26fb7080 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89e000e590 con 0x55ef26fc1940 2024-09-12T01:57:41.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89e000c3e0 con 0x55ef26fb6760 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f3fff640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 0x55ef26fd94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 -- 172.21.15.39:0/3402466681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 msgr2=0x55ef26fd94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 0x55ef26fd94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 -- 172.21.15.39:0/3402466681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 msgr2=0x55ef26fb88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fb88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.028+0000 7f89f37fe640 1 -- 172.21.15.39:0/3402466681 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef26fb2b20 con 0x55ef26fb6760 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.029+0000 7f89f3fff640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 0x55ef26fd94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.029+0000 7f89f37fe640 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbf120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89e40178e0 tx=0x7f89e409a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14bc8d987b21e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.029+0000 7f89d97fa640 1 -- 172.21.15.39:0/3402466681 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e401e040 con 0x55ef26fb6760 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.029+0000 7f89d97fa640 1 -- 172.21.15.39:0/3402466681 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e4010ca0 con 0x55ef26fb6760 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.029+0000 7f89d97fa640 1 -- 172.21.15.39:0/3402466681 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e409a110 con 0x55ef26fb6760 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 msgr2=0x55ef26fbf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbf120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89e40178e0 tx=0x7f89e409a6d0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 shutdown_connections 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fc1940 0x55ef26fd94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fb88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/3402466681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fb6760 0x55ef26fbf120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 >> 172.21.15.39:0/3402466681 conn(0x55ef26fb2cf0 msgr2=0x55ef26fb81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 shutdown_connections 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- 172.21.15.39:0/3402466681 wait complete. 2024-09-12T01:57:41.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.030+0000 7f89fc5c6740 1 -- start start 2024-09-12T01:57:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 Processor -- start 2024-09-12T01:57:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb6760 0x55ef26fc5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f89e000ca50 con 0x55ef26fb7080 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89e000dec0 con 0x55ef26fb6760 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89e000d120 con 0x55ef26fc1940 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89fc5c6740 10 client.0 _ll_register_callbacks cb 0x7f89ec017b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89f2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34234/0 (socket says 172.21.15.39:34234) 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89f2ffd640 1 -- 172.21.15.39:0/4063583428 learned_addr learned my addr 172.21.15.39:0/4063583428 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.031+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb6760 0x55ef26fc5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f3fff640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 -- 172.21.15.39:0/4063583428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 msgr2=0x55ef26fc62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 -- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb6760 msgr2=0x55ef26fc5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb6760 0x55ef26fc5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 -- 172.21.15.39:0/4063583428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2703b700 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f3fff640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89f2ffd640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f89e8006010 tx=0x7f89e8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767a2e12c4e6cc44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8035040 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89e8005020 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.032+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e4010ca0 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89e8005220 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef270451b0 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89e4010ca0 con 0x55ef26fb7080 2024-09-12T01:57:41.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89e80317c0 con 0x55ef26fb7080 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 10 client.15426 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 20 client.15426 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef27047990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 4 client.15426 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.033+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x55ef26f23d20 con 0x55ef26fd1810 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.034+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef27047990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.034+0000 7f89f37fe640 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef27047990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2449e8f04fbb5f9 server_cookie=c05b25c73eb11652 in_seq=0 out_seq=0 2024-09-12T01:57:41.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.034+0000 7f89d2ffd640 10 client.15426 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.039 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:41.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.043+0000 7f89d2ffd640 1 -- 172.21.15.39:0/4063583428 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ef26f23d20 con 0x55ef26fd1810 2024-09-12T01:57:41.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.043+0000 7f89d2ffd640 10 client.15426 handle_command_reply: tid=0 2024-09-12T01:57:41.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.043+0000 7f89fc5c6740 1 client.15426 shutdown 2024-09-12T01:57:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 msgr2=0x55ef26fc5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f89e8006010 tx=0x7f89e8003960 comp rx=0 tx=0).stop 2024-09-12T01:57:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 shutdown_connections 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ef26fd1810 0x55ef27047990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef26fc1940 0x55ef26fc62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ef26fb7080 0x55ef26fc5d70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 --2- 172.21.15.39:0/4063583428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ef26fb6760 0x55ef26fc5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 >> 172.21.15.39:0/4063583428 conn(0x55ef26fb2cf0 msgr2=0x55ef26fb89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89d2ffd640 0 client.15426 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 shutdown_connections 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 1 -- 172.21.15.39:0/4063583428 wait complete. 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.044+0000 7f89fc5c6740 20 client.15426 trim_cache size 0 max 16384 2024-09-12T01:57:41.046 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 25, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 2, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "f10eb086": { 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 2, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T01:57:41.047 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 144.5, 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:57:41.048 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 msgr2=0x7f89dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 0x7f89dc0a5040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009fb0 tx=0x7f89ec00d040 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 msgr2=0x7f89f41a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b4a0 tx=0x7f89e400b960 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 shutdown_connections 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f89dc0a2b80 0x7f89dc0a5040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f4109120 0x7f89f419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41049a0 0x7f89f41a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 --2- 172.21.15.39:0/4156238989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89f4103ff0 0x7f89f41a0580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 >> 172.21.15.39:0/4156238989 conn(0x7f89f40ffab0 msgr2=0x7f89f4100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 shutdown_connections 2024-09-12T01:57:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:41.045+0000 7f89fa1ed640 1 -- 172.21.15.39:0/4156238989 wait complete. 2024-09-12T01:57:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:40 smithi044 ceph-mon[35259]: pgmap v360: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:40 smithi172 ceph-mon[35073]: pgmap v360: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.550+0000 7f30da752640 1 -- 172.21.15.39:0/2929727403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4102620 msgr2=0x7f30d4104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.550+0000 7f30da752640 1 --2- 172.21.15.39:0/2929727403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4102620 0x7f30d4104a10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009900 tx=0x7f30c402a410 comp rx=0 tx=0).stop 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 -- 172.21.15.39:0/2929727403 shutdown_connections 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 --2- 172.21.15.39:0/2929727403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4107880 0x7f30d4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 --2- 172.21.15.39:0/2929727403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4104f50 0x7f30d4107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 --2- 172.21.15.39:0/2929727403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4102620 0x7f30d4104a10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 -- 172.21.15.39:0/2929727403 >> 172.21.15.39:0/2929727403 conn(0x7f30d40fc1e0 msgr2=0x7f30d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 -- 172.21.15.39:0/2929727403 shutdown_connections 2024-09-12T01:57:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 -- 172.21.15.39:0/2929727403 wait complete. 2024-09-12T01:57:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 Processor -- start 2024-09-12T01:57:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.551+0000 7f30da752640 1 -- start start 2024-09-12T01:57:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4102620 0x7f30d4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4107880 0x7f30d419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30d410d830 con 0x7f30d4104f50 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30d410d6b0 con 0x7f30d4102620 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30da752640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30d410d9b0 con 0x7f30d4107880 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34258/0 (socket says 172.21.15.39:34258) 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 -- 172.21.15.39:0/3766259021 learned_addr learned my addr 172.21.15.39:0/3766259021 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d3fff640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4102620 0x7f30d4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4107880 0x7f30d419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 -- 172.21.15.39:0/3766259021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4107880 msgr2=0x7f30d419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4107880 0x7f30d419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 -- 172.21.15.39:0/3766259021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4102620 msgr2=0x7f30d4197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4102620 0x7f30d4197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 -- 172.21.15.39:0/3766259021 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d419fab0 con 0x7f30d4104f50 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d37fe640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d740 tx=0x7f30c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.552+0000 7f30d17fa640 1 -- 172.21.15.39:0/3766259021 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8017070 con 0x7f30d4104f50 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.553+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419fda0 con 0x7f30d4104f50 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.553+0000 7f30d17fa640 1 -- 172.21.15.39:0/3766259021 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c800de50 con 0x7f30d4104f50 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.553+0000 7f30d17fa640 1 -- 172.21.15.39:0/3766259021 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8004e00 con 0x7f30d4104f50 2024-09-12T01:57:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.553+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41a0260 con 0x7f30d4104f50 2024-09-12T01:57:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.555+0000 7f30d17fa640 1 -- 172.21.15.39:0/3766259021 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f30c8004fa0 con 0x7f30d4104f50 2024-09-12T01:57:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.555+0000 7f30dd5c9740 1 Processor -- start 2024-09-12T01:57:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 -- start start 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ad61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567adb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557567a352f0 con 0x557567adb780 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5575679dd270 con 0x557567ad66f0 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557567a312b0 con 0x557567ad5db0 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34260/0 (socket says 172.21.15.39:34260) 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d37fe640 1 -- 172.21.15.39:0/3715517237 learned_addr learned my addr 172.21.15.39:0/3715517237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d3fff640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567adb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ad61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.556+0000 7f30d17fa640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 0x7f30bc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 -- 172.21.15.39:0/3715517237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 msgr2=0x557567adb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567adb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 -- 172.21.15.39:0/3715517237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 msgr2=0x557567addc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 -- 172.21.15.39:0/3715517237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575679dc340 con 0x557567ad5db0 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d17fa640 1 -- 172.21.15.39:0/3766259021 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f30c80cea20 con 0x7f30d4104f50 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d37fe640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 0x7f30bc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ad61b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005fd0 tx=0x7f30cc00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2250b6e538ecb3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30ba7fc640 1 -- 172.21.15.39:0/3715517237 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012dc0 con 0x557567ad5db0 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30d8cef640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 0x7f30bc0a5170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30cc020000 tx=0x7f30cc01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30ba7fc640 1 -- 172.21.15.39:0/3715517237 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30cc01a8f0 con 0x557567ad5db0 2024-09-12T01:57:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.557+0000 7f30ba7fc640 1 -- 172.21.15.39:0/3715517237 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0108a0 con 0x557567ad5db0 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 -- 172.21.15.39:0/3715517237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 msgr2=0x557567ad61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ad61b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005fd0 tx=0x7f30cc00f730 comp rx=0 tx=0).stop 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 -- 172.21.15.39:0/3715517237 shutdown_connections 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567addc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567adb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/3715517237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ad61b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 -- 172.21.15.39:0/3715517237 >> 172.21.15.39:0/3715517237 conn(0x557567acd010 msgr2=0x557567acd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 -- 172.21.15.39:0/3715517237 shutdown_connections 2024-09-12T01:57:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.558+0000 7f30dd5c9740 1 -- 172.21.15.39:0/3715517237 wait complete. 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 -- start start 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 Processor -- start 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad5db0 0x557567ae0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad66f0 0x557567ae0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557567ade750 con 0x557567adb780 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5575679be290 con 0x557567ad5db0 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557567ade8d0 con 0x557567ad66f0 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30dd5c9740 10 client.0 _ll_register_callbacks cb 0x5575679ef140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30d8cef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30d8cef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34270/0 (socket says 172.21.15.39:34270) 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30d8cef640 1 -- 172.21.15.39:0/2066230047 learned_addr learned my addr 172.21.15.39:0/2066230047 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.559+0000 7f30d3fff640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad5db0 0x557567ae0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d37fe640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad66f0 0x557567ae0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 -- 172.21.15.39:0/2066230047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad66f0 msgr2=0x557567ae0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad66f0 0x557567ae0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 -- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad5db0 msgr2=0x557567ae0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad5db0 0x557567ae0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 -- 172.21.15.39:0/2066230047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557567748210 con 0x557567adb780 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30d8cef640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005cc0 tx=0x7f30cc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b63e21d4795fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc033060 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30cc01a8f0 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f30cc01aaa0 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30cc01aca0 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30dd5c9740 10 client.15438 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.560+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557567814620 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30cc01a8f0 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30cc0256a0 con 0x557567adb780 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 10 client.15438 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 20 client.15438 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:41.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567aeba10 0x557567aede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 4 client.15438 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557567a42a20 con 0x557567aeba10 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.561+0000 7f30d3fff640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567aeba10 0x557567aede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.562+0000 7f30d3fff640 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567aeba10 0x557567aede00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=318335307425e79b server_cookie=e0d47c4fb90c563c in_seq=0 out_seq=0 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.562+0000 7f30b37fe640 10 client.15438 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.562+0000 7f30b37fe640 1 -- 172.21.15.39:0/2066230047 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557567a42a20 con 0x557567aeba10 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.562+0000 7f30b37fe640 10 client.15438 handle_command_reply: tid=0 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.562+0000 7f30dd5c9740 1 client.15438 shutdown 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 msgr2=0x557567ae7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005cc0 tx=0x7f30cc009a50 comp rx=0 tx=0).stop 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 shutdown_connections 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567aeba10 0x557567aede00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae7550 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad66f0 0x557567ae0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/2066230047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad5db0 0x557567ae0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 >> 172.21.15.39:0/2066230047 conn(0x557567acd010 msgr2=0x557567ace820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30b37fe640 0 client.15438 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 shutdown_connections 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 1 -- 172.21.15.39:0/2066230047 wait complete. 2024-09-12T01:57:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.563+0000 7f30dd5c9740 20 client.15438 trim_cache size 0 max 16384 2024-09-12T01:57:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 Processor -- start 2024-09-12T01:57:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 -- start start 2024-09-12T01:57:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567adb780 0x557567ace460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a9640 con 0x557567ad5db0 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a6f10 con 0x557567ad66f0 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.577+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a4d60 con 0x557567adb780 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34278/0 (socket says 172.21.15.39:34278) 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 -- 172.21.15.39:0/269890779 learned_addr learned my addr 172.21.15.39:0/269890779 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d37fe640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d8cef640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567adb780 0x557567ace460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 -- 172.21.15.39:0/269890779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567adb780 msgr2=0x557567ace460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567adb780 0x557567ace460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 -- 172.21.15.39:0/269890779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 msgr2=0x557567ae7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 -- 172.21.15.39:0/269890779 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557567ade9d0 con 0x557567ad5db0 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d37fe640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30d3fff640 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f30c402a930 tx=0x7f30c40315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dce10110fcc06f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30b9ffb640 1 -- 172.21.15.39:0/269890779 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4035040 con 0x557567ad5db0 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30b9ffb640 1 -- 172.21.15.39:0/269890779 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c4005040 con 0x557567ad5db0 2024-09-12T01:57:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.578+0000 7f30b9ffb640 1 -- 172.21.15.39:0/269890779 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004920 con 0x557567ad5db0 2024-09-12T01:57:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 -- 172.21.15.39:0/269890779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 msgr2=0x557567acdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f30c402a930 tx=0x7f30c40315d0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 -- 172.21.15.39:0/269890779 shutdown_connections 2024-09-12T01:57:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567adb780 0x557567ace460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/269890779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567ad5db0 0x557567acdf20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 -- 172.21.15.39:0/269890779 >> 172.21.15.39:0/269890779 conn(0x557567acd010 msgr2=0x557567ae0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 -- 172.21.15.39:0/269890779 shutdown_connections 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.579+0000 7f30dd5c9740 1 -- 172.21.15.39:0/269890779 wait complete. 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 -- start start 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 Processor -- start 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ae4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a53d0 con 0x557567adb780 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a6840 con 0x557567ad66f0 2024-09-12T01:57:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41a5aa0 con 0x557567ad5db0 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30dd5c9740 10 client.0 _ll_register_callbacks cb 0x7f30c80d23d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34284/0 (socket says 172.21.15.39:34284) 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 -- 172.21.15.39:0/1728454211 learned_addr learned my addr 172.21.15.39:0/1728454211 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d37fe640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d3fff640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ae4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 -- 172.21.15.39:0/1728454211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 msgr2=0x557567ae4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ae4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 -- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 msgr2=0x557567ae4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d8cef640 1 -- 172.21.15.39:0/1728454211 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557567ae6290 con 0x557567adb780 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d3fff640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ae4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.580+0000 7f30d37fe640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30d8cef640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009660 tx=0x7f30cc005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e58f08628dbd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc03e070 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f30cc025640 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c4005040 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f30cc033040 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30dd5c9740 10 client.15444 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557567ae75a0 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30c4005040 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30cc02f780 con 0x557567adb780 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30dd5c9740 10 client.15444 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.581+0000 7f30dd5c9740 10 client.15444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30dd5c9740 20 client.15444 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567b56aa0 0x557567b58ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30dd5c9740 4 client.15444 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557567a3cd70 con 0x557567b56aa0 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30d3fff640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567b56aa0 0x557567b58ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30b37fe640 10 client.15444 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.582+0000 7f30d3fff640 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567b56aa0 0x557567b58ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb9bb8eb8ab77fd server_cookie=c24b7cac4aa16581 in_seq=0 out_seq=0 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.589+0000 7f30b37fe640 1 -- 172.21.15.39:0/1728454211 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557567a3cd70 con 0x557567b56aa0 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.589+0000 7f30b37fe640 10 client.15444 handle_command_reply: tid=0 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.589+0000 7f30dd5c9740 1 client.15444 shutdown 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 msgr2=0x557567ae5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009660 tx=0x7f30cc005e30 comp rx=0 tx=0).stop 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 shutdown_connections 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557567b56aa0 0x557567b58ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557567adb780 0x557567ae5c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557567ad66f0 0x557567ae4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 --2- 172.21.15.39:0/1728454211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557567ad5db0 0x557567ae4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 >> 172.21.15.39:0/1728454211 conn(0x557567acd010 msgr2=0x557567acb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30b37fe640 0 client.15444 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 shutdown_connections 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 1 -- 172.21.15.39:0/1728454211 wait complete. 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.590+0000 7f30dd5c9740 20 client.15444 trim_cache size 0 max 16384 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:57:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:57:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 msgr2=0x7f30bc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 0x7f30bc0a5170 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30cc020000 tx=0x7f30cc01d000 comp rx=0 tx=0).stop 2024-09-12T01:57:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 msgr2=0x7f30d41983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f30c800d740 tx=0x7f30c800dc00 comp rx=0 tx=0).stop 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 shutdown_connections 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f30bc0a2cb0 0x7f30bc0a5170 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d4107880 0x7f30d419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30d4104f50 0x7f30d41983d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 --2- 172.21.15.39:0/3766259021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30d4102620 0x7f30d4197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 >> 172.21.15.39:0/3766259021 conn(0x7f30d40fc1e0 msgr2=0x7f30d4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 shutdown_connections 2024-09-12T01:57:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:41.591+0000 7f30da752640 1 -- 172.21.15.39:0/3766259021 wait complete. 2024-09-12T01:57:42.129 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f10eb086', quiesce took 4.5 seconds. Will release after: 20.0 2024-09-12T01:57:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:42 smithi044 ceph-mon[35259]: pgmap v361: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T01:57:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:42 smithi172 ceph-mon[35073]: pgmap v361: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T01:57:43.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:42 smithi039 ceph-mon[31204]: pgmap v361: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-12T01:57:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:44 smithi172 ceph-mon[35073]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:57:45.398 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:44 smithi039 ceph-mon[31204]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:57:45.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:44 smithi044 ceph-mon[35259]: pgmap v362: 97 pgs: 97 active+clean; 655 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 -- 172.21.15.39:0/3958534601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 msgr2=0x7f8a2810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/3958534601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a2810d930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009cd0 tx=0x7f8a2002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 -- 172.21.15.39:0/3958534601 shutdown_connections 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/3958534601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a2810d930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/3958534601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/3958534601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 0x7f8a28106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 -- 172.21.15.39:0/3958534601 >> 172.21.15.39:0/3958534601 conn(0x7f8a280fc780 msgr2=0x7f8a280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 -- 172.21.15.39:0/3958534601 shutdown_connections 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.523+0000 7f8a2ce60640 1 -- 172.21.15.39:0/3958534601 wait complete. 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.524+0000 7f8a2ce60640 1 Processor -- start 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.524+0000 7f8a2ce60640 1 -- start start 2024-09-12T01:57:46.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 0x7f8a2819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28110ed0 con 0x7f8a28101400 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28110d50 con 0x7f8a28106a60 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2ce60640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28111050 con 0x7f8a28100a60 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41374/0 (socket says 172.21.15.39:41374) 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 -- 172.21.15.39:0/1259222167 learned_addr learned my addr 172.21.15.39:0/1259222167 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a26d9d640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 0x7f8a2819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 -- 172.21.15.39:0/1259222167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 msgr2=0x7f8a28198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 -- 172.21.15.39:0/1259222167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 msgr2=0x7f8a2819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 0x7f8a2819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a25d9b640 1 -- 172.21.15.39:0/1259222167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2819d4b0 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.525+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.526+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00b4a0 tx=0x7f8a1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.526+0000 7f8a177fe640 1 -- 172.21.15.39:0/1259222167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c014070 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.526+0000 7f8a177fe640 1 -- 172.21.15.39:0/1259222167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1c010af0 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.526+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2819d7a0 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.527+0000 7f8a177fe640 1 -- 172.21.15.39:0/1259222167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c017d10 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.527+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a281a5080 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.529+0000 7f8a177fe640 1 -- 172.21.15.39:0/1259222167 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8a1c017070 con 0x7f8a28101400 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.530+0000 7f8a177fe640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 0x7f8a100a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.530+0000 7f8a2f239740 1 Processor -- start 2024-09-12T01:57:46.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.530+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 0x7f8a100a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.530+0000 7f8a177fe640 1 -- 172.21.15.39:0/1259222167 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a1c0cdc90 con 0x7f8a28101400 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.530+0000 7f8a2f239740 1 -- start start 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd6442f0 con 0x55e0bd6e8280 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd5ebcf0 con 0x55e0bd6ed5d0 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2f239740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd6402b0 con 0x55e0bd6e8c00 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41378/0 (socket says 172.21.15.39:41378) 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 -- 172.21.15.39:0/258878591 learned_addr learned my addr 172.21.15.39:0/258878591 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:46.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 0x7f8a100a5190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a180058c0 tx=0x7f8a18005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a2659c640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a26d9d640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 -- 172.21.15.39:0/258878591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 msgr2=0x55e0bd6f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 -- 172.21.15.39:0/258878591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 msgr2=0x55e0bd6ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.531+0000 7f8a25d9b640 1 -- 172.21.15.39:0/258878591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bd5d03a0 con 0x55e0bd6e8280 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.532+0000 7f8a2659c640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.532+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09a490 tx=0x7f8a1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125608c8d35db990 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.532+0000 7f8a14ff9640 1 -- 172.21.15.39:0/258878591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c01e040 con 0x55e0bd6e8280 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.532+0000 7f8a14ff9640 1 -- 172.21.15.39:0/258878591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1c0a3170 con 0x55e0bd6e8280 2024-09-12T01:57:46.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.532+0000 7f8a14ff9640 1 -- 172.21.15.39:0/258878591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c099b50 con 0x55e0bd6e8280 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 -- 172.21.15.39:0/258878591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 msgr2=0x55e0bd6e86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09a490 tx=0x7f8a1c000bc0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 -- 172.21.15.39:0/258878591 shutdown_connections 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd6e86c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 --2- 172.21.15.39:0/258878591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 -- 172.21.15.39:0/258878591 >> 172.21.15.39:0/258878591 conn(0x55e0bd6a7310 msgr2=0x55e0bd6da6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.533+0000 7f8a2f239740 1 -- 172.21.15.39:0/258878591 shutdown_connections 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.534+0000 7f8a2f239740 1 -- 172.21.15.39:0/258878591 wait complete. 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.534+0000 7f8a2f239740 1 -- start start 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.534+0000 7f8a2f239740 1 Processor -- start 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.535+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.535+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.535+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.535+0000 7f8a2f239740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd6f4870 con 0x55e0bd6ed5d0 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.535+0000 7f8a2f239740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd5ff060 con 0x55e0bd6e8280 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2f239740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e0bd6f49f0 con 0x55e0bd6e8c00 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:39878/0 (socket says 172.21.15.39:39878) 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 -- 172.21.15.39:0/1397454770 learned_addr learned my addr 172.21.15.39:0/1397454770 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2f239740 10 client.0 _ll_register_callbacks cb 0x55e0bd3528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a26d9d640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 -- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 msgr2=0x55e0bd6f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 -- 172.21.15.39:0/1397454770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 msgr2=0x55e0bd6f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 -- 172.21.15.39:0/1397454770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bd3b53c0 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a2659c640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a180116f0 tx=0x7f8a180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b4b6efd7dc74d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.536+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1801ea50 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a1801ebf0 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a1c0a3170 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a1801edf0 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a2f239740 10 client.25091 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e0bd7002c0 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.537+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1801f910 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a180276f0 con 0x55e0bd6e8280 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 10 client.25091 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 10 client.25091 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:57:46.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 20 client.25091 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd701780 0x55e0bd703be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 4 client.25091 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a1c0a3170 con 0x55e0bd701780 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.538+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd701780 0x55e0bd703be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.539+0000 7f8a0dffb640 10 client.25091 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.539+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd701780 0x55e0bd703be0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=515deaac143d33c7 server_cookie=c6e001f71dc552e2 in_seq=0 out_seq=0 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a0dffb640 1 -- 172.21.15.39:0/1397454770 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8a1c0a3170 con 0x55e0bd701780 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a0dffb640 10 client.25091 handle_command_reply: tid=0 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 client.25091 shutdown 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 msgr2=0x55e0bd6f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a180116f0 tx=0x7f8a180046c0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 shutdown_connections 2024-09-12T01:57:46.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd701780 0x55e0bd703be0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a0dffb640 0 client.25091 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 --2- 172.21.15.39:0/1397454770 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f4220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 >> 172.21.15.39:0/1397454770 conn(0x55e0bd6a7310 msgr2=0x55e0bd6e7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 shutdown_connections 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 1 -- 172.21.15.39:0/1397454770 wait complete. 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.540+0000 7f8a2f239740 20 client.25091 trim_cache size 0 max 16384 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.567+0000 7f8a2f239740 1 Processor -- start 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.567+0000 7f8a2f239740 1 -- start start 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281adcb0 con 0x55e0bd6ed5d0 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281ab580 con 0x55e0bd6e8280 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2f239740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281a93f0 con 0x55e0bd6e8c00 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a26d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a26d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41392/0 (socket says 172.21.15.39:41392) 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a26d9d640 1 -- 172.21.15.39:0/2588156151 learned_addr learned my addr 172.21.15.39:0/2588156151 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 -- 172.21.15.39:0/2588156151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 msgr2=0x55e0bd6fdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6fdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 -- 172.21.15.39:0/2588156151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 msgr2=0x55e0bd6e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a2659c640 1 -- 172.21.15.39:0/2588156151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bd6dac20 con 0x55e0bd6e8280 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a26d9d640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:46.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.568+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.569+0000 7f8a2659c640 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f14a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a18000c00 tx=0x7f8a1800bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=999bc2d69bbcc042 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.569+0000 7f8a0ffff640 1 -- 172.21.15.39:0/2588156151 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18036040 con 0x55e0bd6e8280 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.569+0000 7f8a0ffff640 1 -- 172.21.15.39:0/2588156151 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1803f070 con 0x55e0bd6e8280 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.569+0000 7f8a0ffff640 1 -- 172.21.15.39:0/2588156151 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a180267c0 con 0x55e0bd6e8280 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 -- 172.21.15.39:0/2588156151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 msgr2=0x55e0bd6f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f14a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a18000c00 tx=0x7f8a1800bdd0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 -- 172.21.15.39:0/2588156151 shutdown_connections 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd6e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd6fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 --2- 172.21.15.39:0/2588156151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6e8280 0x55e0bd6f14a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 -- 172.21.15.39:0/2588156151 >> 172.21.15.39:0/2588156151 conn(0x55e0bd6a7310 msgr2=0x55e0bd6f0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 -- 172.21.15.39:0/2588156151 shutdown_connections 2024-09-12T01:57:46.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.570+0000 7f8a2f239740 1 -- 172.21.15.39:0/2588156151 wait complete. 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.571+0000 7f8a2f239740 1 -- start start 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.571+0000 7f8a2f239740 1 Processor -- start 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd7095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41398/0 (socket says 172.21.15.39:41398) 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 -- 172.21.15.39:0/119729795 learned_addr learned my addr 172.21.15.39:0/119729795 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd709af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281a9a40 con 0x55e0bd6e8280 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281aaeb0 con 0x55e0bd6ed5d0 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281aa110 con 0x55e0bd6e8c00 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2f239740 10 client.0 _ll_register_callbacks cb 0x7f8a1800bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:46.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd7095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a26d9d640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd709af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 -- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 msgr2=0x55e0bd7095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd7095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 -- 172.21.15.39:0/119729795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 msgr2=0x55e0bd709af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd709af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a2659c640 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bd76b470 con 0x55e0bd6e8280 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.572+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd7095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.573+0000 7f8a2659c640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a18027ca0 tx=0x7f8a180276a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5f982cf281c749 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.573+0000 7f8a0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.573+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18036040 con 0x55e0bd6e8280 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.573+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a18004020 con 0x55e0bd6e8280 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.573+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a1803f070 con 0x55e0bd6e8280 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a18004260 con 0x55e0bd6e8280 2024-09-12T01:57:46.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e0bd76c6f0 con 0x55e0bd6e8280 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a1803f070 con 0x55e0bd6e8280 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a18039070 con 0x55e0bd6e8280 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 10 client.15462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 20 client.15462 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd76ccf0 0x55e0bd76f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 4 client.15462 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.574+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0bd651860 con 0x55e0bd76ccf0 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.575+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd76ccf0 0x55e0bd76f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:46.347 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:57:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.575+0000 7f8a25d9b640 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd76ccf0 0x55e0bd76f0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9bb1a15ee729ea8 server_cookie=c9629761a9fa05be in_seq=0 out_seq=0 2024-09-12T01:57:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.575+0000 7f8a0dffb640 10 client.15462 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a0dffb640 1 -- 172.21.15.39:0/119729795 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0bd651860 con 0x55e0bd76ccf0 2024-09-12T01:57:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a0dffb640 10 client.15462 handle_command_reply: tid=0 2024-09-12T01:57:46.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 client.15462 shutdown 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 msgr2=0x55e0bd709070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a18027ca0 tx=0x7f8a180276a0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 shutdown_connections 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55e0bd76ccf0 0x55e0bd76f0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0bd6ed5d0 0x55e0bd709af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e0bd6e8c00 0x55e0bd7095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 --2- 172.21.15.39:0/119729795 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e0bd6e8280 0x55e0bd709070 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 >> 172.21.15.39:0/119729795 conn(0x55e0bd6a7310 msgr2=0x55e0bd6e7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a0dffb640 0 client.15462 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 shutdown_connections 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 1 -- 172.21.15.39:0/119729795 wait complete. 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.576+0000 7f8a2f239740 20 client.15462 trim_cache size 0 max 16384 2024-09-12T01:57:46.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 msgr2=0x7f8a100a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 0x7f8a100a5190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a180058c0 tx=0x7f8a18005850 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 msgr2=0x7f8a28198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00b4a0 tx=0x7f8a1c00b960 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 shutdown_connections 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a28106a60 0x7f8a2819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a28101400 0x7f8a28198a40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f8a100a2cd0 0x7f8a100a5190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 --2- 172.21.15.39:0/1259222167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a28100a60 0x7f8a28198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:46.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 >> 172.21.15.39:0/1259222167 conn(0x7f8a280fc780 msgr2=0x7f8a2806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 shutdown_connections 2024-09-12T01:57:46.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:45.577+0000 7f8a2ce60640 1 -- 172.21.15.39:0/1259222167 wait complete. 2024-09-12T01:57:47.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:46 smithi039 ceph-mon[31204]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T01:57:47.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:57:47.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:46 smithi172 ceph-mon[35073]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T01:57:47.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:46 smithi044 ceph-mon[35259]: pgmap v363: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T01:57:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:48.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 -- 172.21.15.39:0/765289553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec100e20 msgr2=0x7f7dec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 --2- 172.21.15.39:0/765289553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec100e20 0x7f7dec101200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009900 tx=0x7f7de002a480 comp rx=0 tx=0).stop 2024-09-12T01:57:48.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 -- 172.21.15.39:0/765289553 shutdown_connections 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 --2- 172.21.15.39:0/765289553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec102ef0 0x7f7dec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 --2- 172.21.15.39:0/765289553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 0x7f7dec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 --2- 172.21.15.39:0/765289553 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec100e20 0x7f7dec101200 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 -- 172.21.15.39:0/765289553 >> 172.21.15.39:0/765289553 conn(0x7f7dec0fc7d0 msgr2=0x7f7dec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 -- 172.21.15.39:0/765289553 shutdown_connections 2024-09-12T01:57:48.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.079+0000 7f7df2a89640 1 -- 172.21.15.39:0/765289553 wait complete. 2024-09-12T01:57:48.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.080+0000 7f7df2a89640 1 Processor -- start 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.080+0000 7f7df2a89640 1 -- start start 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.080+0000 7f7df2a89640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec100e20 0x7f7dec1132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df2a89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 0x7f7dec111730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df2a89640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df0825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec100e20 0x7f7dec1132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7debfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 0x7f7dec111730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41416/0 (socket says 172.21.15.39:41416) 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 -- 172.21.15.39:0/3197670477 learned_addr learned my addr 172.21.15.39:0/3197670477 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:48.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec110fd0 con 0x7f7dec102ef0 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec110e50 con 0x7f7dec100e20 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec111150 con 0x7f7dec102570 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 -- 172.21.15.39:0/3197670477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 msgr2=0x7f7dec111730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 0x7f7dec111730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 -- 172.21.15.39:0/3197670477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec100e20 msgr2=0x7f7dec1132a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec100e20 0x7f7dec1132a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.081+0000 7f7df1026640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec112570 con 0x7f7dec102ef0 2024-09-12T01:57:48.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7df1026640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7de400eb10 tx=0x7f7de400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7de9ffb640 1 -- 172.21.15.39:0/3197670477 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4004b20 con 0x7f7dec102ef0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7de9ffb640 1 -- 172.21.15.39:0/3197670477 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de4004cc0 con 0x7f7dec102ef0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dec1a6bf0 con 0x7f7dec102ef0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dec1a70e0 con 0x7f7dec102ef0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.082+0000 7f7de9ffb640 1 -- 172.21.15.39:0/3197670477 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4010760 con 0x7f7dec102ef0 2024-09-12T01:57:48.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.085+0000 7f7de9ffb640 1 -- 172.21.15.39:0/3197670477 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7de4005020 con 0x7f7dec102ef0 2024-09-12T01:57:48.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.085+0000 7f7df4e62740 1 Processor -- start 2024-09-12T01:57:48.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.085+0000 7f7df4e62740 1 -- start start 2024-09-12T01:57:48.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.085+0000 7f7de9ffb640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 0x7f7ddc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7de9ffb640 1 -- 172.21.15.39:0/3197670477 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7de40cf5c0 con 0x7f7dec102ef0 2024-09-12T01:57:48.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7debfff640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 0x7f7ddc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fd6461d2f0 con 0x55fd646b75d0 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fd645c4cf0 con 0x55fd646b8b40 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7debfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df4e62740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd646192b0 con 0x55fd646c2370 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7debfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41428/0 (socket says 172.21.15.39:41428) 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7debfff640 1 -- 172.21.15.39:0/1423619469 learned_addr learned my addr 172.21.15.39:0/1423619469 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df0825640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.086+0000 7f7df1026640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 -- 172.21.15.39:0/1423619469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 msgr2=0x55fd646c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 -- 172.21.15.39:0/1423619469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 msgr2=0x55fd646b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 -- 172.21.15.39:0/1423619469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd645a93a0 con 0x55fd646b75d0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7df1026640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 0x7f7ddc0a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80139d0 tx=0x7f7dd8009b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7debfff640 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800f790 tx=0x7f7dd801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e1aaa2038e9d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7dd6ffd640 1 -- 172.21.15.39:0/1423619469 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8013170 con 0x55fd646b75d0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7dd6ffd640 1 -- 172.21.15.39:0/1423619469 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd8005020 con 0x55fd646b75d0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.087+0000 7f7dd6ffd640 1 -- 172.21.15.39:0/1423619469 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8004a00 con 0x55fd646b75d0 2024-09-12T01:57:48.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 -- 172.21.15.39:0/1423619469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 msgr2=0x55fd646b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800f790 tx=0x7f7dd801d000 comp rx=0 tx=0).stop 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 -- 172.21.15.39:0/1423619469 shutdown_connections 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b75d0 0x55fd646b7a10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 --2- 172.21.15.39:0/1423619469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 -- 172.21.15.39:0/1423619469 >> 172.21.15.39:0/1423619469 conn(0x55fd64680310 msgr2=0x55fd646b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.088+0000 7f7df4e62740 1 -- 172.21.15.39:0/1423619469 shutdown_connections 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.089+0000 7f7df4e62740 1 -- 172.21.15.39:0/1423619469 wait complete. 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.089+0000 7f7df4e62740 1 -- start start 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.089+0000 7f7df4e62740 1 Processor -- start 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd646bf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 0x55fd646bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fd646c4fb0 con 0x55fd646b8b40 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fd645d8060 con 0x55fd646c2370 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd646c5130 con 0x55fd646b75d0 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df4e62740 10 client.0 _ll_register_callbacks cb 0x55fd6432b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7debfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd646bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df0825640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df0825640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33644/0 (socket says 172.21.15.39:33644) 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.090+0000 7f7df0825640 1 -- 172.21.15.39:0/2101082126 learned_addr learned my addr 172.21.15.39:0/2101082126 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7df1026640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 0x55fd646bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 -- 172.21.15.39:0/2101082126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 msgr2=0x55fd646c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 -- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 msgr2=0x55fd646bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 0x55fd646bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 -- 172.21.15.39:0/2101082126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6438e3c0 con 0x55fd646b8b40 2024-09-12T01:57:48.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7df1026640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 0x55fd646bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7debfff640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd646bf030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8023040 tx=0x7f7dd8005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61896a7b8364c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7dcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80055f0 con 0x55fd646b8b40 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd8005020 con 0x55fd646b8b40 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.091+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7dd801b040 con 0x55fd646b8b40 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7dd800e990 con 0x55fd646b8b40 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 10 client.15474 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd646d0a70 con 0x55fd646b8b40 2024-09-12T01:57:48.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd8005020 con 0x55fd646b8b40 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7dd8020050 con 0x55fd646b8b40 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 10 client.15474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 20 client.15474 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd646d2240 0x55fd646d4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 4 client.15474 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.092+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd6462a860 con 0x55fd646d2240 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.093+0000 7f7df0825640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd646d2240 0x55fd646d4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.093+0000 7f7df0825640 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd646d2240 0x55fd646d4650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3648df9efb7fbbf1 server_cookie=5a04b74bef2a42e7 in_seq=0 out_seq=0 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.093+0000 7f7dcbfff640 10 client.15474 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7dcbfff640 1 -- 172.21.15.39:0/2101082126 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd6462a860 con 0x55fd646d2240 2024-09-12T01:57:48.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7dcbfff640 10 client.15474 handle_command_reply: tid=0 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 client.15474 shutdown 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 msgr2=0x55fd646bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd646bf030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8023040 tx=0x7f7dd8005400 comp rx=0 tx=0).stop 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 shutdown_connections 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd646d2240 0x55fd646d4650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646c2370 0x55fd646bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd646bf030 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 --2- 172.21.15.39:0/2101082126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7dcbfff640 0 client.15474 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.094+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 >> 172.21.15.39:0/2101082126 conn(0x55fd64680310 msgr2=0x55fd646b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.095+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 shutdown_connections 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.095+0000 7f7df4e62740 1 -- 172.21.15.39:0/2101082126 wait complete. 2024-09-12T01:57:48.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.095+0000 7f7df4e62740 20 client.15474 trim_cache size 0 max 16384 2024-09-12T01:57:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 Processor -- start 2024-09-12T01:57:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 -- start start 2024-09-12T01:57:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646bf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1b1fd0 con 0x55fd646c2370 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1af8a0 con 0x55fd646b8b40 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df4e62740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1ad6f0 con 0x55fd646b75d0 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df1026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df1026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41444/0 (socket says 172.21.15.39:41444) 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df1026640 1 -- 172.21.15.39:0/530010858 learned_addr learned my addr 172.21.15.39:0/530010858 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7df0825640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.108+0000 7f7debfff640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 -- 172.21.15.39:0/530010858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 msgr2=0x55fd646b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 -- 172.21.15.39:0/530010858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 msgr2=0x55fd646bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646bf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 -- 172.21.15.39:0/530010858 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd646d4cd0 con 0x55fd646c2370 2024-09-12T01:57:48.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df0825640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7df1026640 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7de40cd0d0 tx=0x7f7de40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba415dfd4a146f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7dd67fc640 1 -- 172.21.15.39:0/530010858 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de409c530 con 0x55fd646c2370 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7dd67fc640 1 -- 172.21.15.39:0/530010858 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de40b9030 con 0x55fd646c2370 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.109+0000 7f7dd67fc640 1 -- 172.21.15.39:0/530010858 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de40a4870 con 0x55fd646c2370 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 -- 172.21.15.39:0/530010858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 msgr2=0x55fd646ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7de40cd0d0 tx=0x7f7de40058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 -- 172.21.15.39:0/530010858 shutdown_connections 2024-09-12T01:57:48.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646c2370 0x55fd646ce2d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b8b40 0x55fd646bf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 --2- 172.21.15.39:0/530010858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646b75d0 0x55fd646b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 -- 172.21.15.39:0/530010858 >> 172.21.15.39:0/530010858 conn(0x55fd64680310 msgr2=0x55fd646be8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 -- 172.21.15.39:0/530010858 shutdown_connections 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.110+0000 7f7df4e62740 1 -- 172.21.15.39:0/530010858 wait complete. 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 -- start start 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 Processor -- start 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 0x55fd6473da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1add60 con 0x55fd646b8b40 2024-09-12T01:57:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1af1d0 con 0x55fd646b75d0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1ae430 con 0x55fd646c2370 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7df4e62740 10 client.0 _ll_register_callbacks cb 0x7f7dd8009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.111+0000 7f7debfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7debfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41446/0 (socket says 172.21.15.39:41446) 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7debfff640 1 -- 172.21.15.39:0/3323191213 learned_addr learned my addr 172.21.15.39:0/3323191213 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 0x55fd6473da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df1026640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 -- 172.21.15.39:0/3323191213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 msgr2=0x55fd646c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 -- 172.21.15.39:0/3323191213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 msgr2=0x55fd6473df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 -- 172.21.15.39:0/3323191213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd646ba120 con 0x55fd646b75d0 2024-09-12T01:57:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7debfff640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df0825640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 0x55fd6473da30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55fd646d4f00 tx=0x7f7de0004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe0ff7d99ca266f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7dcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0035040 con 0x55fd646b75d0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7de0005450 con 0x55fd646b75d0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.112+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7de40b9030 con 0x55fd646b75d0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.113+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7de0005650 con 0x55fd646b75d0 2024-09-12T01:57:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.113+0000 7f7df4e62740 10 client.25115 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.113+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd64745130 con 0x55fd646b75d0 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.113+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de40b9030 con 0x55fd646b75d0 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7de0003940 con 0x55fd646b75d0 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 10 client.25115 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 10 client.25115 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 20 client.25115 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd64745850 0x55fd64747c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 4 client.25115 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd64624d70 con 0x55fd64745850 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.114+0000 7f7debfff640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd64745850 0x55fd64747c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7debfff640 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd64745850 0x55fd64747c40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1cad251ce40af073 server_cookie=d3514fd3b15db6e2 in_seq=0 out_seq=0 2024-09-12T01:57:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7dcbfff640 10 client.25115 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:48.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7dcbfff640 1 -- 172.21.15.39:0/3323191213 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd64624d70 con 0x55fd64745850 2024-09-12T01:57:48.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7dcbfff640 10 client.25115 handle_command_reply: tid=0 2024-09-12T01:57:48.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 client.25115 shutdown 2024-09-12T01:57:48.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 msgr2=0x55fd6473da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 0x55fd6473da30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55fd646d4f00 tx=0x7f7de0004400 comp rx=0 tx=0).stop 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 shutdown_connections 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55fd64745850 0x55fd64747c40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd646c2370 0x55fd646c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fd646b8b40 0x55fd6473df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 --2- 172.21.15.39:0/3323191213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd646b75d0 0x55fd6473da30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 >> 172.21.15.39:0/3323191213 conn(0x55fd64680310 msgr2=0x55fd646b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.115+0000 7f7dcbfff640 0 client.25115 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 shutdown_connections 2024-09-12T01:57:48.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df4e62740 1 -- 172.21.15.39:0/3323191213 wait complete. 2024-09-12T01:57:48.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df4e62740 20 client.25115 trim_cache size 0 max 16384 2024-09-12T01:57:48.121 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 msgr2=0x7f7ddc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 0x7f7ddc0a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80139d0 tx=0x7f7dd8009b60 comp rx=0 tx=0).stop 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 msgr2=0x7f7dec111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.116+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7de400eb10 tx=0x7f7de400c2d0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 shutdown_connections 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7dec102ef0 0x7f7dec111cb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7ddc0a2b80 0x7f7ddc0a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dec102570 0x7f7dec111730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 --2- 172.21.15.39:0/3197670477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dec100e20 0x7f7dec1132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:48.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 >> 172.21.15.39:0/3197670477 conn(0x7f7dec0fc7d0 msgr2=0x7f7dec0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:48.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 shutdown_connections 2024-09-12T01:57:48.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:48.117+0000 7f7df2a89640 1 -- 172.21.15.39:0/3197670477 wait complete. 2024-09-12T01:57:48.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:57:49.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:48 smithi039 ceph-mon[31204]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:49.251 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:49.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:48 smithi172 ceph-mon[35073]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:49.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:48 smithi044 ceph-mon[35259]: pgmap v364: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 -- 172.21.15.39:0/306760534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 msgr2=0x7efdc8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/306760534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8103110 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009930 tx=0x7efdb802a420 comp rx=0 tx=0).stop 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 -- 172.21.15.39:0/306760534 shutdown_connections 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/306760534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/306760534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc81036e0 0x7efdc8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/306760534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8103110 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 -- 172.21.15.39:0/306760534 >> 172.21.15.39:0/306760534 conn(0x7efdc80fc7d0 msgr2=0x7efdc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 -- 172.21.15.39:0/306760534 shutdown_connections 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.790+0000 7efdcc9ec640 1 -- 172.21.15.39:0/306760534 wait complete. 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.791+0000 7efdcc9ec640 1 Processor -- start 2024-09-12T01:57:49.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.791+0000 7efdcc9ec640 1 -- start start 2024-09-12T01:57:49.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc81036e0 0x7efdc8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81120a0 con 0x7efdc8102d30 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdc659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdc659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41452/0 (socket says 172.21.15.39:41452) 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8111f20 con 0x7efdc81082a0 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdcc9ec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdc8112220 con 0x7efdc81036e0 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdc659c640 1 -- 172.21.15.39:0/106640569 learned_addr learned my addr 172.21.15.39:0/106640569 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.792+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 -- 172.21.15.39:0/106640569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc81036e0 msgr2=0x7efdc8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc81036e0 0x7efdc8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 -- 172.21.15.39:0/106640569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 msgr2=0x7efdc819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 -- 172.21.15.39:0/106640569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc819d500 con 0x7efdc8102d30 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdc659c640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009a50 tx=0x7efdb8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdbf7fe640 1 -- 172.21.15.39:0/106640569 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8035070 con 0x7efdc8102d30 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdbf7fe640 1 -- 172.21.15.39:0/106640569 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb803de40 con 0x7efdc8102d30 2024-09-12T01:57:49.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc819d790 con 0x7efdc8102d30 2024-09-12T01:57:49.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdbf7fe640 1 -- 172.21.15.39:0/106640569 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb80453d0 con 0x7efdc8102d30 2024-09-12T01:57:49.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.793+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc81008c0 con 0x7efdc8102d30 2024-09-12T01:57:49.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 Processor -- start 2024-09-12T01:57:49.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 -- start start 2024-09-12T01:57:49.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc05a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ddddb6b2f0 con 0x55ddddc10370 2024-09-12T01:57:49.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddddb12cf0 con 0x55ddddc055d0 2024-09-12T01:57:49.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.797+0000 7efdcedc5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ddddb672b0 con 0x55ddddc06b40 2024-09-12T01:57:49.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdbffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdbffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41462/0 (socket says 172.21.15.39:41462) 2024-09-12T01:57:49.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33674/0 (socket says 172.21.15.39:33674) 2024-09-12T01:57:49.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdbffff640 1 -- 172.21.15.39:0/1036655595 learned_addr learned my addr 172.21.15.39:0/1036655595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:49.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 -- 172.21.15.39:0/1036655595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 msgr2=0x55ddddc05a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc05a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 -- 172.21.15.39:0/1036655595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 msgr2=0x55ddddc12760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdbf7fe640 1 -- 172.21.15.39:0/106640569 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efdb8045570 con 0x7efdc8102d30 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 -- 172.21.15.39:0/1036655595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddddaf73a0 con 0x55ddddc06b40 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdbffff640 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.798+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007db0 tx=0x7efdc000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1a17859997e168 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.799+0000 7efdbcff9640 1 -- 172.21.15.39:0/1036655595 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0017bd0 con 0x55ddddc06b40 2024-09-12T01:57:49.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.799+0000 7efdbcff9640 1 -- 172.21.15.39:0/1036655595 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc0017d70 con 0x55ddddc06b40 2024-09-12T01:57:49.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.799+0000 7efdbcff9640 1 -- 172.21.15.39:0/1036655595 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00059d0 con 0x55ddddc06b40 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.799+0000 7efdbf7fe640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 0x7efdb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdbf7fe640 1 -- 172.21.15.39:0/106640569 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdb80bf640 con 0x7efdc8102d30 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 -- 172.21.15.39:0/1036655595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 msgr2=0x55ddddc05090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdc0007db0 tx=0x7efdc000e720 comp rx=0 tx=0).stop 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdc659c640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 0x7efdb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 -- 172.21.15.39:0/1036655595 shutdown_connections 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc05a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 --2- 172.21.15.39:0/1036655595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc05090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 -- 172.21.15.39:0/1036655595 >> 172.21.15.39:0/1036655595 conn(0x55ddddbce310 msgr2=0x55ddddc01c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 -- 172.21.15.39:0/1036655595 shutdown_connections 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdcedc5740 1 -- 172.21.15.39:0/1036655595 wait complete. 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.800+0000 7efdc659c640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 0x7efdb40a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efdb80c9ce0 tx=0x7efdb8009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 -- start start 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 Processor -- start 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc0fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc0d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ddddc13070 con 0x55ddddc10370 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddddb26060 con 0x55ddddc055d0 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ddddc131f0 con 0x55ddddc06b40 2024-09-12T01:57:49.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdcedc5740 10 client.0 _ll_register_callbacks cb 0x55dddd8798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdbffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.801+0000 7efdbffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33684/0 (socket says 172.21.15.39:33684) 2024-09-12T01:57:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 -- 172.21.15.39:0/2811497749 learned_addr learned my addr 172.21.15.39:0/2811497749 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:49.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc0d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc0fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 -- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 msgr2=0x55ddddc0fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc0fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 -- 172.21.15.39:0/2811497749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 msgr2=0x55ddddc0d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc0d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 -- 172.21.15.39:0/2811497749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddd8dc3c0 con 0x55ddddc06b40 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc0fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdbffff640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdb000f670 tx=0x7efdb000fb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb6c091915f21c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.802+0000 7efdadffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb001d060 con 0x55ddddc06b40 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc0017d70 con 0x55ddddc06b40 2024-09-12T01:57:49.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdb000db20 con 0x55ddddc06b40 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdb000dd20 con 0x55ddddc06b40 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdcedc5740 10 client.25030 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddddc1ebc0 con 0x55ddddc06b40 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.803+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc0017d70 con 0x55ddddc06b40 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdb0003c60 con 0x55ddddc06b40 2024-09-12T01:57:49.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 10 client.25030 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 10 client.25030 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 20 client.25030 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc20020 0x55ddddc22440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 4 client.25030 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:49.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.804+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddddb78860 con 0x55ddddc20020 2024-09-12T01:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.805+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc20020 0x55ddddc22440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.805+0000 7efdadffb640 10 client.25030 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.805+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc20020 0x55ddddc22440 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b2b696c71b7336 server_cookie=ff1a09d210916628 in_seq=0 out_seq=0 2024-09-12T01:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdadffb640 1 -- 172.21.15.39:0/2811497749 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddddb78860 con 0x55ddddc20020 2024-09-12T01:57:49.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdadffb640 10 client.25030 handle_command_reply: tid=0 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 client.25030 shutdown 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 msgr2=0x55ddddc0d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efdb000f670 tx=0x7efdb000fb30 comp rx=0 tx=0).stop 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 shutdown_connections 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc20020 0x55ddddc22440 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc0d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc06b40 0x55ddddc0d010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 --2- 172.21.15.39:0/2811497749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc055d0 0x55ddddc0fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 >> 172.21.15.39:0/2811497749 conn(0x55ddddbce310 msgr2=0x55ddddc07960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdadffb640 0 client.25030 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:49.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.806+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 shutdown_connections 2024-09-12T01:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.807+0000 7efdcedc5740 1 -- 172.21.15.39:0/2811497749 wait complete. 2024-09-12T01:57:49.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.807+0000 7efdcedc5740 20 client.25030 trim_cache size 0 max 16384 2024-09-12T01:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.821+0000 7efdcedc5740 1 Processor -- start 2024-09-12T01:57:49.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.821+0000 7efdcedc5740 1 -- start start 2024-09-12T01:57:49.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc01e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc1c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81adb70 con 0x55ddddc10370 2024-09-12T01:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81ab440 con 0x55ddddc06b40 2024-09-12T01:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdcedc5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81a9290 con 0x55ddddc055d0 2024-09-12T01:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41476/0 (socket says 172.21.15.39:41476) 2024-09-12T01:57:49.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 -- 172.21.15.39:0/846259965 learned_addr learned my addr 172.21.15.39:0/846259965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdbffff640 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc1c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc01e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 -- 172.21.15.39:0/846259965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 msgr2=0x55ddddc01e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc01e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 -- 172.21.15.39:0/846259965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 msgr2=0x55ddddc1c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc1c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.822+0000 7efdc6d9d640 1 -- 172.21.15.39:0/846259965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddddc0f980 con 0x55ddddc10370 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.823+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efdc0005540 tx=0x7efdc00076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5b2698171bfffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.823+0000 7efdaffff640 1 -- 172.21.15.39:0/846259965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00051a0 con 0x55ddddc10370 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.823+0000 7efdaffff640 1 -- 172.21.15.39:0/846259965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc0003e50 con 0x55ddddc10370 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.823+0000 7efdaffff640 1 -- 172.21.15.39:0/846259965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc002f710 con 0x55ddddc10370 2024-09-12T01:57:49.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- 172.21.15.39:0/846259965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 msgr2=0x55ddddc27cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efdc0005540 tx=0x7efdc00076a0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- 172.21.15.39:0/846259965 shutdown_connections 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc27cd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc1c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 --2- 172.21.15.39:0/846259965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc01e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- 172.21.15.39:0/846259965 >> 172.21.15.39:0/846259965 conn(0x55ddddbce310 msgr2=0x55ddddc01700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- 172.21.15.39:0/846259965 shutdown_connections 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- 172.21.15.39:0/846259965 wait complete. 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.824+0000 7efdcedc5740 1 -- start start 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 Processor -- start 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc14630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81a9900 con 0x55ddddc10370 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81aad70 con 0x55ddddc06b40 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdc81a9fd0 con 0x55ddddc055d0 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdcedc5740 10 client.0 _ll_register_callbacks cb 0x7efdb000a5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:49.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdc6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41482/0 (socket says 172.21.15.39:41482) 2024-09-12T01:57:49.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdc6d9d640 1 -- 172.21.15.39:0/4254059049 learned_addr learned my addr 172.21.15.39:0/4254059049 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:49.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.825+0000 7efdbffff640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc14630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 -- 172.21.15.39:0/4254059049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 msgr2=0x55ddddc140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 -- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 msgr2=0x55ddddc14630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc14630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 -- 172.21.15.39:0/4254059049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddddc89ca0 con 0x55ddddc10370 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdbffff640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc14630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdc6d9d640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55ddddbb0610 tx=0x7efdc002f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aef10129e55c25e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdadffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:49.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0005300 con 0x55ddddc10370 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdc00056f0 con 0x55ddddc10370 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.826+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc0003e50 con 0x55ddddc10370 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdc00058f0 con 0x55ddddc10370 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddddc8aea0 con 0x55ddddc10370 2024-09-12T01:57:49.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc002f490 con 0x55ddddc10370 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdc0037040 con 0x55ddddc10370 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 20 client.15498 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc8b370 0x55ddddc8d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 4 client.15498 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:57:49.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.827+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7efdc0003e50 con 0x55ddddc8b370 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdbffff640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc8b370 0x55ddddc8d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdadffb640 10 client.15498 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdbffff640 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc8b370 0x55ddddc8d760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c44cc9be09e85f server_cookie=c5d90f2ac3847d37 in_seq=0 out_seq=0 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdadffb640 1 -- 172.21.15.39:0/4254059049 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7efdc0003e50 con 0x55ddddc8b370 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdadffb640 10 client.15498 handle_command_reply: tid=0 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.828+0000 7efdcedc5740 1 client.15498 shutdown 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 msgr2=0x55ddddc14b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55ddddbb0610 tx=0x7efdc002f3b0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 shutdown_connections 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ddddc8b370 0x55ddddc8d760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ddddc10370 0x55ddddc14b70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddddc06b40 0x55ddddc14630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 --2- 172.21.15.39:0/4254059049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddddc055d0 0x55ddddc140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 >> 172.21.15.39:0/4254059049 conn(0x55ddddbce310 msgr2=0x55ddddc0f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdadffb640 0 client.15498 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 shutdown_connections 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 1 -- 172.21.15.39:0/4254059049 wait complete. 2024-09-12T01:57:49.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.829+0000 7efdcedc5740 20 client.15498 trim_cache size 0 max 16384 2024-09-12T01:57:49.847 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:57:49.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 msgr2=0x7efdb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 0x7efdb40a5040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efdb80c9ce0 tx=0x7efdb8009230 comp rx=0 tx=0).stop 2024-09-12T01:57:49.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 msgr2=0x7efdc8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009a50 tx=0x7efdb8004270 comp rx=0 tx=0).stop 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 shutdown_connections 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc81082a0 0x7efdc819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7efdb40a2b80 0x7efdb40a5040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc81036e0 0x7efdc8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 --2- 172.21.15.39:0/106640569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efdc8102d30 0x7efdc8198550 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 >> 172.21.15.39:0/106640569 conn(0x7efdc80fc7d0 msgr2=0x7efdc8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 shutdown_connections 2024-09-12T01:57:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:49.830+0000 7efdcc9ec640 1 -- 172.21.15.39:0/106640569 wait complete. 2024-09-12T01:57:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:50 smithi172 ceph-mon[35073]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:51.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:50 smithi039 ceph-mon[31204]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:51.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:50 smithi044 ceph-mon[35259]: pgmap v365: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T01:57:51.549 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:57:51.550 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:57:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 -- 172.21.15.39:0/2184315379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd398102d30 msgr2=0x7fd398103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2184315379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd398102d30 0x7fd398103110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd388009930 tx=0x7fd38802a420 comp rx=0 tx=0).stop 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 -- 172.21.15.39:0/2184315379 shutdown_connections 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2184315379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981082a0 0x7fd39810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2184315379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3981036e0 0x7fd398107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2184315379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd398102d30 0x7fd398103110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.430+0000 7fd39dde1640 1 -- 172.21.15.39:0/2184315379 >> 172.21.15.39:0/2184315379 conn(0x7fd3980fc7d0 msgr2=0x7fd3980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.431+0000 7fd39dde1640 1 -- 172.21.15.39:0/2184315379 shutdown_connections 2024-09-12T01:57:52.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.431+0000 7fd39dde1640 1 -- 172.21.15.39:0/2184315379 wait complete. 2024-09-12T01:57:52.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.431+0000 7fd39dde1640 1 Processor -- start 2024-09-12T01:57:52.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 -- start start 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 0x7fd398100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981036e0 0x7fd398100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981120f0 con 0x7fd3981082a0 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd398111f70 con 0x7fd398102d30 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd39dde1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd398112270 con 0x7fd3981036e0 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35368/0 (socket says 172.21.15.39:35368) 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd397fff640 1 -- 172.21.15.39:0/2509995848 learned_addr learned my addr 172.21.15.39:0/2509995848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd396ffd640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981036e0 0x7fd398100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.432+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 0x7fd398100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 -- 172.21.15.39:0/2509995848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981036e0 msgr2=0x7fd398100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981036e0 0x7fd398100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 -- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 msgr2=0x7fd398101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 -- 172.21.15.39:0/2509995848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3981a6a50 con 0x7fd398102d30 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd397fff640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 0x7fd398100990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38802a940 tx=0x7fd388003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd394ff9640 1 -- 172.21.15.39:0/2509995848 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38803f070 con 0x7fd398102d30 2024-09-12T01:57:52.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3981a6ce0 con 0x7fd398102d30 2024-09-12T01:57:52.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd394ff9640 1 -- 172.21.15.39:0/2509995848 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd388031c90 con 0x7fd398102d30 2024-09-12T01:57:52.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.433+0000 7fd394ff9640 1 -- 172.21.15.39:0/2509995848 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388035030 con 0x7fd398102d30 2024-09-12T01:57:52.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.434+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3981a71c0 con 0x7fd398102d30 2024-09-12T01:57:52.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.437+0000 7fd394ff9640 1 -- 172.21.15.39:0/2509995848 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd388042070 con 0x7fd398102d30 2024-09-12T01:57:52.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.437+0000 7fd3a01ba740 1 Processor -- start 2024-09-12T01:57:52.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.437+0000 7fd3a01ba740 1 -- start start 2024-09-12T01:57:52.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c28dfe4280 con 0x55c28e07eb60 2024-09-12T01:57:52.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c28df8bb10 con 0x55c28e07f480 2024-09-12T01:57:52.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c28dfe0240 con 0x55c28e089d40 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd394ff9640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 0x7fd3800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3977fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42996/0 (socket says 172.21.15.39:42996) 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35374/0 (socket says 172.21.15.39:35374) 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd3977fe640 1 -- 172.21.15.39:0/2849041181 learned_addr learned my addr 172.21.15.39:0/2849041181 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:52.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.438+0000 7fd396ffd640 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 -- 172.21.15.39:0/2849041181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 msgr2=0x55c28e08c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 -- 172.21.15.39:0/2849041181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 msgr2=0x55c28e07ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 -- 172.21.15.39:0/2849041181 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28df981f0 con 0x55c28e07f480 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd397fff640 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd394ff9640 1 -- 172.21.15.39:0/2509995848 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3880ef710 con 0x7fd398102d30 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd397fff640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 0x7fd3800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd3880bbf60 tx=0x7fd38807c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb037274329434bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd37dffb640 1 -- 172.21.15.39:0/2849041181 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388049070 con 0x55c28e07f480 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd37dffb640 1 -- 172.21.15.39:0/2849041181 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd388039350 con 0x55c28e07f480 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.439+0000 7fd37dffb640 1 -- 172.21.15.39:0/2849041181 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3880bbfd0 con 0x55c28e07f480 2024-09-12T01:57:52.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.440+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2849041181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 msgr2=0x55c28e089800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.440+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd3880bbf60 tx=0x7fd38807c0f0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.440+0000 7fd397fff640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 0x7fd3800a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd390009fd0 tx=0x7fd39000f790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2849041181 shutdown_connections 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e089800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2849041181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e07ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2849041181 >> 172.21.15.39:0/2849041181 conn(0x55c28e07b0f0 msgr2=0x55c28e07b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2849041181 shutdown_connections 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2849041181 wait complete. 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 -- start start 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.441+0000 7fd3a01ba740 1 Processor -- start 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e07eb60 0x55c28e0897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e086b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c28e08c6d0 con 0x55c28e089d40 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c28df9ef10 con 0x55c28e07f480 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c28e08c850 con 0x55c28e07eb60 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd3a01ba740 10 client.0 _ll_register_callbacks cb 0x55c28df67a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd397fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35390/0 (socket says 172.21.15.39:35390) 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd397fff640 1 -- 172.21.15.39:0/2110527707 learned_addr learned my addr 172.21.15.39:0/2110527707 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.442+0000 7fd396ffd640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e086b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 -- 172.21.15.39:0/2110527707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e07eb60 msgr2=0x55c28e0897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e07eb60 0x55c28e0897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 -- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 msgr2=0x55c28e086b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e086b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 -- 172.21.15.39:0/2110527707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28dd556a0 con 0x55c28e089d40 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd397fff640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd390005cb0 tx=0x7fd390009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1d4ec7e9ca83ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:52.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39000dbe0 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd39000dd80 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.443+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd388039350 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd390005000 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c28e098110 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd390023040 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd39000f040 con 0x55c28e089d40 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 20 client.15510 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e099520 0x55c28e09b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 4 client.15510 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.444+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd388039350 con 0x55c28e099520 2024-09-12T01:57:52.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.445+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e099520 0x55c28e09b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.445+0000 7fd376ffd640 10 client.15510 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.445+0000 7fd3977fe640 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e099520 0x55c28e09b980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd43fd1bc02ff18c server_cookie=cba4fc20cab8e445 in_seq=0 out_seq=0 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd376ffd640 1 -- 172.21.15.39:0/2110527707 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd388039350 con 0x55c28e099520 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd376ffd640 10 client.15510 handle_command_reply: tid=0 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 client.15510 shutdown 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 msgr2=0x55c28e0872b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd390005cb0 tx=0x7fd390009f20 comp rx=0 tx=0).stop 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 shutdown_connections 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e099520 0x55c28e09b980 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e089d40 0x55c28e0872b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e086b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/2110527707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e07eb60 0x55c28e0897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd376ffd640 0 client.15510 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:52.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.446+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 >> 172.21.15.39:0/2110527707 conn(0x55c28e07b0f0 msgr2=0x55c28e080e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.447+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 shutdown_connections 2024-09-12T01:57:52.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.447+0000 7fd3a01ba740 1 -- 172.21.15.39:0/2110527707 wait complete. 2024-09-12T01:57:52.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.447+0000 7fd3a01ba740 20 client.15510 trim_cache size 0 max 16384 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.481+0000 7fd3a01ba740 1 Processor -- start 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.481+0000 7fd3a01ba740 1 -- start start 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.481+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07eb60 0x55c28e07b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e0a1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981addf0 con 0x55c28e07f480 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981ab6c0 con 0x55c28e07eb60 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd3a01ba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981a9550 con 0x55c28e089d40 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35402/0 (socket says 172.21.15.39:35402) 2024-09-12T01:57:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 -- 172.21.15.39:0/3206679423 learned_addr learned my addr 172.21.15.39:0/3206679423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd397fff640 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e0a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 -- 172.21.15.39:0/3206679423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 msgr2=0x55c28e0a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e0a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 -- 172.21.15.39:0/3206679423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07eb60 msgr2=0x55c28e07b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07eb60 0x55c28e07b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd396ffd640 1 -- 172.21.15.39:0/3206679423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28e07f2b0 con 0x55c28e07f480 2024-09-12T01:57:52.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.482+0000 7fd397fff640 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e0a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:52.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.483+0000 7fd396ffd640 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd39806a370 tx=0x7fd38c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f159de1b40a61027 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.483+0000 7fd37d7fa640 1 -- 172.21.15.39:0/3206679423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c003c20 con 0x55c28e07f480 2024-09-12T01:57:52.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.483+0000 7fd37d7fa640 1 -- 172.21.15.39:0/3206679423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd38c003dc0 con 0x55c28e07f480 2024-09-12T01:57:52.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.483+0000 7fd37d7fa640 1 -- 172.21.15.39:0/3206679423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011440 con 0x55c28e07f480 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 -- 172.21.15.39:0/3206679423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 msgr2=0x55c28e0a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd39806a370 tx=0x7fd38c00bcb0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 -- 172.21.15.39:0/3206679423 shutdown_connections 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e0a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07f480 0x55c28e0a1250 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/3206679423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07eb60 0x55c28e07b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 -- 172.21.15.39:0/3206679423 >> 172.21.15.39:0/3206679423 conn(0x55c28e07b0f0 msgr2=0x55c28e085c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 -- 172.21.15.39:0/3206679423 shutdown_connections 2024-09-12T01:57:52.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.484+0000 7fd3a01ba740 1 -- 172.21.15.39:0/3206679423 wait complete. 2024-09-12T01:57:52.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.485+0000 7fd3a01ba740 1 -- start start 2024-09-12T01:57:52.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.485+0000 7fd3a01ba740 1 Processor -- start 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35414/0 (socket says 172.21.15.39:35414) 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3977fe640 1 -- 172.21.15.39:0/554090317 learned_addr learned my addr 172.21.15.39:0/554090317 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e092120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981a9ba0 con 0x55c28e07eb60 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981aaff0 con 0x55c28e07f480 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3981aa250 con 0x55c28e089d40 2024-09-12T01:57:52.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.486+0000 7fd396ffd640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e092120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd397fff640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 -- 172.21.15.39:0/554090317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 msgr2=0x55c28e08c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 -- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 msgr2=0x55c28e092120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e092120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28e08d1e0 con 0x55c28e07eb60 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3977fe640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b8430 tx=0x7fd388031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c815eab38d73101d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3a01ba740 10 client.0 _ll_register_callbacks cb 0x7fd390004ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.487+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd38c003dc0 con 0x55c28e07eb60 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd376ffd640 1 -- 172.21.15.39:0/554090317 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388049040 con 0x55c28e07eb60 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd376ffd640 1 -- 172.21.15.39:0/554090317 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3880ba2d0 con 0x55c28e07eb60 2024-09-12T01:57:52.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd376ffd640 1 -- 172.21.15.39:0/554090317 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd3880b8270 con 0x55c28e07eb60 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd3a01ba740 10 client.15516 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c28e104b00 con 0x55c28e07eb60 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.488+0000 7fd376ffd640 1 -- 172.21.15.39:0/554090317 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd3880bf030 con 0x55c28e07eb60 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 10 client.15516 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 20 client.15516 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e104e10 0x55c28e1072d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 4 client.15516 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c28dff17f0 con 0x55c28e104e10 2024-09-12T01:57:52.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd396ffd640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e104e10 0x55c28e1072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd396ffd640 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e104e10 0x55c28e1072d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afc39195e21f1cc server_cookie=60f163c30bd54b0d in_seq=0 out_seq=0 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.489+0000 7fd376ffd640 10 client.15516 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.490+0000 7fd376ffd640 1 -- 172.21.15.39:0/554090317 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c28dff17f0 con 0x55c28e104e10 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.490+0000 7fd376ffd640 10 client.15516 handle_command_reply: tid=0 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.490+0000 7fd3a01ba740 1 client.15516 shutdown 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 msgr2=0x55c28e091be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b8430 tx=0x7fd388031490 comp rx=0 tx=0).stop 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 shutdown_connections 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c28e104e10 0x55c28e1072d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c28e089d40 0x55c28e08c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c28e07f480 0x55c28e092120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 --2- 172.21.15.39:0/554090317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c28e07eb60 0x55c28e091be0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 >> 172.21.15.39:0/554090317 conn(0x55c28e07b0f0 msgr2=0x55c28e079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd376ffd640 0 client.15516 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 shutdown_connections 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.491+0000 7fd3a01ba740 1 -- 172.21.15.39:0/554090317 wait complete. 2024-09-12T01:57:52.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.492+0000 7fd3a01ba740 20 client.15516 trim_cache size 0 max 16384 2024-09-12T01:57:52.494 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:52.494 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-12T01:57:52.494 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "2862adf3-59f3-4c96-ba6a-fbc08d9c2785", 2024-09-12T01:57:52.494 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-12T01:57:52.494 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:52.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 msgr2=0x7fd3800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 0x7fd3800a50c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd390009fd0 tx=0x7fd39000f790 comp rx=0 tx=0).stop 2024-09-12T01:57:52.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 msgr2=0x7fd398100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:52.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 0x7fd398100990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38802a940 tx=0x7fd388003b90 comp rx=0 tx=0).stop 2024-09-12T01:57:52.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 shutdown_connections 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd3981082a0 0x7fd398101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd3800a2c00 0x7fd3800a50c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3981036e0 0x7fd398100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 --2- 172.21.15.39:0/2509995848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd398102d30 0x7fd398100990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 >> 172.21.15.39:0/2509995848 conn(0x7fd3980fc7d0 msgr2=0x7fd398105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 shutdown_connections 2024-09-12T01:57:52.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:52.493+0000 7fd39dde1640 1 -- 172.21.15.39:0/2509995848 wait complete. 2024-09-12T01:57:53.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T01:57:53.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: scrub queued for path: / 2024-09-12T01:57:53.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.201 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:57:53.201 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.201 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:52 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:57:53.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: scrub queued for path: / 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:52 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:57:53.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: pgmap v366: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-12T01:57:53.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: scrub queued for path: / 2024-09-12T01:57:53.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:57:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:57:53.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:52 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:57:53.616 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.169+0000 7f09c22c5640 1 -- 172.21.15.39:0/3702610542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc102d30 msgr2=0x7f09bc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.169+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3702610542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc102d30 0x7f09bc103110 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009930 tx=0x7f09ac02a420 comp rx=0 tx=0).stop 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 -- 172.21.15.39:0/3702610542 shutdown_connections 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3702610542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1082a0 0x7f09bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3702610542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc1036e0 0x7f09bc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3702610542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc102d30 0x7f09bc103110 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 -- 172.21.15.39:0/3702610542 >> 172.21.15.39:0/3702610542 conn(0x7f09bc0fc7d0 msgr2=0x7f09bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 -- 172.21.15.39:0/3702610542 shutdown_connections 2024-09-12T01:57:54.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.170+0000 7f09c22c5640 1 -- 172.21.15.39:0/3702610542 wait complete. 2024-09-12T01:57:54.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 Processor -- start 2024-09-12T01:57:54.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 -- start start 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc102d30 0x7f09bc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1036e0 0x7f09bc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1120a0 con 0x7f09bc1082a0 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc111f20 con 0x7f09bc1036e0 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c22c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc112220 con 0x7f09bc102d30 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c0862640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c0862640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35444/0 (socket says 172.21.15.39:35444) 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09c0862640 1 -- 172.21.15.39:0/3137369359 learned_addr learned my addr 172.21.15.39:0/3137369359 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc102d30 0x7f09bc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.171+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1036e0 0x7f09bc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 -- 172.21.15.39:0/3137369359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc102d30 msgr2=0x7f09bc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc102d30 0x7f09bc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 -- 172.21.15.39:0/3137369359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1036e0 msgr2=0x7f09bc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1036e0 0x7f09bc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 -- 172.21.15.39:0/3137369359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc19d4e0 con 0x7f09bc1082a0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c0862640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f09b400cce0 tx=0x7f09b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09b97fa640 1 -- 172.21.15.39:0/3137369359 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b400f450 con 0x7f09bc1082a0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc19d7d0 con 0x7f09bc1082a0 2024-09-12T01:57:54.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09b97fa640 1 -- 172.21.15.39:0/3137369359 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b400fad0 con 0x7f09bc1082a0 2024-09-12T01:57:54.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.172+0000 7f09b97fa640 1 -- 172.21.15.39:0/3137369359 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4018c30 con 0x7f09bc1082a0 2024-09-12T01:57:54.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.173+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc1008c0 con 0x7f09bc1082a0 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.176+0000 7f09c469e740 1 Processor -- start 2024-09-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.176+0000 7f09b97fa640 1 -- 172.21.15.39:0/3137369359 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f09b400f5f0 con 0x7f09bc1082a0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.176+0000 7f09c469e740 1 -- start start 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.176+0000 7f09c469e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.176+0000 7f09c469e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf28dc0 0x55679cf33140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09c469e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf33680 0x55679cf35a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09c469e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55679ce8e2e0 con 0x55679cf284a0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09c469e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55679ce35ce0 con 0x55679cf33680 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09c469e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55679ce8a2a0 con 0x55679cf28dc0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35448/0 (socket says 172.21.15.39:35448) 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 -- 172.21.15.39:0/582698068 learned_addr learned my addr 172.21.15.39:0/582698068 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bbfff640 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf28dc0 0x55679cf33140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 -- 172.21.15.39:0/582698068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf28dc0 msgr2=0x55679cf33140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf28dc0 0x55679cf33140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 -- 172.21.15.39:0/582698068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf33680 msgr2=0x55679cf35a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf33680 0x55679cf35a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09bb7fe640 1 -- 172.21.15.39:0/582698068 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679ce1a440 con 0x55679cf284a0 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.177+0000 7f09b97fa640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 0x7f09a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09b97fa640 1 -- 172.21.15.39:0/3137369359 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09b40cf640 con 0x7f09bc1082a0 2024-09-12T01:57:54.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f09b0004600 tx=0x7f09b000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0d2c436579183a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09a27fc640 1 -- 172.21.15.39:0/582698068 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0003bd0 con 0x55679cf284a0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 0x7f09a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09a27fc640 1 -- 172.21.15.39:0/582698068 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b0015070 con 0x55679cf284a0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.178+0000 7f09a27fc640 1 -- 172.21.15.39:0/582698068 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0004de0 con 0x55679cf284a0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 -- 172.21.15.39:0/582698068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 msgr2=0x55679cf28880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 0x7f09a40a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000c00 tx=0x7f09ac0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f09b0004600 tx=0x7f09b000bb20 comp rx=0 tx=0).stop 2024-09-12T01:57:54.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 -- 172.21.15.39:0/582698068 shutdown_connections 2024-09-12T01:57:54.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf33680 0x55679cf35a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf28dc0 0x55679cf33140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 --2- 172.21.15.39:0/582698068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf28880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 -- 172.21.15.39:0/582698068 >> 172.21.15.39:0/582698068 conn(0x55679cf24a30 msgr2=0x55679cf24e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 -- 172.21.15.39:0/582698068 shutdown_connections 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.179+0000 7f09c469e740 1 -- 172.21.15.39:0/582698068 wait complete. 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.180+0000 7f09c469e740 1 -- start start 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.180+0000 7f09c469e740 1 Processor -- start 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.180+0000 7f09c469e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35458/0 (socket says 172.21.15.39:35458) 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf30210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 -- 172.21.15.39:0/3464139120 learned_addr learned my addr 172.21.15.39:0/3464139120 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf30750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55679cf362f0 con 0x55679cf284a0 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55679ce49050 con 0x55679cf28dc0 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55679cf36470 con 0x55679cf33680 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c0862640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf30750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 -- 172.21.15.39:0/3464139120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 msgr2=0x55679cf30750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf30750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 -- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 msgr2=0x55679cf30210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf30210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09bbfff640 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679cbff3c0 con 0x55679cf284a0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.181+0000 7f09c469e740 10 client.0 _ll_register_callbacks cb 0x55679ce89160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f09bbfff640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009930 tx=0x7f09ac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e93eda2e997a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b0015070 con 0x55679cf284a0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f099b7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f099b7fe640 1 -- 172.21.15.39:0/3464139120 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac055050 con 0x55679cf284a0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f099b7fe640 1 -- 172.21.15.39:0/3464139120 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09ac003cc0 con 0x55679cf284a0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f099b7fe640 1 -- 172.21.15.39:0/3464139120 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09ac04b070 con 0x55679cf284a0 2024-09-12T01:57:54.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f09c469e740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:54.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.182+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55679cf41aa0 con 0x55679cf284a0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f099b7fe640 1 -- 172.21.15.39:0/3464139120 <== mon.0 v2:172.21.15.39:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09ac058020 con 0x55679cf284a0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 20 client.15528 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cf433e0 0x55679cf45870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 4 client.15528 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55679ce9b850 con 0x55679cf433e0 2024-09-12T01:57:54.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.183+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cf433e0 0x55679cf45870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.184+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cf433e0 0x55679cf45870 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37f451fb329421e5 server_cookie=cb5a3d2975654b93 in_seq=0 out_seq=0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.184+0000 7f099b7fe640 10 client.15528 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f099b7fe640 1 -- 172.21.15.39:0/3464139120 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55679ce9b850 con 0x55679cf433e0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f099b7fe640 10 client.15528 handle_command_reply: tid=0 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 client.15528 shutdown 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 msgr2=0x55679cf32f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009930 tx=0x7f09ac009260 comp rx=0 tx=0).stop 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 shutdown_connections 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cf433e0 0x55679cf45870 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf30750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf30210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 --2- 172.21.15.39:0/3464139120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf284a0 0x55679cf32f60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 >> 172.21.15.39:0/3464139120 conn(0x55679cf24a30 msgr2=0x55679cf23b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f099b7fe640 0 client.15528 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.185+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 shutdown_connections 2024-09-12T01:57:54.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.186+0000 7f09c469e740 1 -- 172.21.15.39:0/3464139120 wait complete. 2024-09-12T01:57:54.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.186+0000 7f09c469e740 20 client.15528 trim_cache size 0 max 16384 2024-09-12T01:57:54.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.203+0000 7f09c469e740 1 Processor -- start 2024-09-12T01:57:54.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.203+0000 7f09c469e740 1 -- start start 2024-09-12T01:57:54.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 0x55679cf2d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 0x55679cf4ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1ada50 con 0x55679cf33680 2024-09-12T01:57:54.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1ab320 con 0x55679cf28dc0 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09c469e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1a9170 con 0x55679cf284a0 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 0x55679cf2d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09bb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43050/0 (socket says 172.21.15.39:43050) 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.204+0000 7f09bb7fe640 1 -- 172.21.15.39:0/1876036538 learned_addr learned my addr 172.21.15.39:0/1876036538 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 -- 172.21.15.39:0/1876036538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 msgr2=0x55679cf2d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 0x55679cf2d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09c0862640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 0x55679cf4ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 -- 172.21.15.39:0/1876036538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 msgr2=0x55679cf4ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 0x55679cf4ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 -- 172.21.15.39:0/1876036538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679cf2f180 con 0x55679cf28dc0 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bbfff640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 0x55679cf2d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09c0862640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 0x55679cf4ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09b00043f0 tx=0x7f09b0013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadc83439aed2ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09a1ffb640 1 -- 172.21.15.39:0/1876036538 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b000bdf0 con 0x55679cf28dc0 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09a1ffb640 1 -- 172.21.15.39:0/1876036538 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b0003b70 con 0x55679cf28dc0 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.205+0000 7f09a1ffb640 1 -- 172.21.15.39:0/1876036538 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0011440 con 0x55679cf28dc0 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 -- 172.21.15.39:0/1876036538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 msgr2=0x55679cf2d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09b00043f0 tx=0x7f09b0013040 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 -- 172.21.15.39:0/1876036538 shutdown_connections 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf33680 0x55679cf4ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf28dc0 0x55679cf2d9b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 --2- 172.21.15.39:0/1876036538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf284a0 0x55679cf2d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 -- 172.21.15.39:0/1876036538 >> 172.21.15.39:0/1876036538 conn(0x55679cf24a30 msgr2=0x55679cf2a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 -- 172.21.15.39:0/1876036538 shutdown_connections 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.206+0000 7f09c469e740 1 -- 172.21.15.39:0/1876036538 wait complete. 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.207+0000 7f09c469e740 1 -- start start 2024-09-12T01:57:54.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.207+0000 7f09c469e740 1 Processor -- start 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.207+0000 7f09c469e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 0x55679cf48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1a97e0 con 0x55679cf28dc0 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1aac50 con 0x55679cf284a0 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc1a9eb0 con 0x55679cf33680 2024-09-12T01:57:54.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43064/0 (socket says 172.21.15.39:43064) 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 -- 172.21.15.39:0/377546322 learned_addr learned my addr 172.21.15.39:0/377546322 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c469e740 10 client.0 _ll_register_callbacks cb 0x7f09ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 0x55679cf48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c0862640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf49480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 -- 172.21.15.39:0/377546322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 msgr2=0x55679cf49480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf49480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 -- 172.21.15.39:0/377546322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 msgr2=0x55679cf48cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 0x55679cf48cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 -- 172.21.15.39:0/377546322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679cfad0d0 con 0x55679cf284a0 2024-09-12T01:57:54.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09c0862640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf49480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 0x55679cf48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f09bbfff640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09ac005940 tx=0x7f09ac041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3fff05fffff6193 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.208+0000 7f099b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac055050 con 0x55679cf284a0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b0003b70 con 0x55679cf284a0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09ac004ad0 con 0x55679cf284a0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09ac06a050 con 0x55679cf284a0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f09c469e740 10 client.25151 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55679cfae1e0 con 0x55679cf284a0 2024-09-12T01:57:54.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b0003b70 con 0x55679cf284a0 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.209+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09ac058040 con 0x55679cf284a0 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 10 client.25151 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 10 client.25151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 20 client.25151 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cfae900 0x55679cfb0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 4 client.25151 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55679cf2ae80 con 0x55679cfae900 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.210+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cfae900 0x55679cfb0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09bb7fe640 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cfae900 0x55679cfb0cf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbaec621cfebcb99 server_cookie=67e15ebe5aa20e2 in_seq=0 out_seq=0 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f099b7fe640 10 client.25151 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f099b7fe640 1 -- 172.21.15.39:0/377546322 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55679cf2ae80 con 0x55679cfae900 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f099b7fe640 10 client.25151 handle_command_reply: tid=0 2024-09-12T01:57:54.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 client.25151 shutdown 2024-09-12T01:57:54.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 msgr2=0x55679cf4b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09ac005940 tx=0x7f09ac041000 comp rx=0 tx=0).stop 2024-09-12T01:57:54.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 shutdown_connections 2024-09-12T01:57:54.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55679cfae900 0x55679cfb0cf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55679cf33680 0x55679cf49480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55679cf28dc0 0x55679cf48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 --2- 172.21.15.39:0/377546322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55679cf284a0 0x55679cf4b9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 >> 172.21.15.39:0/377546322 conn(0x55679cf24a30 msgr2=0x55679cf23350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f099b7fe640 0 client.25151 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 shutdown_connections 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.211+0000 7f09c469e740 1 -- 172.21.15.39:0/377546322 wait complete. 2024-09-12T01:57:54.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.212+0000 7f09c469e740 20 client.25151 trim_cache size 0 max 16384 2024-09-12T01:57:54.217 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:57:54.217 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-12T01:57:54.217 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2024-09-12T01:57:54.217 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:57:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.212+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 msgr2=0x7f09a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.212+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 0x7f09a40a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000c00 tx=0x7f09ac0058b0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.212+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 msgr2=0x7f09bc19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.212+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f09b400cce0 tx=0x7f09b400a620 comp rx=0 tx=0).stop 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 shutdown_connections 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09bc1082a0 0x7f09bc19ce00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09bc1036e0 0x7f09bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09a40a2b80 0x7f09a40a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 --2- 172.21.15.39:0/3137369359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09bc102d30 0x7f09bc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 >> 172.21.15.39:0/3137369359 conn(0x7f09bc0fc7d0 msgr2=0x7f09bc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 shutdown_connections 2024-09-12T01:57:54.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:54.213+0000 7f09c22c5640 1 -- 172.21.15.39:0/3137369359 wait complete. 2024-09-12T01:57:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 -- 172.21.15.39:0/1897120667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 msgr2=0x7f3000101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 --2- 172.21.15.39:0/1897120667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000101f60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009900 tx=0x7f2ff002a410 comp rx=0 tx=0).stop 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 -- 172.21.15.39:0/1897120667 shutdown_connections 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 --2- 172.21.15.39:0/1897120667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000103710 0x7f3000109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 --2- 172.21.15.39:0/1897120667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000102d50 0x7f30001031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 --2- 172.21.15.39:0/1897120667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000101f60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.728+0000 7f3005227640 1 -- 172.21.15.39:0/1897120667 >> 172.21.15.39:0/1897120667 conn(0x7f30000fd2c0 msgr2=0x7f30000ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.729+0000 7f3005227640 1 -- 172.21.15.39:0/1897120667 shutdown_connections 2024-09-12T01:57:54.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.729+0000 7f3005227640 1 -- 172.21.15.39:0/1897120667 wait complete. 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.729+0000 7f3005227640 1 Processor -- start 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 -- start start 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 0x7f3000198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000103710 0x7f300019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f300010d7e0 con 0x7f3000101b60 2024-09-12T01:57:54.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f300010d660 con 0x7f3000102d50 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f3005227640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f300010d960 con 0x7f3000103710 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35490/0 (socket says 172.21.15.39:35490) 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f2ffed9d640 1 -- 172.21.15.39:0/162749243 learned_addr learned my addr 172.21.15.39:0/162749243 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 0x7f3000198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.730+0000 7f2fff59e640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000103710 0x7f300019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 -- 172.21.15.39:0/162749243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000103710 msgr2=0x7f300019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000103710 0x7f300019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 -- 172.21.15.39:0/162749243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 msgr2=0x7f3000198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 0x7f3000198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 -- 172.21.15.39:0/162749243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300019fa20 con 0x7f3000101b60 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 0x7f3000198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:54.732 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0031610 tx=0x7f2ff0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2fe7fff640 1 -- 172.21.15.39:0/162749243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff003f030 con 0x7f3000101b60 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2fe7fff640 1 -- 172.21.15.39:0/162749243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff0003ad0 con 0x7f3000101b60 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300019fcb0 con 0x7f3000101b60 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f2fe7fff640 1 -- 172.21.15.39:0/162749243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0035070 con 0x7f3000101b60 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.731+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a01a0 con 0x7f3000101b60 2024-09-12T01:57:54.733 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.734+0000 7f2fe7fff640 1 -- 172.21.15.39:0/162749243 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2ff0042030 con 0x7f3000101b60 2024-09-12T01:57:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2fe7fff640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 0x7f2fe80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.734 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 Processor -- start 2024-09-12T01:57:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 0x7f2fe80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.735 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2fe7fff640 1 -- 172.21.15.39:0/162749243 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ff00eedc0 con 0x7f3000101b60 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 -- start start 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b61fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b620330 0x55c11b62d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c11b5802f0 con 0x55c11b61d260 2024-09-12T01:57:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c11b528270 con 0x55c11b61c920 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f3007fc0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c11b57c2b0 con 0x55c11b620330 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b61fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.735+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43108/0 (socket says 172.21.15.39:43108) 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1773312056 learned_addr learned my addr 172.21.15.39:0/1773312056 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2fff59e640 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b620330 0x55c11b62d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1773312056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b620330 msgr2=0x55c11b62d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b620330 0x55c11b62d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1773312056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 msgr2=0x55c11b61fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b61fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1773312056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c11b527340 con 0x55c11b61c920 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b61fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 0x7f2fe80a50f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3000199310 tx=0x7f2ff400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00c3d70 tx=0x7f2ff003b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c5e952899d5c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.736+0000 7f2fe57fa640 1 -- 172.21.15.39:0/1773312056 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0049040 con 0x55c11b61c920 2024-09-12T01:57:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f2fe57fa640 1 -- 172.21.15.39:0/1773312056 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff00c42a0 con 0x55c11b61c920 2024-09-12T01:57:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f2fe57fa640 1 -- 172.21.15.39:0/1773312056 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff003b460 con 0x55c11b61c920 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 -- 172.21.15.39:0/1773312056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 msgr2=0x55c11b61cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00c3d70 tx=0x7f2ff003b800 comp rx=0 tx=0).stop 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 -- 172.21.15.39:0/1773312056 shutdown_connections 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b620330 0x55c11b62d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b61fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1773312056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b61c920 0x55c11b61cd20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 -- 172.21.15.39:0/1773312056 >> 172.21.15.39:0/1773312056 conn(0x55c11b618010 msgr2=0x55c11b618410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 -- 172.21.15.39:0/1773312056 shutdown_connections 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.737+0000 7f3007fc0740 1 -- 172.21.15.39:0/1773312056 wait complete. 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 -- start start 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 Processor -- start 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b61d260 0x55c11b626f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b62bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c11b620bf0 con 0x55c11b61c920 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c11b509290 con 0x55c11b620330 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c11b620d70 con 0x55c11b61d260 2024-09-12T01:57:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35506/0 (socket says 172.21.15.39:35506) 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1820512717 learned_addr learned my addr 172.21.15.39:0/1820512717 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f3007fc0740 10 client.0 _ll_register_callbacks cb 0x55c11b53a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.738+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b61d260 0x55c11b626f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2fff59e640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b62bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1820512717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b61d260 msgr2=0x55c11b626f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b61d260 0x55c11b626f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 msgr2=0x55c11b62bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b62bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1820512717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c11b293210 con 0x55c11b61c920 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0031440 tx=0x7f2ff0003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc4e962545baccb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2fe2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00d3020 con 0x55c11b61c920 2024-09-12T01:57:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ff003b460 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff00c42a0 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ff0049070 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f3007fc0740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.739+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c11b35f620 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff00da020 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff0031b80 con 0x55c11b61c920 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 20 client.15543 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b643420 0x55c11b645830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 4 client.15543 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2ff00c42a0 con 0x55c11b643420 2024-09-12T01:57:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.740+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b643420 0x55c11b645830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.741+0000 7f2fe2ff5640 10 client.15543 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.741+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b643420 0x55c11b645830 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa79a0a18486121 server_cookie=28370683c83dd90f in_seq=0 out_seq=0 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/1820512717 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2ff00c42a0 con 0x55c11b643420 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f2fe2ff5640 10 client.15543 handle_command_reply: tid=0 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 client.15543 shutdown 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 msgr2=0x55c11b6269e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0031440 tx=0x7f2ff0003d10 comp rx=0 tx=0).stop 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 shutdown_connections 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b643420 0x55c11b645830 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b62bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b61d260 0x55c11b626f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1820512717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61c920 0x55c11b6269e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f2fe2ff5640 0 client.15543 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 >> 172.21.15.39:0/1820512717 conn(0x55c11b618010 msgr2=0x55c11b619820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 shutdown_connections 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 1 -- 172.21.15.39:0/1820512717 wait complete. 2024-09-12T01:57:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.742+0000 7f3007fc0740 20 client.15543 trim_cache size 0 max 16384 2024-09-12T01:57:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 Processor -- start 2024-09-12T01:57:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 -- start start 2024-09-12T01:57:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b618ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b6198b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a9650 con 0x55c11b61d260 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a6f20 con 0x55c11b620330 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f3007fc0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a4d70 con 0x55c11b619400 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b6198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35522/0 (socket says 172.21.15.39:35522) 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2ffed9d640 1 -- 172.21.15.39:0/1765498667 learned_addr learned my addr 172.21.15.39:0/1765498667 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b618ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 -- 172.21.15.39:0/1765498667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 msgr2=0x55c11b618ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b618ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 -- 172.21.15.39:0/1765498667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 msgr2=0x55c11b626ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.757+0000 7f2fff59e640 1 -- 172.21.15.39:0/1765498667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c11b645eb0 con 0x55c11b619400 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.758+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.758+0000 7f2fff59e640 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b6198b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005fd0 tx=0x7f2ff8009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b92891904839d063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.758+0000 7f2fe4ff9640 1 -- 172.21.15.39:0/1765498667 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8020070 con 0x55c11b619400 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.758+0000 7f2fe4ff9640 1 -- 172.21.15.39:0/1765498667 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff8010910 con 0x55c11b619400 2024-09-12T01:57:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.758+0000 7f2fe4ff9640 1 -- 172.21.15.39:0/1765498667 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff801ba60 con 0x55c11b619400 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- 172.21.15.39:0/1765498667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 msgr2=0x55c11b6198b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b6198b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005fd0 tx=0x7f2ff8009500 comp rx=0 tx=0).stop 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- 172.21.15.39:0/1765498667 shutdown_connections 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b6198b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b618ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- 172.21.15.39:0/1765498667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b626ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- 172.21.15.39:0/1765498667 >> 172.21.15.39:0/1765498667 conn(0x55c11b618010 msgr2=0x55c11b626790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- 172.21.15.39:0/1765498667 shutdown_connections 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- 172.21.15.39:0/1765498667 wait complete. 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 -- start start 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 Processor -- start 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b657140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.759+0000 7f3007fc0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b6557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f3007fc0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a53e0 con 0x55c11b61d260 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f3007fc0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a6850 con 0x55c11b620330 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f3007fc0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30001a5ab0 con 0x55c11b619400 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f3007fc0740 10 client.0 _ll_register_callbacks cb 0x7f2ff00bf070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35528/0 (socket says 172.21.15.39:35528) 2024-09-12T01:57:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 -- 172.21.15.39:0/3344455504 learned_addr learned my addr 172.21.15.39:0/3344455504 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b657140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2fff59e640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b6557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 -- 172.21.15.39:0/3344455504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 msgr2=0x55c11b657140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b657140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 -- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 msgr2=0x55c11b6557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b6557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 -- 172.21.15.39:0/3344455504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c11b655fd0 con 0x55c11b61d260 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2fff59e640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b6557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2ffe59c640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55c11b61dc90 tx=0x7f2ff4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25cb856c125366b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2fe2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4011e60 con 0x55c11b61d260 2024-09-12T01:57:54.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff8010910 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.760+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ff4004220 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ff4004420 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 10 client.15549 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c11b6aebe0 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff8010910 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff4004c10 con 0x55c11b61d260 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 10 client.15549 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 20 client.15549 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b6af5c0 0x55c11b6b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 4 client.15549 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c11b58da20 con 0x55c11b6af5c0 2024-09-12T01:57:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.761+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b6af5c0 0x55c11b6b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.762+0000 7f2fe2ff5640 10 client.15549 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.762+0000 7f2ffed9d640 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b6af5c0 0x55c11b6b19e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c053cffdfbac2d8b server_cookie=4620062b286b17f5 in_seq=0 out_seq=0 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f2fe2ff5640 1 -- 172.21.15.39:0/3344455504 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c11b58da20 con 0x55c11b6af5c0 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f2fe2ff5640 10 client.15549 handle_command_reply: tid=0 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 client.15549 shutdown 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 msgr2=0x55c11b657680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55c11b61dc90 tx=0x7f2ff4004730 comp rx=0 tx=0).stop 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 shutdown_connections 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c11b6af5c0 0x55c11b6b19e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c11b620330 0x55c11b6557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c11b61d260 0x55c11b657680 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 --2- 172.21.15.39:0/3344455504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c11b619400 0x55c11b657140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 >> 172.21.15.39:0/3344455504 conn(0x55c11b618010 msgr2=0x55c11b624b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f2fe2ff5640 0 client.15549 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 shutdown_connections 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 1 -- 172.21.15.39:0/3344455504 wait complete. 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.766+0000 7f3007fc0740 20 client.15549 trim_cache size 0 max 16384 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:57:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:57:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:57:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:57:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 msgr2=0x7f2fe80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 0x7f2fe80a50f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3000199310 tx=0x7f2ff400b390 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 msgr2=0x7f3000197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0031610 tx=0x7f2ff0004270 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 shutdown_connections 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2fe80a2c30 0x7f2fe80a50f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3000103710 0x7f300019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3000102d50 0x7f3000198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 --2- 172.21.15.39:0/162749243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3000101b60 0x7f3000197e00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 >> 172.21.15.39:0/162749243 conn(0x7f30000fd2c0 msgr2=0x7f30001060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 shutdown_connections 2024-09-12T01:57:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:57:54.767+0000 7f3005227640 1 -- 172.21.15.39:0/162749243 wait complete. 2024-09-12T01:57:54.940 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:57:54.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:57:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:54 smithi039 ceph-mon[31204]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T01:57:55.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:54 smithi172 ceph-mon[35073]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T01:57:55.323 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:54 smithi044 ceph-mon[35259]: pgmap v367: 97 pgs: 97 active+clean; 661 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.866+0000 7f1741d37640 1 -- 172.21.15.39:0/3142775959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 msgr2=0x7f173c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.866+0000 7f1741d37640 1 --2- 172.21.15.39:0/3142775959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c10ec40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1734009cd0 tx=0x7f173402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 -- 172.21.15.39:0/3142775959 shutdown_connections 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 --2- 172.21.15.39:0/3142775959 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c10ec40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 --2- 172.21.15.39:0/3142775959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 0x7f173c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 --2- 172.21.15.39:0/3142775959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 0x7f173c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 -- 172.21.15.39:0/3142775959 >> 172.21.15.39:0/3142775959 conn(0x7f173c0fc7d0 msgr2=0x7f173c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 -- 172.21.15.39:0/3142775959 shutdown_connections 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.867+0000 7f1741d37640 1 -- 172.21.15.39:0/3142775959 wait complete. 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.868+0000 7f1741d37640 1 Processor -- start 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.868+0000 7f1741d37640 1 -- start start 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 0x7f173c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 0x7f173c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f173c1120a0 con 0x7f173c1082a0 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f173c111f20 con 0x7f173c1036e0 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f1741d37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112220 con 0x7f173c102d30 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35548/0 (socket says 172.21.15.39:35548) 2024-09-12T01:57:55.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 -- 172.21.15.39:0/3860665101 learned_addr learned my addr 172.21.15.39:0/3860665101 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173affd640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 0x7f173c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173b7fe640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 0x7f173c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 -- 172.21.15.39:0/3860665101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 msgr2=0x7f173c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 0x7f173c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 -- 172.21.15.39:0/3860665101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 msgr2=0x7f173c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 0x7f173c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.869+0000 7f173bfff640 1 -- 172.21.15.39:0/3860665101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c19d4e0 con 0x7f173c1082a0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.870+0000 7f173bfff640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1734005cc0 tx=0x7f1734003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.870+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734004040 con 0x7f173c1082a0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.870+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17340046c0 con 0x7f173c1082a0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.870+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c19d770 con 0x7f173c1082a0 2024-09-12T01:57:55.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.871+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c1a50b0 con 0x7f173c1082a0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.871+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734046480 con 0x7f173c1082a0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.872+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c06a850 con 0x7f173c1082a0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.873+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17340305a0 con 0x7f173c1082a0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.874+0000 7f1738ff9640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 0x7f17240a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.875+0000 7f173b7fe640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 0x7f17240a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.875+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f173402e030 con 0x7f173c1082a0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.875+0000 7f173b7fe640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 0x7f17240a4f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f172c005fd0 tx=0x7f172c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:55.879+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f173404b060 con 0x7f173c1082a0 2024-09-12T01:57:56.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.092+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f173c199890 con 0x7f173c1082a0 2024-09-12T01:57:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.093+0000 7f1738ff9640 1 -- 172.21.15.39:0/3860665101 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7f17340bd240 con 0x7f173c1082a0 2024-09-12T01:57:56.093 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:57:56.093 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:57:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:57:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.095+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 msgr2=0x7f17240a4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.095+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 0x7f17240a4f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f172c005fd0 tx=0x7f172c00b390 comp rx=0 tx=0).stop 2024-09-12T01:57:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.095+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 msgr2=0x7f173c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:56.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.095+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1734005cc0 tx=0x7f1734003970 comp rx=0 tx=0).stop 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 shutdown_connections 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f173c1082a0 0x7f173c19ce00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f173c1036e0 0x7f173c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f17240a2a50 0x7f17240a4f10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 --2- 172.21.15.39:0/3860665101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f173c102d30 0x7f173c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:56.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 >> 172.21.15.39:0/3860665101 conn(0x7f173c0fc7d0 msgr2=0x7f173c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:56.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 shutdown_connections 2024-09-12T01:57:56.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:56.096+0000 7f1741d37640 1 -- 172.21.15.39:0/3860665101 wait complete. 2024-09-12T01:57:56.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:57:57.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:56 smithi039 ceph-mon[31204]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T01:57:57.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:56 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3860665101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:56 smithi172 ceph-mon[35073]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T01:57:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:56 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3860665101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:57.269 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:56 smithi044 ceph-mon[35259]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-12T01:57:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:56 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3860665101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:57:57.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.824+0000 7f2e2f763640 1 -- 172.21.15.39:0/1831289530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28100e20 msgr2=0x7f2e28101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 --2- 172.21.15.39:0/1831289530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28100e20 0x7f2e28101200 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009980 tx=0x7f2e2402e8b0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 -- 172.21.15.39:0/1831289530 shutdown_connections 2024-09-12T01:57:57.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 --2- 172.21.15.39:0/1831289530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28102ef0 0x7f2e2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 --2- 172.21.15.39:0/1831289530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 --2- 172.21.15.39:0/1831289530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28100e20 0x7f2e28101200 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 -- 172.21.15.39:0/1831289530 >> 172.21.15.39:0/1831289530 conn(0x7f2e280fc7d0 msgr2=0x7f2e280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 -- 172.21.15.39:0/1831289530 shutdown_connections 2024-09-12T01:57:57.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.825+0000 7f2e2f763640 1 -- 172.21.15.39:0/1831289530 wait complete. 2024-09-12T01:57:57.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.827+0000 7f2e2f763640 1 Processor -- start 2024-09-12T01:57:57.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.827+0000 7f2e2f763640 1 -- start start 2024-09-12T01:57:57.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.827+0000 7f2e2f763640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28100e20 0x7f2e28196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.827+0000 7f2e2f763640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e28196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.827+0000 7f2e2f763640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2f763640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2810fec0 con 0x7f2e28102ef0 2024-09-12T01:57:57.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2f763640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2810fd40 con 0x7f2e28100e20 2024-09-12T01:57:57.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2f763640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e28110040 con 0x7f2e28102570 2024-09-12T01:57:57.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35576/0 (socket says 172.21.15.39:35576) 2024-09-12T01:57:57.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 -- 172.21.15.39:0/126280015 learned_addr learned my addr 172.21.15.39:0/126280015 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:57.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28100e20 0x7f2e28196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e28196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 -- 172.21.15.39:0/126280015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 msgr2=0x7f2e28196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e28196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 -- 172.21.15.39:0/126280015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28100e20 msgr2=0x7f2e28196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28100e20 0x7f2e28196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 -- 172.21.15.39:0/126280015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2819b2e0 con 0x7f2e28102ef0 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e28196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:57:57.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.828+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000eaa0 tx=0x7f2e2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.829+0000 7f2e1e7fc640 1 -- 172.21.15.39:0/126280015 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2000cdb0 con 0x7f2e28102ef0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.829+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2819b5d0 con 0x7f2e28102ef0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.829+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e281a2eb0 con 0x7f2e28102ef0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.829+0000 7f2e1e7fc640 1 -- 172.21.15.39:0/126280015 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e20005020 con 0x7f2e28102ef0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.829+0000 7f2e1e7fc640 1 -- 172.21.15.39:0/126280015 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e200116d0 con 0x7f2e28102ef0 2024-09-12T01:57:57.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.832+0000 7f2e31b3c740 1 Processor -- start 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.832+0000 7f2e1e7fc640 1 -- 172.21.15.39:0/126280015 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2e20011870 con 0x7f2e28102ef0 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 -- start start 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53129b40 0x55ea53128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53133370 0x55ea53135760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ea5308e2f0 con 0x55ea531285d0 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea53035cf0 con 0x55ea53133370 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ea5308a2b0 con 0x55ea53129b40 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35582/0 (socket says 172.21.15.39:35582) 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/3631814280 learned_addr learned my addr 172.21.15.39:0/3631814280 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:57.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53133370 0x55ea53135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53129b40 0x55ea53128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/3631814280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53129b40 msgr2=0x55ea53128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53129b40 0x55ea53128090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/3631814280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53133370 msgr2=0x55ea53135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53133370 0x55ea53135760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.833+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/3631814280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5301a3a0 con 0x55ea531285d0 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009230 tx=0x7f2e24005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6333f19c41e0822 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e137fe640 1 -- 172.21.15.39:0/3631814280 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24043070 con 0x55ea531285d0 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e1e7fc640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 0x7f2e140ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e137fe640 1 -- 172.21.15.39:0/3631814280 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24010530 con 0x55ea531285d0 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e137fe640 1 -- 172.21.15.39:0/3631814280 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004a00 con 0x55ea531285d0 2024-09-12T01:57:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.834+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 0x7f2e140ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.835+0000 7f2e1e7fc640 1 -- 172.21.15.39:0/126280015 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e200cf150 con 0x7f2e28102ef0 2024-09-12T01:57:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.835+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3631814280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 msgr2=0x55ea53128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.835+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 0x7f2e140ad8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e180058c0 tx=0x7f2e18005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.835+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009230 tx=0x7f2e24005fd0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3631814280 shutdown_connections 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53133370 0x55ea53135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea53128a10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3631814280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53129b40 0x55ea53128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3631814280 >> 172.21.15.39:0/3631814280 conn(0x55ea530f1310 msgr2=0x55ea53124c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3631814280 shutdown_connections 2024-09-12T01:57:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3631814280 wait complete. 2024-09-12T01:57:57.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.836+0000 7f2e31b3c740 1 -- start start 2024-09-12T01:57:57.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.837+0000 7f2e31b3c740 1 Processor -- start 2024-09-12T01:57:57.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.837+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea53132c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea53130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea53132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea53132c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:59846/0 (socket says 172.21.15.39:59846) 2024-09-12T01:57:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/315851987 learned_addr learned my addr 172.21.15.39:0/315851987 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ea53136010 con 0x55ea53133370 2024-09-12T01:57:57.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea53049060 con 0x55ea53129b40 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea53130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ea53136190 con 0x55ea531285d0 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e31b3c740 10 client.0 _ll_register_callbacks cb 0x55ea52d9c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 -- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 msgr2=0x55ea53132c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea53132c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 -- 172.21.15.39:0/315851987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 msgr2=0x55ea5312ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.838+0000 7f2e2dd00640 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea52dff3c0 con 0x55ea53133370 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea53130460 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2e200ccc60 tx=0x7f2e2009c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5048bfe46f3b838 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:57.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001f040 con 0x55ea53133370 2024-09-12T01:57:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e24010530 con 0x55ea53133370 2024-09-12T01:57:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e200a41a0 con 0x55ea53133370 2024-09-12T01:57:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e200a43a0 con 0x55ea53133370 2024-09-12T01:57:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e31b3c740 10 client.15567 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:57.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.839+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea53141ad0 con 0x55ea53133370 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24010530 con 0x55ea53133370 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e2000f040 con 0x55ea53133370 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 10 client.15567 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 10 client.15567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 20 client.15567 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:57.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea53145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 4 client.15567 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.840+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea5309b860 con 0x55ea53142ee0 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.841+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea53145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.841+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea53145330 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ceb3fe29db2b478 server_cookie=1e344070f814d44c in_seq=0 out_seq=0 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.841+0000 7f2e10ff9640 10 client.15567 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:57.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e10ff9640 1 -- 172.21.15.39:0/315851987 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea5309b860 con 0x55ea53142ee0 2024-09-12T01:57:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e10ff9640 10 client.15567 handle_command_reply: tid=0 2024-09-12T01:57:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 client.15567 shutdown 2024-09-12T01:57:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 msgr2=0x55ea53130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea53130460 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2e200ccc60 tx=0x7f2e2009c200 comp rx=0 tx=0).stop 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 shutdown_connections 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea53145330 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea53130460 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e10ff9640 0 client.15567 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/315851987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea53132c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.842+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 >> 172.21.15.39:0/315851987 conn(0x55ea530f1310 msgr2=0x55ea5312a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.843+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 shutdown_connections 2024-09-12T01:57:57.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.843+0000 7f2e31b3c740 1 -- 172.21.15.39:0/315851987 wait complete. 2024-09-12T01:57:57.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.843+0000 7f2e31b3c740 20 client.15567 trim_cache size 0 max 16384 2024-09-12T01:57:57.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.869+0000 7f2e31b3c740 1 Processor -- start 2024-09-12T01:57:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.869+0000 7f2e31b3c740 1 -- start start 2024-09-12T01:57:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.869+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea53123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53133370 0x55ea5312b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281adb70 con 0x55ea531285d0 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35594/0 (socket says 172.21.15.39:35594) 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e2d4ff640 1 -- 172.21.15.39:0/4062750883 learned_addr learned my addr 172.21.15.39:0/4062750883 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:57.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281ab440 con 0x55ea53129b40 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281a9290 con 0x55ea53133370 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea53123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.870+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53133370 0x55ea5312b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 -- 172.21.15.39:0/4062750883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53133370 msgr2=0x55ea5312b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53133370 0x55ea5312b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 -- 172.21.15.39:0/4062750883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 msgr2=0x55ea5311fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 -- 172.21.15.39:0/4062750883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5312eed0 con 0x55ea53129b40 2024-09-12T01:57:57.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea53123bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55ea53129070 tx=0x7f2e18010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b344daf20df3e507 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.871+0000 7f2e12ffd640 1 -- 172.21.15.39:0/4062750883 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1802b070 con 0x55ea53129b40 2024-09-12T01:57:57.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.872+0000 7f2e12ffd640 1 -- 172.21.15.39:0/4062750883 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e1801ddf0 con 0x55ea53129b40 2024-09-12T01:57:57.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.872+0000 7f2e12ffd640 1 -- 172.21.15.39:0/4062750883 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18014040 con 0x55ea53129b40 2024-09-12T01:57:57.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.872+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 msgr2=0x55ea53123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.872+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea53123bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55ea53129070 tx=0x7f2e18010000 comp rx=0 tx=0).stop 2024-09-12T01:57:57.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 shutdown_connections 2024-09-12T01:57:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea53133370 0x55ea5312b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea53123bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/4062750883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea531285d0 0x55ea5311fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 >> 172.21.15.39:0/4062750883 conn(0x55ea530f1310 msgr2=0x55ea531234e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 shutdown_connections 2024-09-12T01:57:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 -- 172.21.15.39:0/4062750883 wait complete. 2024-09-12T01:57:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 -- start start 2024-09-12T01:57:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.873+0000 7f2e31b3c740 1 Processor -- start 2024-09-12T01:57:57.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea5312cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281a9900 con 0x55ea53133370 2024-09-12T01:57:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281aad70 con 0x55ea53129b40 2024-09-12T01:57:57.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281a9fd0 con 0x55ea531285d0 2024-09-12T01:57:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e31b3c740 10 client.0 _ll_register_callbacks cb 0x7f2e20084f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e2d4ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea5312cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e2dd00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e2dd00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35608/0 (socket says 172.21.15.39:35608) 2024-09-12T01:57:57.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e2dd00640 1 -- 172.21.15.39:0/3512665212 learned_addr learned my addr 172.21.15.39:0/3512665212 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.874+0000 7f2e2ccfe640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 -- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 msgr2=0x55ea5312cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea5312cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 -- 172.21.15.39:0/3512665212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 msgr2=0x55ea5312d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:57.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 -- 172.21.15.39:0/3512665212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea531acc20 con 0x55ea53133370 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e2dd00640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cccb0 tx=0x7f2e200ba4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c8bdb10518c029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.875+0000 7f2e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2007e070 con 0x55ea53133370 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e200b4bc0 con 0x55ea53133370 2024-09-12T01:57:57.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e1801ddf0 con 0x55ea53133370 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e200a9050 con 0x55ea53133370 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e31b3c740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ea531adf00 con 0x55ea53133370 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.876+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e200b4de0 con 0x55ea53133370 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.877+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e2009a880 con 0x55ea53133370 2024-09-12T01:57:57.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.877+0000 7f2e31b3c740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.877+0000 7f2e31b3c740 10 client.15573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:57:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.877+0000 7f2e31b3c740 20 client.15573 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.877+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea531b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.878+0000 7f2e31b3c740 4 client.15573 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:57:57.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.878+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2e1801ddf0 con 0x55ea53142ee0 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.878+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea531b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.878+0000 7f2e2d4ff640 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea531b03e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee1240ea288247fa server_cookie=2d8bea074333ed0a in_seq=0 out_seq=0 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.878+0000 7f2e10ff9640 10 client.15573 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e10ff9640 1 -- 172.21.15.39:0/3512665212 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2e1801ddf0 con 0x55ea53142ee0 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e10ff9640 10 client.15573 handle_command_reply: tid=0 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 client.15573 shutdown 2024-09-12T01:57:57.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 msgr2=0x55ea5312da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cccb0 tx=0x7f2e200ba4d0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 shutdown_connections 2024-09-12T01:57:57.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55ea53142ee0 0x55ea531b03e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ea53133370 0x55ea5312da40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e10ff9640 0 client.15573 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea53129b40 0x55ea5312d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 --2- 172.21.15.39:0/3512665212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea531285d0 0x55ea5312cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.879+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 >> 172.21.15.39:0/3512665212 conn(0x55ea530f1310 msgr2=0x55ea53131fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.880+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 shutdown_connections 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.880+0000 7f2e31b3c740 1 -- 172.21.15.39:0/3512665212 wait complete. 2024-09-12T01:57:57.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.880+0000 7f2e31b3c740 20 client.15573 trim_cache size 0 max 16384 2024-09-12T01:57:57.898 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 msgr2=0x7f2e140ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 0x7f2e140ad8d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e180058c0 tx=0x7f2e18005e50 comp rx=0 tx=0).stop 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 msgr2=0x7f2e2819ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000eaa0 tx=0x7f2e2000ef60 comp rx=0 tx=0).stop 2024-09-12T01:57:57.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 shutdown_connections 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e28102ef0 0x7f2e2819ac00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2e140ab410 0x7f2e140ad8d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28102570 0x7f2e28196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 --2- 172.21.15.39:0/126280015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e28100e20 0x7f2e28196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 >> 172.21.15.39:0/126280015 conn(0x7f2e280fc7d0 msgr2=0x7f2e280fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:57.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 shutdown_connections 2024-09-12T01:57:57.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:57.881+0000 7f2e2f763640 1 -- 172.21.15.39:0/126280015 wait complete. 2024-09-12T01:57:58.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:57:59.052 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:57:59.215 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:57:58 smithi039 ceph-mon[31204]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T01:57:59.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:57:58 smithi172 ceph-mon[35073]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T01:57:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:57:58 smithi044 ceph-mon[35259]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 -- 172.21.15.39:0/2056645981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058102790 msgr2=0x7f20581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 --2- 172.21.15.39:0/2056645981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058102790 0x7f20581067e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f204c009900 tx=0x7f204c02a3f0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 -- 172.21.15.39:0/2056645981 shutdown_connections 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 --2- 172.21.15.39:0/2056645981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058106f10 0x7f205810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 --2- 172.21.15.39:0/2056645981 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058102790 0x7f20581067e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 --2- 172.21.15.39:0/2056645981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 0x7f20581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 -- 172.21.15.39:0/2056645981 >> 172.21.15.39:0/2056645981 conn(0x7f20580fd8e0 msgr2=0x7f20580ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.596+0000 7f205e73b640 1 -- 172.21.15.39:0/2056645981 shutdown_connections 2024-09-12T01:57:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.597+0000 7f205e73b640 1 -- 172.21.15.39:0/2056645981 wait complete. 2024-09-12T01:57:59.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.598+0000 7f205e73b640 1 Processor -- start 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.598+0000 7f205e73b640 1 -- start start 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.598+0000 7f205e73b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 0x7f20581983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.598+0000 7f205e73b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 0x7f20581988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.598+0000 7f205e73b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205e73b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2058111f70 con 0x7f2058106f10 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205e73b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2058111df0 con 0x7f2058102790 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205e73b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20581120f0 con 0x7f2058101de0 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f20577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 0x7f20581988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35632/0 (socket says 172.21.15.39:35632) 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 -- 172.21.15.39:0/3395157157 learned_addr learned my addr 172.21.15.39:0/3395157157 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:59.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f2057fff640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 0x7f20581983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 -- 172.21.15.39:0/3395157157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 msgr2=0x7f20581983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 0x7f20581983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 -- 172.21.15.39:0/3395157157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 msgr2=0x7f20581988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 0x7f20581988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 -- 172.21.15.39:0/3395157157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205819d350 con 0x7f2058106f10 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f20577fe640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 0x7f20581988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.599+0000 7f205ccd8640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f205000cce0 tx=0x7f205000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.600+0000 7f20557fa640 1 -- 172.21.15.39:0/3395157157 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205000f450 con 0x7f2058106f10 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.600+0000 7f20557fa640 1 -- 172.21.15.39:0/3395157157 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f205000fad0 con 0x7f2058106f10 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.600+0000 7f20557fa640 1 -- 172.21.15.39:0/3395157157 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050018c10 con 0x7f2058106f10 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.600+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205819d640 con 0x7f2058106f10 2024-09-12T01:57:59.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.600+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2058074420 con 0x7f2058106f10 2024-09-12T01:57:59.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.603+0000 7f2060b14740 1 Processor -- start 2024-09-12T01:57:59.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f20557fa640 1 -- 172.21.15.39:0/3395157157 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f205000fc80 con 0x7f2058106f10 2024-09-12T01:57:59.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 -- start start 2024-09-12T01:57:59.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3fb40 0x55b825e3e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e3ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b825da42f0 con 0x55b825e49370 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b825d4bcf0 con 0x55b825e3e5d0 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.604+0000 7f2060b14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b825da02b0 con 0x55b825e3fb40 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f20577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f20577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35642/0 (socket says 172.21.15.39:35642) 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f20577fe640 1 -- 172.21.15.39:0/72185332 learned_addr learned my addr 172.21.15.39:0/72185332 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:59.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e3ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 -- 172.21.15.39:0/72185332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3fb40 msgr2=0x55b825e3e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3fb40 0x55b825e3e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 -- 172.21.15.39:0/72185332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 msgr2=0x55b825e4b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f20557fa640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 0x7f20400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f2057fff640 1 -- 172.21.15.39:0/72185332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b825d303a0 con 0x55b825e3e5d0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.605+0000 7f20577fe640 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f20557fa640 1 -- 172.21.15.39:0/3395157157 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f20500cf440 con 0x7f2058106f10 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f20577fe640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 0x7f20400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f2057fff640 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e3ea10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2048009b70 tx=0x7f20480117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0bbc9378e42429b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f203e7fc640 1 -- 172.21.15.39:0/72185332 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048009e60 con 0x55b825e3e5d0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f203e7fc640 1 -- 172.21.15.39:0/72185332 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048012930 con 0x55b825e3e5d0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f203e7fc640 1 -- 172.21.15.39:0/72185332 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204800fbb0 con 0x55b825e3e5d0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.606+0000 7f20577fe640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 0x7f20400a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 -- 172.21.15.39:0/72185332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 msgr2=0x55b825e3ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e3ea10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2048009b70 tx=0x7f20480117b0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 -- 172.21.15.39:0/72185332 shutdown_connections 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e3ea10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 --2- 172.21.15.39:0/72185332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3fb40 0x55b825e3e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 -- 172.21.15.39:0/72185332 >> 172.21.15.39:0/72185332 conn(0x55b825e07310 msgr2=0x55b825e3ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 -- 172.21.15.39:0/72185332 shutdown_connections 2024-09-12T01:57:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.607+0000 7f2060b14740 1 -- 172.21.15.39:0/72185332 wait complete. 2024-09-12T01:57:59.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 -- start start 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 Processor -- start 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 0x55b825e45fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 0x55b825e46520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b825e4c070 con 0x55b825e3fb40 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b825d5f060 con 0x55b825e3e5d0 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b825e4c1f0 con 0x55b825e49370 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2060b14740 10 client.0 _ll_register_callbacks cb 0x55b825ab28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:59.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f2057fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 0x55b825e45fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.608+0000 7f205ccd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 0x55b825e46520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f205ccd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 0x55b825e46520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:59888/0 (socket says 172.21.15.39:59888) 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f205ccd8640 1 -- 172.21.15.39:0/3146366201 learned_addr learned my addr 172.21.15.39:0/3146366201 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 -- 172.21.15.39:0/3146366201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 msgr2=0x55b825e46520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 0x55b825e46520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 -- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 msgr2=0x55b825e48cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e48cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 -- 172.21.15.39:0/3146366201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b825b153c0 con 0x55b825e3fb40 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20577fe640 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 0x55b825e45fa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55b825e3f070 tx=0x7f204c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7277681833159e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.609+0000 7f20377fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c004950 con 0x55b825e3fb40 2024-09-12T01:57:59.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2048012930 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f204c004af0 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f204c004d30 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f2060b14740 10 client.15585 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b825e57af0 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.610+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048012930 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f204c03c4d0 con 0x55b825e3fb40 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 10 client.15585 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 10 client.15585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 20 client.15585 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825e59320 0x55b825e5b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 4 client.15585 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:57:59.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b825db1860 con 0x55b825e59320 2024-09-12T01:57:59.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.611+0000 7f2057fff640 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825e59320 0x55b825e5b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.612+0000 7f2057fff640 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825e59320 0x55b825e5b750 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18a89108e2f1e28c server_cookie=aa6415ecf829597a in_seq=0 out_seq=0 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.612+0000 7f20377fe640 10 client.15585 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f20377fe640 1 -- 172.21.15.39:0/3146366201 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b825db1860 con 0x55b825e59320 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f20377fe640 10 client.15585 handle_command_reply: tid=0 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 client.15585 shutdown 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 msgr2=0x55b825e45fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 0x55b825e45fa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55b825e3f070 tx=0x7f204c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 shutdown_connections 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825e59320 0x55b825e5b750 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e49370 0x55b825e46520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3fb40 0x55b825e45fa0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 --2- 172.21.15.39:0/3146366201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e3e5d0 0x55b825e48cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 >> 172.21.15.39:0/3146366201 conn(0x55b825e07310 msgr2=0x55b825e40960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.613+0000 7f20377fe640 0 client.15585 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:59.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.614+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 shutdown_connections 2024-09-12T01:57:59.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.614+0000 7f2060b14740 1 -- 172.21.15.39:0/3146366201 wait complete. 2024-09-12T01:57:59.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.614+0000 7f2060b14740 20 client.15585 trim_cache size 0 max 16384 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 Processor -- start 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 -- start start 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3e5d0 0x55b825e45f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e4a760 0x55b825e4abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20581b1f30 con 0x55b825e3e5d0 2024-09-12T01:57:59.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20581af800 con 0x55b825e49370 2024-09-12T01:57:59.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2060b14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20581ad650 con 0x55b825e4a760 2024-09-12T01:57:59.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f20577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f2057fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3e5d0 0x55b825e45f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.640+0000 7f20577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43294/0 (socket says 172.21.15.39:43294) 2024-09-12T01:57:59.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 -- 172.21.15.39:0/3208586368 learned_addr learned my addr 172.21.15.39:0/3208586368 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f205ccd8640 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e4a760 0x55b825e4abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 -- 172.21.15.39:0/3208586368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e4a760 msgr2=0x55b825e4abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e4a760 0x55b825e4abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 -- 172.21.15.39:0/3208586368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3e5d0 msgr2=0x55b825e45f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3e5d0 0x55b825e45f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 -- 172.21.15.39:0/3208586368 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b825e4b120 con 0x55b825e49370 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f20577fe640 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f204c009900 tx=0x7f204c009630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff44b1a1f0d5c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f203dffb640 1 -- 172.21.15.39:0/3208586368 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c03c440 con 0x55b825e49370 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f203dffb640 1 -- 172.21.15.39:0/3208586368 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204c03c5e0 con 0x55b825e49370 2024-09-12T01:57:59.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.641+0000 7f203dffb640 1 -- 172.21.15.39:0/3208586368 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c003850 con 0x55b825e49370 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 -- 172.21.15.39:0/3208586368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 msgr2=0x55b825e55310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f204c009900 tx=0x7f204c009630 comp rx=0 tx=0).stop 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 -- 172.21.15.39:0/3208586368 shutdown_connections 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e4a760 0x55b825e4abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e49370 0x55b825e55310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 --2- 172.21.15.39:0/3208586368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e3e5d0 0x55b825e45f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 -- 172.21.15.39:0/3208586368 >> 172.21.15.39:0/3208586368 conn(0x55b825e07310 msgr2=0x55b825e45860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 -- 172.21.15.39:0/3208586368 shutdown_connections 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.642+0000 7f2060b14740 1 -- 172.21.15.39:0/3208586368 wait complete. 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 -- start start 2024-09-12T01:57:59.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 Processor -- start 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3e5d0 0x55b825e51490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e4a760 0x55b825e4c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f20581adcc0 con 0x55b825e49370 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20581af130 con 0x55b825e4a760 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20581ae390 con 0x55b825e3e5d0 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.643+0000 7f2060b14740 10 client.0 _ll_register_callbacks cb 0x7f204c031af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35668/0 (socket says 172.21.15.39:35668) 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 -- 172.21.15.39:0/3771198559 learned_addr learned my addr 172.21.15.39:0/3771198559 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f2057fff640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3e5d0 0x55b825e51490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f205ccd8640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e4a760 0x55b825e4c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 -- 172.21.15.39:0/3771198559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3e5d0 msgr2=0x55b825e51490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3e5d0 0x55b825e51490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 -- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e4a760 msgr2=0x55b825e4c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:57:59.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e4a760 0x55b825e4c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 -- 172.21.15.39:0/3771198559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b825e4ca30 con 0x55b825e49370 2024-09-12T01:57:59.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20577fe640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f204c03ca60 tx=0x7f204c0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b959b585fbd4d60c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:57:59.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.644+0000 7f20377fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:57:59.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c03c440 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c03c5e0 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f204c0035f0 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f204c004b60 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f2060b14740 10 client.15591 fetch_fsmap learned FSMap version 25 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b825ecd120 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.645+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204c03c5e0 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f204c05d4e0 con 0x55b825e49370 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 10 client.15591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 20 client.15591 populate_metadata read hostname 'smithi039' 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825ecd700 0x55b825ecfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:57:59.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 4 client.15591 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b825dabd70 con 0x55b825ecd700 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2057fff640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825ecd700 0x55b825ecfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f20377fe640 10 client.15591 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.646+0000 7f2057fff640 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825ecd700 0x55b825ecfb20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84d2982e28c1db15 server_cookie=7d9b16e9ab9026ba in_seq=0 out_seq=0 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f20377fe640 1 -- 172.21.15.39:0/3771198559 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b825dabd70 con 0x55b825ecd700 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f20377fe640 10 client.15591 handle_command_reply: tid=0 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 client.15591 shutdown 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 msgr2=0x55b825e519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f204c03ca60 tx=0x7f204c0092d0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 shutdown_connections 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55b825ecd700 0x55b825ecfb20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b825e4a760 0x55b825e4c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b825e49370 0x55b825e519d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f20377fe640 0 client.15591 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 --2- 172.21.15.39:0/3771198559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b825e3e5d0 0x55b825e51490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.647+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 >> 172.21.15.39:0/3771198559 conn(0x55b825e07310 msgr2=0x55b825e47800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.648+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 shutdown_connections 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.648+0000 7f2060b14740 1 -- 172.21.15.39:0/3771198559 wait complete. 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.648+0000 7f2060b14740 20 client.15591 trim_cache size 0 max 16384 2024-09-12T01:57:59.651 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 msgr2=0x7f20400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 0x7f20400a50c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f204c000c00 tx=0x7f204c009260 comp rx=0 tx=0).stop 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 msgr2=0x7f205819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f205000cce0 tx=0x7f205000a620 comp rx=0 tx=0).stop 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 shutdown_connections 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2058106f10 0x7f205819cc70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2058102790 0x7f20581988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20400a2c00 0x7f20400a50c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 --2- 172.21.15.39:0/3395157157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2058101de0 0x7f20581983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:57:59.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 >> 172.21.15.39:0/3395157157 conn(0x7f20580fd8e0 msgr2=0x7f20580febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:57:59.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 shutdown_connections 2024-09-12T01:57:59.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:57:59.649+0000 7f205e73b640 1 -- 172.21.15.39:0/3395157157 wait complete. 2024-09-12T01:58:00.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:58:00.686 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:01.144 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:00 smithi039 ceph-mon[31204]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T01:58:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:00 smithi172 ceph-mon[35073]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 -- 172.21.15.39:0/2955149876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c100c80 msgr2=0x7f248c110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 --2- 172.21.15.39:0/2955149876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c100c80 0x7f248c110890 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2484009ca0 tx=0x7f248402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 -- 172.21.15.39:0/2955149876 shutdown_connections 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 --2- 172.21.15.39:0/2955149876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c100c80 0x7f248c110890 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 --2- 172.21.15.39:0/2955149876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 0x7f248c100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 --2- 172.21.15.39:0/2955149876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c102a50 0x7f248c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 -- 172.21.15.39:0/2955149876 >> 172.21.15.39:0/2955149876 conn(0x7f248c077230 msgr2=0x7f248c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 -- 172.21.15.39:0/2955149876 shutdown_connections 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.232+0000 7f2490c37640 1 -- 172.21.15.39:0/2955149876 wait complete. 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.233+0000 7f2490c37640 1 Processor -- start 2024-09-12T01:58:01.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.233+0000 7f2490c37640 1 -- start start 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.233+0000 7f2490c37640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 0x7f248c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.233+0000 7f2490c37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c100c80 0x7f248c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f2490c37640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f2490c37640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f248c114100 con 0x7f248c102a50 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f2490c37640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f248c113f80 con 0x7f248c100100 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f2490c37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f248c114280 con 0x7f248c100c80 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 0x7f248c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35682/0 (socket says 172.21.15.39:35682) 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 -- 172.21.15.39:0/1885348796 learned_addr learned my addr 172.21.15.39:0/1885348796 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f2489d9b640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c100c80 0x7f248c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 -- 172.21.15.39:0/1885348796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c100c80 msgr2=0x7f248c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c100c80 0x7f248c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 -- 172.21.15.39:0/1885348796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 msgr2=0x7f248c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 0x7f248c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.234+0000 7f248ad9d640 1 -- 172.21.15.39:0/1885348796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c19f4f0 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f248ad9d640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2484031a20 tx=0x7f2484031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f247b7fe640 1 -- 172.21.15.39:0/1885348796 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484003c30 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f247b7fe640 1 -- 172.21.15.39:0/1885348796 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2484003dd0 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f247b7fe640 1 -- 172.21.15.39:0/1885348796 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248402fc40 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c19f780 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.235+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c19fc00 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.238+0000 7f2493010740 1 Processor -- start 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f247b7fe640 1 -- 172.21.15.39:0/1885348796 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2484004050 con 0x7f248c102a50 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 -- start start 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561a09b192f0 con 0x561a09bbe370 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561a09ac0cf0 con 0x561a09bb4b40 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.239+0000 7f2493010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a09b152b0 con 0x561a09bb35d0 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35686/0 (socket says 172.21.15.39:35686) 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 -- 172.21.15.39:0/2979323221 learned_addr learned my addr 172.21.15.39:0/2979323221 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f248a59c640 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f247b7fe640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 0x7f24740a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 -- 172.21.15.39:0/2979323221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 msgr2=0x561a09bb3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 -- 172.21.15.39:0/2979323221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 msgr2=0x561a09bb3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bb3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 -- 172.21.15.39:0/2979323221 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a09aa53a0 con 0x561a09bbe370 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f247b7fe640 1 -- 172.21.15.39:0/1885348796 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f24840f00b0 con 0x7f248c102a50 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.240+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24800058c0 tx=0x7f2480005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4c69afe82fe4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.241+0000 7f248ad9d640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 0x7f24740a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.241+0000 7f248ad9d640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 0x7f24740a5190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f24840c5060 tx=0x7f248402f710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2478ff9640 1 -- 172.21.15.39:0/2979323221 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480004030 con 0x561a09bbe370 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2478ff9640 1 -- 172.21.15.39:0/2979323221 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f248000fca0 con 0x561a09bbe370 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2478ff9640 1 -- 172.21.15.39:0/2979323221 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480003a10 con 0x561a09bbe370 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 -- 172.21.15.39:0/2979323221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 msgr2=0x561a09bc0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f24800058c0 tx=0x7f2480005850 comp rx=0 tx=0).stop 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 -- 172.21.15.39:0/2979323221 shutdown_connections 2024-09-12T01:58:01.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bc0760 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.242+0000 7f2493010740 1 --2- 172.21.15.39:0/2979323221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bb3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- 172.21.15.39:0/2979323221 >> 172.21.15.39:0/2979323221 conn(0x561a09b7c310 msgr2=0x561a09bafc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- 172.21.15.39:0/2979323221 shutdown_connections 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- 172.21.15.39:0/2979323221 wait complete. 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- start start 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 Processor -- start 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bbddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bbb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561a09bc1070 con 0x561a09bbe370 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561a09ad4060 con 0x561a09bb4b40 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a09bc11f0 con 0x561a09bb35d0 2024-09-12T01:58:01.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.243+0000 7f2493010740 10 client.0 _ll_register_callbacks cb 0x561a098278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35700/0 (socket says 172.21.15.39:35700) 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 -- 172.21.15.39:0/2180105309 learned_addr learned my addr 172.21.15.39:0/2180105309 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bbddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 -- 172.21.15.39:0/2180105309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 msgr2=0x561a09bbddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bbddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 -- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 msgr2=0x561a09bbb070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bbb070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 -- 172.21.15.39:0/2180105309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a0988a3c0 con 0x561a09bbe370 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2489d9b640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2480009cd0 tx=0x7f24800035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e727f36e4335260 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.244+0000 7f2471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480005020 con 0x561a09bbe370 2024-09-12T01:58:01.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f248000fca0 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2480019040 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2480044050 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2493010740 10 client.15603 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.245+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a09bccb80 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f248000fca0 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24800039a0 con 0x561a09bbe370 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 10 client.15603 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 20 client.15603 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09bcded0 0x561a09bd02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 4 client.15603 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a09b26860 con 0x561a09bcded0 2024-09-12T01:58:01.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.246+0000 7f248a59c640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09bcded0 0x561a09bd02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.247+0000 7f248a59c640 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09bcded0 0x561a09bd02c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b04bcb71bf07eda server_cookie=34731d40913f2f3e in_seq=0 out_seq=0 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.247+0000 7f2471ffb640 10 client.15603 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2471ffb640 1 -- 172.21.15.39:0/2180105309 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a09b26860 con 0x561a09bcded0 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2471ffb640 10 client.15603 handle_command_reply: tid=0 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 client.15603 shutdown 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 msgr2=0x561a09bbb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2480009cd0 tx=0x7f24800035f0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 shutdown_connections 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09bcded0 0x561a09bd02c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bbe370 0x561a09bbb800 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09bb4b40 0x561a09bbb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 --2- 172.21.15.39:0/2180105309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bbddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 >> 172.21.15.39:0/2180105309 conn(0x561a09b7c310 msgr2=0x561a09bb5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.248+0000 7f2471ffb640 0 client.15603 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:01.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.249+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 shutdown_connections 2024-09-12T01:58:01.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.249+0000 7f2493010740 1 -- 172.21.15.39:0/2180105309 wait complete. 2024-09-12T01:58:01.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.249+0000 7f2493010740 20 client.15603 trim_cache size 0 max 16384 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 Processor -- start 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 -- start start 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb35d0 0x561a09bafe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bb6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1adbd0 con 0x561a09bb35d0 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1ab4a0 con 0x561a09baf130 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.262+0000 7f2493010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1a9330 con 0x561a09bb4b40 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:59950/0 (socket says 172.21.15.39:59950) 2024-09-12T01:58:01.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 -- 172.21.15.39:0/4015782087 learned_addr learned my addr 172.21.15.39:0/4015782087 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f2489d9b640 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb35d0 0x561a09bafe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 -- 172.21.15.39:0/4015782087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 msgr2=0x561a09bb6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f2489d9b640 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bb6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bb6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 -- 172.21.15.39:0/4015782087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb35d0 msgr2=0x561a09bafe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb35d0 0x561a09bafe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.263+0000 7f248a59c640 1 -- 172.21.15.39:0/4015782087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a09bbe130 con 0x561a09bb4b40 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.264+0000 7f248a59c640 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x561a09bb0ac0 tx=0x7f247c00a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a51e52ad3f152391 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.264+0000 7f2473fff640 1 -- 172.21.15.39:0/4015782087 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c01e020 con 0x561a09bb4b40 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.264+0000 7f2473fff640 1 -- 172.21.15.39:0/4015782087 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f247c0044d0 con 0x561a09bb4b40 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.264+0000 7f2473fff640 1 -- 172.21.15.39:0/4015782087 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c011730 con 0x561a09bb4b40 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- 172.21.15.39:0/4015782087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 msgr2=0x561a09baebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x561a09bb0ac0 tx=0x7f247c00a400 comp rx=0 tx=0).stop 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- 172.21.15.39:0/4015782087 shutdown_connections 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bb6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb4b40 0x561a09baebf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 --2- 172.21.15.39:0/4015782087 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb35d0 0x561a09bafe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- 172.21.15.39:0/4015782087 >> 172.21.15.39:0/4015782087 conn(0x561a09b7c310 msgr2=0x561a09bae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- 172.21.15.39:0/4015782087 shutdown_connections 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- 172.21.15.39:0/4015782087 wait complete. 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 -- start start 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.265+0000 7f2493010740 1 Processor -- start 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bc6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1a9980 con 0x561a09bb4b40 2024-09-12T01:58:01.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1aadd0 con 0x561a09baf130 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f248c1aa030 con 0x561a09bb35d0 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2493010740 10 client.0 _ll_register_callbacks cb 0x7f2480009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35716/0 (socket says 172.21.15.39:35716) 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 -- 172.21.15.39:0/813033284 learned_addr learned my addr 172.21.15.39:0/813033284 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bc6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 -- 172.21.15.39:0/813033284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 msgr2=0x561a09bb7db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb7db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 -- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 msgr2=0x561a09bc6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bc6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.266+0000 7f2489d9b640 1 -- 172.21.15.39:0/813033284 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a09bb8af0 con 0x561a09bb4b40 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2489d9b640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f24800117f0 tx=0x7f2480013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739fa2281c3a79a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:01.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480009b00 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f248000fce0 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f247c0044d0 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2480011030 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2493010740 10 client.15609 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.267+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a09c38980 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f247c0044d0 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2480004640 con 0x561a09bb4b40 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 10 client.15609 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 20 client.15609 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09c39020 0x561a09c3b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 4 client.15609 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:58:01.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.268+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a09b20d70 con 0x561a09c39020 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f248a59c640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09c39020 0x561a09c3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f248a59c640 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09c39020 0x561a09c3b440 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8db25f013d84a9 server_cookie=2eafe7dd027fd012 in_seq=0 out_seq=0 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2471ffb640 10 client.15609 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2471ffb640 1 -- 172.21.15.39:0/813033284 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a09b20d70 con 0x561a09c39020 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2471ffb640 10 client.15609 handle_command_reply: tid=0 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 client.15609 shutdown 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 msgr2=0x561a09bb82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f24800117f0 tx=0x7f2480013040 comp rx=0 tx=0).stop 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 shutdown_connections 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561a09c39020 0x561a09c3b440 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2471ffb640 0 client.15609 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561a09bb4b40 0x561a09bb82f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a09bb35d0 0x561a09bb7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 --2- 172.21.15.39:0/813033284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a09baf130 0x561a09bc6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.269+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 >> 172.21.15.39:0/813033284 conn(0x561a09b7c310 msgr2=0x561a09bbc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 shutdown_connections 2024-09-12T01:58:01.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2493010740 1 -- 172.21.15.39:0/813033284 wait complete. 2024-09-12T01:58:01.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2493010740 20 client.15609 trim_cache size 0 max 16384 2024-09-12T01:58:01.279 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 msgr2=0x7f24740a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 0x7f24740a5190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f24840c5060 tx=0x7f248402f710 comp rx=0 tx=0).stop 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 msgr2=0x7f248c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2484031a20 tx=0x7f2484031a50 comp rx=0 tx=0).stop 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 shutdown_connections 2024-09-12T01:58:01.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f248c102a50 0x7f248c19ee10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f24740a2cd0 0x7f24740a5190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f248c100c80 0x7f248c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 --2- 172.21.15.39:0/1885348796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f248c100100 0x7f248c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.270+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 >> 172.21.15.39:0/1885348796 conn(0x7f248c077230 msgr2=0x7f248c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.271+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 shutdown_connections 2024-09-12T01:58:01.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:01.271+0000 7f2490c37640 1 -- 172.21.15.39:0/1885348796 wait complete. 2024-09-12T01:58:01.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:00 smithi044 ceph-mon[35259]: pgmap v370: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-12T01:58:02.130 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:02.426 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.924+0000 7ff789c80640 1 -- 172.21.15.39:0/2951622819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7841082a0 msgr2=0x7ff78410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.924+0000 7ff789c80640 1 --2- 172.21.15.39:0/2951622819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7841082a0 0x7ff78410ec40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009cd0 tx=0x7ff77c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 -- 172.21.15.39:0/2951622819 shutdown_connections 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 --2- 172.21.15.39:0/2951622819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7841082a0 0x7ff78410ec40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 --2- 172.21.15.39:0/2951622819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841036e0 0x7ff784107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 --2- 172.21.15.39:0/2951622819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff784102d30 0x7ff784103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 -- 172.21.15.39:0/2951622819 >> 172.21.15.39:0/2951622819 conn(0x7ff7840fc7d0 msgr2=0x7ff7840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 -- 172.21.15.39:0/2951622819 shutdown_connections 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 -- 172.21.15.39:0/2951622819 wait complete. 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.925+0000 7ff789c80640 1 Processor -- start 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 -- start start 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7841036e0 0x7ff784198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841082a0 0x7ff78419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7841120a0 con 0x7ff784102d30 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff784111f20 con 0x7ff7841082a0 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff789c80640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff784112220 con 0x7ff7841036e0 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff7837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff7837fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44482/0 (socket says 172.21.15.39:44482) 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff7837fe640 1 -- 172.21.15.39:0/3993181403 learned_addr learned my addr 172.21.15.39:0/3993181403 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff782ffd640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7841036e0 0x7ff784198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.926+0000 7ff783fff640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841082a0 0x7ff78419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 -- 172.21.15.39:0/3993181403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7841036e0 msgr2=0x7ff784198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7841036e0 0x7ff784198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 -- 172.21.15.39:0/3993181403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841082a0 msgr2=0x7ff78419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841082a0 0x7ff78419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 -- 172.21.15.39:0/3993181403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78419d500 con 0x7ff784102d30 2024-09-12T01:58:02.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff7837fe640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff77400bd30 tx=0x7ff774009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774004220 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78419d7f0 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841008c0 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7740043c0 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.927+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774004a00 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.929+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff784103110 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.930+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff774004ba0 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.931+0000 7ff780ff9640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 0x7ff76c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.931+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff7740d2c50 con 0x7ff784102d30 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.931+0000 7ff782ffd640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 0x7ff76c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.932+0000 7ff782ffd640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 0x7ff76c0a5140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7840fedf0 tx=0x7ff77800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:02.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:02.939+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff77409f510 con 0x7ff784102d30 2024-09-12T01:58:02.994 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:58:02.994 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:58:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:02 smithi039 ceph-mon[31204]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T01:58:03.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:02 smithi172 ceph-mon[35073]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T01:58:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.317+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff78410a2b0 con 0x7ff784102d30 2024-09-12T01:58:03.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.318+0000 7ff780ff9640 1 -- 172.21.15.39:0/3993181403 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11908 (secure 0 0 0) 0x7ff7740a3810 con 0x7ff784102d30 2024-09-12T01:58:03.319 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:58:03.319 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"btime":"2024-09-12T01:56:54:336589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:56:54.025226+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:58:03.319 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 25 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.321+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 msgr2=0x7ff76c0a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.321+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 0x7ff76c0a5140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7840fedf0 tx=0x7ff77800b390 comp rx=0 tx=0).stop 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 msgr2=0x7ff784198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff77400bd30 tx=0x7ff774009610 comp rx=0 tx=0).stop 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 shutdown_connections 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7841082a0 0x7ff78419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff76c0a2c80 0x7ff76c0a5140 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7841036e0 0x7ff784198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 --2- 172.21.15.39:0/3993181403 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff784102d30 0x7ff784198550 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 >> 172.21.15.39:0/3993181403 conn(0x7ff7840fc7d0 msgr2=0x7ff784105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 shutdown_connections 2024-09-12T01:58:03.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:03.322+0000 7ff789c80640 1 -- 172.21.15.39:0/3993181403 wait complete. 2024-09-12T01:58:03.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:02 smithi044 ceph-mon[35259]: pgmap v371: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T01:58:03.979 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:03 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3993181403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:04.144 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:04.175 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --set-id f10eb086 --release --await' 2024-09-12T01:58:04.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --set-id f10eb086 --release --await 2024-09-12T01:58:04.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:03 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3993181403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:04.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:03 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3993181403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:04.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 -- 172.21.15.39:0/2483909870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc1082a0 msgr2=0x7f92fc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 --2- 172.21.15.39:0/2483909870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc1082a0 0x7f92fc10ec40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009cd0 tx=0x7f92f402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 -- 172.21.15.39:0/2483909870 shutdown_connections 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 --2- 172.21.15.39:0/2483909870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc1082a0 0x7f92fc10ec40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 --2- 172.21.15.39:0/2483909870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 --2- 172.21.15.39:0/2483909870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc102d30 0x7f92fc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 -- 172.21.15.39:0/2483909870 >> 172.21.15.39:0/2483909870 conn(0x7f92fc0fc7d0 msgr2=0x7f92fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 -- 172.21.15.39:0/2483909870 shutdown_connections 2024-09-12T01:58:04.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.690+0000 7f9302af8640 1 -- 172.21.15.39:0/2483909870 wait complete. 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.691+0000 7f9302af8640 1 Processor -- start 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 -- start start 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 0x7f92fc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1120a0 con 0x7f92fc102d30 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc111f20 con 0x7f92fc1036e0 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9302af8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc112220 con 0x7f92fc1082a0 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44508/0 (socket says 172.21.15.39:44508) 2024-09-12T01:58:04.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f92fbfff640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 -- 172.21.15.39:0/720557737 learned_addr learned my addr 172.21.15.39:0/720557737 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9301095640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 0x7f92fc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 -- 172.21.15.39:0/720557737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 msgr2=0x7f92fc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 0x7f92fc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 -- 172.21.15.39:0/720557737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 msgr2=0x7f92fc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9300894640 1 -- 172.21.15.39:0/720557737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc1a6a30 con 0x7f92fc102d30 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f9301095640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 0x7f92fc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.692+0000 7f92fbfff640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:04.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f9300894640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e9f0 tx=0x7f92f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f92f9ffb640 1 -- 172.21.15.39:0/720557737 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f000cd80 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1a6d20 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f92f9ffb640 1 -- 172.21.15.39:0/720557737 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f0005500 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f92f9ffb640 1 -- 172.21.15.39:0/720557737 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0010690 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.693+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1a7200 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.697+0000 7f9304ed1740 1 Processor -- start 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.697+0000 7f92f9ffb640 1 -- 172.21.15.39:0/720557737 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f92f00046c0 con 0x7f92fc102d30 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.697+0000 7f9304ed1740 1 -- start start 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.698+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bf9df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.698+0000 7f92f9ffb640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 0x7f92ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.698+0000 7f92f9ffb640 1 -- 172.21.15.39:0/720557737 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f92f00cf500 con 0x7f92fc102d30 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.698+0000 7f9300894640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 0x7f92ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bfa8d40 0x55726bfab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9304ed1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55726bf03280 con 0x55726bf9e480 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f92fbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f92fbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44520/0 (socket says 172.21.15.39:44520) 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f92fbfff640 1 -- 172.21.15.39:0/1058617 learned_addr learned my addr 172.21.15.39:0/1058617 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9300894640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 0x7f92ec0a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92f00981d0 tx=0x7f92f000cf20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55726beaab10 con 0x55726bf9db60 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.699+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55726beff240 con 0x55726bfa8d40 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f9301095640 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bf9df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 -- 172.21.15.39:0/1058617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bfa8d40 msgr2=0x55726bfab130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bfa8d40 0x55726bfab130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 -- 172.21.15.39:0/1058617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 msgr2=0x55726bf9df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bf9df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 -- 172.21.15.39:0/1058617 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726beb71f0 con 0x55726bf9e480 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92fbfff640 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f92e8010400 tx=0x7f92e80108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557d4223cf0ee8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.700+0000 7f92e6ffd640 1 -- 172.21.15.39:0/1058617 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8011760 con 0x55726bf9e480 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.701+0000 7f92e6ffd640 1 -- 172.21.15.39:0/1058617 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e8011de0 con 0x55726bf9e480 2024-09-12T01:58:04.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.701+0000 7f92e6ffd640 1 -- 172.21.15.39:0/1058617 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e801b3e0 con 0x55726bf9e480 2024-09-12T01:58:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 msgr2=0x55726bfa8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f92e8010400 tx=0x7f92e80108c0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 shutdown_connections 2024-09-12T01:58:04.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bfa8d40 0x55726bfab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bf9e480 0x55726bfa8800 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 --2- 172.21.15.39:0/1058617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bf9df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 >> 172.21.15.39:0/1058617 conn(0x55726bf9a0f0 msgr2=0x55726bf9a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 shutdown_connections 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.702+0000 7f9304ed1740 1 -- 172.21.15.39:0/1058617 wait complete. 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.703+0000 7f9304ed1740 1 -- start start 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.703+0000 7f9304ed1740 1 Processor -- start 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfa61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfa6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55726bfab910 con 0x55726bfa8d40 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55726bebdf10 con 0x55726bf9e480 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.704+0000 7f9304ed1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55726bfaba90 con 0x55726bf9db60 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f9304ed1740 10 client.0 _ll_register_callbacks cb 0x55726be86a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f9301095640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f92fbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfa61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f9301095640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50770/0 (socket says 172.21.15.39:50770) 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f9301095640 1 -- 172.21.15.39:0/2982925844 learned_addr learned my addr 172.21.15.39:0/2982925844 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.705+0000 7f9301095640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfa6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 -- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 msgr2=0x55726bfa61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfa61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 -- 172.21.15.39:0/2982925844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 msgr2=0x55726bfa6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfa6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 -- 172.21.15.39:0/2982925844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726bc746a0 con 0x55726bf9db60 2024-09-12T01:58:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f9301095640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009cd0 tx=0x7f92f4003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ded972c7b0a3b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f92dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f40305a0 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.706+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f92f4030740 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.707+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e8011de0 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.707+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92f4030940 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.707+0000 7f9304ed1740 10 client.25147 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.707+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55726bfb75d0 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.707+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f4036040 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.708+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f92f4030070 con 0x55726bf9db60 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 10 client.25147 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:04.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 10 client.25147 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 20 client.25147 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726bfb8a90 0x55726bfbae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 4 client.25147 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f92e8011de0 con 0x55726bfb8a90 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.709+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726bfb8a90 0x55726bfbae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.710+0000 7f92dbfff640 10 client.25147 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:04.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.710+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726bfb8a90 0x55726bfbae80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbcc0420af18e25d server_cookie=25dd9f9cdabde2e0 in_seq=0 out_seq=0 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.710+0000 7f92dbfff640 1 -- 172.21.15.39:0/2982925844 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f92e8011de0 con 0x55726bfb8a90 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.710+0000 7f92dbfff640 10 client.25147 handle_command_reply: tid=0 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.710+0000 7f9304ed1740 1 client.25147 shutdown 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 msgr2=0x55726bfa5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009cd0 tx=0x7f92f4003970 comp rx=0 tx=0).stop 2024-09-12T01:58:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 shutdown_connections 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726bfb8a90 0x55726bfbae80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfa6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfa61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2982925844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfa5c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 >> 172.21.15.39:0/2982925844 conn(0x55726bf9a0f0 msgr2=0x55726bf9fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f92dbfff640 0 client.25147 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 shutdown_connections 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.711+0000 7f9304ed1740 1 -- 172.21.15.39:0/2982925844 wait complete. 2024-09-12T01:58:04.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.712+0000 7f9304ed1740 20 client.25147 trim_cache size 0 max 16384 2024-09-12T01:58:04.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.747+0000 7f9304ed1740 1 Processor -- start 2024-09-12T01:58:04.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.747+0000 7f9304ed1740 1 -- start start 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.747+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bfa6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 0x55726bf99160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfc0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9304ed1740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1b1eb0 con 0x55726bfa8d40 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9304ed1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1af780 con 0x55726bf9db60 2024-09-12T01:58:04.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9304ed1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1ad680 con 0x55726bf9e480 2024-09-12T01:58:04.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9301095640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfc0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9301095640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfc0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44544/0 (socket says 172.21.15.39:44544) 2024-09-12T01:58:04.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9301095640 1 -- 172.21.15.39:0/2946879200 learned_addr learned my addr 172.21.15.39:0/2946879200 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f9301095640 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bfa6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.748+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 0x55726bf99160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 -- 172.21.15.39:0/2946879200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 msgr2=0x55726bfa6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bfa6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 -- 172.21.15.39:0/2946879200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 msgr2=0x55726bfc0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfc0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 -- 172.21.15.39:0/2946879200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55726bf95830 con 0x55726bf9e480 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 0x55726bf99160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92e8011010 tx=0x7f92e800b5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3278623631363a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92e67fc640 1 -- 172.21.15.39:0/2946879200 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e802e020 con 0x55726bf9e480 2024-09-12T01:58:04.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92e67fc640 1 -- 172.21.15.39:0/2946879200 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e8005040 con 0x55726bf9e480 2024-09-12T01:58:04.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.749+0000 7f92e67fc640 1 -- 172.21.15.39:0/2946879200 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80048c0 con 0x55726bf9e480 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 -- 172.21.15.39:0/2946879200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 msgr2=0x55726bf99160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 0x55726bf99160 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92e8011010 tx=0x7f92e800b5b0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 -- 172.21.15.39:0/2946879200 shutdown_connections 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfc0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9e480 0x55726bf99160 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2946879200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9db60 0x55726bfa6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.750+0000 7f9304ed1740 1 -- 172.21.15.39:0/2946879200 >> 172.21.15.39:0/2946879200 conn(0x55726bf9a0f0 msgr2=0x55726bf98a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.751+0000 7f9304ed1740 1 -- 172.21.15.39:0/2946879200 shutdown_connections 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.751+0000 7f9304ed1740 1 -- 172.21.15.39:0/2946879200 wait complete. 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.751+0000 7f9304ed1740 1 -- start start 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.751+0000 7f9304ed1740 1 Processor -- start 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.752+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfacbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.752+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.752+0000 7f9304ed1740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9301095640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfacbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f92fbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f92fbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42238/0 (socket says 172.21.15.39:42238) 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9301095640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfacbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50788/0 (socket says 172.21.15.39:50788) 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f92fbfff640 1 -- 172.21.15.39:0/2258641554 learned_addr learned my addr 172.21.15.39:0/2258641554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1adc40 con 0x55726bfa8d40 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1af0b0 con 0x55726bf9e480 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc1ae310 con 0x55726bf9db60 2024-09-12T01:58:04.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9301095640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.753+0000 7f9304ed1740 10 client.0 _ll_register_callbacks cb 0x7f92f0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 -- 172.21.15.39:0/2258641554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 msgr2=0x55726bfacbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfacbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 -- 172.21.15.39:0/2258641554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 msgr2=0x55726bfad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfad650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55726c022880 con 0x55726bf9e480 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92fbfff640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92e801a750 tx=0x7f92e801a840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e93f942ef55b429 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e801ae30 con 0x55726bf9e480 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f92e80051f0 con 0x55726bf9e480 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.754+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e8005040 con 0x55726bf9e480 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92e8005410 con 0x55726bf9e480 2024-09-12T01:58:04.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f9304ed1740 10 client.25238 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55726c023b20 con 0x55726bf9e480 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e80055b0 con 0x55726bf9e480 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f92e802b630 con 0x55726bf9e480 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.755+0000 7f9304ed1740 10 client.25238 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.756+0000 7f9304ed1740 10 client.25238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.756+0000 7f9304ed1740 20 client.25238 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.756+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726c024000 0x55726c026420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.756+0000 7f9304ed1740 4 client.25238 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:58:04.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.756+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f92e8005040 con 0x55726c024000 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.757+0000 7f9301095640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726c024000 0x55726c026420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.757+0000 7f92dbfff640 10 client.25238 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.757+0000 7f9301095640 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726c024000 0x55726c026420 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4dd7380da3e89c server_cookie=c64d2c2dcfed698c in_seq=0 out_seq=0 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.758+0000 7f92dbfff640 1 -- 172.21.15.39:0/2258641554 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f92e8005040 con 0x55726c024000 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.758+0000 7f92dbfff640 10 client.25238 handle_command_reply: tid=0 2024-09-12T01:58:04.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.758+0000 7f9304ed1740 1 client.25238 shutdown 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 msgr2=0x55726bfad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92e801a750 tx=0x7f92e801a840 comp rx=0 tx=0).stop 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 shutdown_connections 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55726c024000 0x55726c026420 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55726bfa8d40 0x55726bfad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f92dbfff640 0 client.25238 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55726bf9e480 0x55726bfad110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 --2- 172.21.15.39:0/2258641554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55726bf9db60 0x55726bfacbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.759+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 >> 172.21.15.39:0/2258641554 conn(0x55726bf9a0f0 msgr2=0x55726bf99270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.760+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 shutdown_connections 2024-09-12T01:58:04.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.760+0000 7f9304ed1740 1 -- 172.21.15.39:0/2258641554 wait complete. 2024-09-12T01:58:04.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.760+0000 7f9304ed1740 20 client.25238 trim_cache size 0 max 16384 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "4accf5af-974f-4574-ab32-ab774e612d82", 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:04.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.761+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 msgr2=0x7f92ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.761+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 0x7f92ec0a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92f00981d0 tx=0x7f92f000cf20 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.761+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 msgr2=0x7f92fc100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.761+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f92f000e9f0 tx=0x7f92f000edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.761+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 shutdown_connections 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f92ec0a2b80 0x7f92ec0a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc1082a0 0x7f92fc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92fc1036e0 0x7f92fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 --2- 172.21.15.39:0/720557737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92fc102d30 0x7f92fc100990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 >> 172.21.15.39:0/720557737 conn(0x7f92fc0fc7d0 msgr2=0x7f92fc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 shutdown_connections 2024-09-12T01:58:04.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:04.762+0000 7f9302af8640 1 -- 172.21.15.39:0/720557737 wait complete. 2024-09-12T01:58:04.764 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:04 smithi172 ceph-mon[35073]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:04 smithi172 ceph-mon[35073]: scrub queued for path: / 2024-09-12T01:58:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:04 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:04 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:58:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:04 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:04 smithi039 ceph-mon[31204]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:05.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:04 smithi039 ceph-mon[31204]: scrub queued for path: / 2024-09-12T01:58:05.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:04 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:04 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:58:05.302 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:04 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:04 smithi044 ceph-mon[35259]: pgmap v372: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:05.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:04 smithi044 ceph-mon[35259]: scrub queued for path: / 2024-09-12T01:58:05.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:04 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:04 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:58:05.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:04 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:05.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 -- 172.21.15.39:0/1670537182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c102570 msgr2=0x7f626c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 --2- 172.21.15.39:0/1670537182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c102570 0x7f626c1029b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6260009930 tx=0x7f626002a4d0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 -- 172.21.15.39:0/1670537182 shutdown_connections 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 --2- 172.21.15.39:0/1670537182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 --2- 172.21.15.39:0/1670537182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c102570 0x7f626c1029b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 --2- 172.21.15.39:0/1670537182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f626c100e20 0x7f626c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 -- 172.21.15.39:0/1670537182 >> 172.21.15.39:0/1670537182 conn(0x7f626c0fc7d0 msgr2=0x7f626c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 -- 172.21.15.39:0/1670537182 shutdown_connections 2024-09-12T01:58:06.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.094+0000 7f6271184640 1 -- 172.21.15.39:0/1670537182 wait complete. 2024-09-12T01:58:06.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.095+0000 7f6271184640 1 Processor -- start 2024-09-12T01:58:06.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 -- start start 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c100e20 0x7f626c10d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f626c102570 0x7f626c108a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f626b59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f626b59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44584/0 (socket says 172.21.15.39:44584) 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f626ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c100e20 0x7f626c10d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f626b59e640 1 -- 172.21.15.39:0/2384267198 learned_addr learned my addr 172.21.15.39:0/2384267198 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f626c06abc0 con 0x7f626c102ef0 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f626c06aa40 con 0x7f626c100e20 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.096+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f626c06ad40 con 0x7f626c102570 2024-09-12T01:58:06.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 -- 172.21.15.39:0/2384267198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f626c102570 msgr2=0x7f626c108a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f626c102570 0x7f626c108a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 -- 172.21.15.39:0/2384267198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c100e20 msgr2=0x7f626c10d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c100e20 0x7f626c10d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c1aaf00 con 0x7f626c102ef0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f626b59e640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f626400efd0 tx=0x7f626400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.097+0000 7f6253fff640 1 -- 172.21.15.39:0/2384267198 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264003b70 con 0x7f626c102ef0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.098+0000 7f6253fff640 1 -- 172.21.15.39:0/2384267198 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6264003d10 con 0x7f626c102ef0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.098+0000 7f6253fff640 1 -- 172.21.15.39:0/2384267198 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264010a90 con 0x7f626c102ef0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.098+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626c1ab0d0 con 0x7f626c102ef0 2024-09-12T01:58:06.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.098+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626c1ab530 con 0x7f626c102ef0 2024-09-12T01:58:06.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.102+0000 7f627355d740 1 Processor -- start 2024-09-12T01:58:06.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.102+0000 7f6253fff640 1 -- 172.21.15.39:0/2384267198 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6264003ec0 con 0x7f626c102ef0 2024-09-12T01:58:06.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.102+0000 7f627355d740 1 -- start start 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6ca240 0x5641ab6cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5641ab624620 con 0x5641ab6bf980 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5641ab5cbe50 con 0x5641ab6bf060 2024-09-12T01:58:06.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.104+0000 7f627355d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641ab6205e0 con 0x5641ab6ca240 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f626a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f626a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6ca240 0x5641ab6cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f6253fff640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 0x7f62540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f626a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6bf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42258/0 (socket says 172.21.15.39:42258) 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f626a59c640 1 -- 172.21.15.39:0/1056188774 learned_addr learned my addr 172.21.15.39:0/1056188774 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:06.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f6253fff640 1 -- 172.21.15.39:0/2384267198 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f62640cf460 con 0x7f626c102ef0 2024-09-12T01:58:06.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.105+0000 7f626ad9d640 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626b59e640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 0x7f62540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 -- 172.21.15.39:0/1056188774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6ca240 msgr2=0x5641ab6cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6ca240 0x5641ab6cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 -- 172.21.15.39:0/1056188774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 msgr2=0x5641ab6bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6bf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 -- 172.21.15.39:0/1056188774 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ab5bcd40 con 0x5641ab6bf980 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626b59e640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 0x7f62540a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6264009fd0 tx=0x7f6264010430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f626ad9d640 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6c9d00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c00 tx=0x7f625c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294f9d19ae68238b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.106+0000 7f62517fa640 1 -- 172.21.15.39:0/1056188774 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c004230 con 0x5641ab6bf980 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.107+0000 7f62517fa640 1 -- 172.21.15.39:0/1056188774 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625c0043d0 con 0x5641ab6bf980 2024-09-12T01:58:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.107+0000 7f62517fa640 1 -- 172.21.15.39:0/1056188774 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c004d90 con 0x5641ab6bf980 2024-09-12T01:58:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.107+0000 7f627355d740 1 -- 172.21.15.39:0/1056188774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 msgr2=0x5641ab6c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.107+0000 7f627355d740 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6c9d00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c00 tx=0x7f625c011810 comp rx=0 tx=0).stop 2024-09-12T01:58:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 -- 172.21.15.39:0/1056188774 shutdown_connections 2024-09-12T01:58:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6ca240 0x5641ab6cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6c9d00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 --2- 172.21.15.39:0/1056188774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 -- 172.21.15.39:0/1056188774 >> 172.21.15.39:0/1056188774 conn(0x5641ab6bb5f0 msgr2=0x5641ab6bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 -- 172.21.15.39:0/1056188774 shutdown_connections 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 -- 172.21.15.39:0/1056188774 wait complete. 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 -- start start 2024-09-12T01:58:06.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.108+0000 7f627355d740 1 Processor -- start 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 0x5641ab6c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5641ab6cce10 con 0x5641ab6ca240 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5641ab5acf10 con 0x5641ab6bf060 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641ab6ccf90 con 0x5641ab6bf980 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f626a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f626a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44600/0 (socket says 172.21.15.39:44600) 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 -- 172.21.15.39:0/689329181 learned_addr learned my addr 172.21.15.39:0/689329181 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.109+0000 7f627355d740 10 client.0 _ll_register_callbacks cb 0x5641ab5d0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:06.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626ad9d640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 0x5641ab6c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 -- 172.21.15.39:0/689329181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 msgr2=0x5641ab6c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 0x5641ab6c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 -- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 msgr2=0x5641ab6c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 -- 172.21.15.39:0/689329181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ab333580 con 0x5641ab6ca240 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626ad9d640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 0x5641ab6c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f626a59c640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6260033000 tx=0x7f6260000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118a2a82c5b1a683 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f624eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.110+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260035070 con 0x5641ab6ca240 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6260004460 con 0x5641ab6ca240 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625c0043d0 con 0x5641ab6ca240 2024-09-12T01:58:06.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62600035f0 con 0x5641ab6ca240 2024-09-12T01:58:06.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f627355d740 10 client.15645 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:06.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641ab3fd960 con 0x5641ab6ca240 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.111+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6260003c70 con 0x5641ab6ca240 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f626003a040 con 0x5641ab6ca240 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 10 client.15645 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 10 client.15645 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 20 client.15645 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab6dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 4 client.15645 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.112+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f625c0043d0 con 0x5641ab6d9cd0 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.113+0000 7f626ad9d640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab6dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.113+0000 7f626ad9d640 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab6dc100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3276df576e308a server_cookie=8f0c540e2895d452 in_seq=0 out_seq=0 2024-09-12T01:58:06.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.113+0000 7f624eff5640 10 client.15645 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f624eff5640 1 -- 172.21.15.39:0/689329181 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f625c0043d0 con 0x5641ab6d9cd0 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f624eff5640 10 client.15645 handle_command_reply: tid=0 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 client.15645 shutdown 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 msgr2=0x5641ab6c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6260033000 tx=0x7f6260000bc0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 shutdown_connections 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab6dc100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f624eff5640 0 client.15645 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6c7b90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf980 0x5641ab6c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 --2- 172.21.15.39:0/689329181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf060 0x5641ab6c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.114+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 >> 172.21.15.39:0/689329181 conn(0x5641ab6bb5f0 msgr2=0x5641ab6ba750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.115+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 shutdown_connections 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.115+0000 7f627355d740 1 -- 172.21.15.39:0/689329181 wait complete. 2024-09-12T01:58:06.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.115+0000 7f627355d740 20 client.15645 trim_cache size 0 max 16384 2024-09-12T01:58:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.134+0000 7f627355d740 1 Processor -- start 2024-09-12T01:58:06.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.134+0000 7f627355d740 1 -- start start 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.134+0000 7f627355d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.134+0000 7f627355d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.134+0000 7f627355d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6ca240 0x5641ab6e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f627355d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b6320 con 0x5641ab6bf980 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f627355d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b3bf0 con 0x5641ab6ca240 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f627355d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b1a40 con 0x5641ab6bf060 2024-09-12T01:58:06.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44604/0 (socket says 172.21.15.39:44604) 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 -- 172.21.15.39:0/803827717 learned_addr learned my addr 172.21.15.39:0/803827717 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626a59c640 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 -- 172.21.15.39:0/803827717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 msgr2=0x5641ab6c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 -- 172.21.15.39:0/803827717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6ca240 msgr2=0x5641ab6e1f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6ca240 0x5641ab6e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 -- 172.21.15.39:0/803827717 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ab6bf7b0 con 0x5641ab6bf980 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.135+0000 7f626ad9d640 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c00 tx=0x7f625c0098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e5755fcd656754 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.136+0000 7f6250ff9640 1 -- 172.21.15.39:0/803827717 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c032070 con 0x5641ab6bf980 2024-09-12T01:58:06.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.136+0000 7f6250ff9640 1 -- 172.21.15.39:0/803827717 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625c01f040 con 0x5641ab6bf980 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.136+0000 7f6250ff9640 1 -- 172.21.15.39:0/803827717 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c019470 con 0x5641ab6bf980 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 -- 172.21.15.39:0/803827717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 msgr2=0x5641ab6e19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f625c009c00 tx=0x7f625c0098f0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 -- 172.21.15.39:0/803827717 shutdown_connections 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6ca240 0x5641ab6e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6bf980 0x5641ab6e19d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 --2- 172.21.15.39:0/803827717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 -- 172.21.15.39:0/803827717 >> 172.21.15.39:0/803827717 conn(0x5641ab6bb5f0 msgr2=0x5641ab6c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 -- 172.21.15.39:0/803827717 shutdown_connections 2024-09-12T01:58:06.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.137+0000 7f627355d740 1 -- 172.21.15.39:0/803827717 wait complete. 2024-09-12T01:58:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.138+0000 7f627355d740 1 -- start start 2024-09-12T01:58:06.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.138+0000 7f627355d740 1 Processor -- start 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.138+0000 7f627355d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f627355d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f627355d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42284/0 (socket says 172.21.15.39:42284) 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6d24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50832/0 (socket says 172.21.15.39:50832) 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626ad9d640 1 -- 172.21.15.39:0/580279724 learned_addr learned my addr 172.21.15.39:0/580279724 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b20b0 con 0x5641ab6ca240 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b3520 con 0x5641ab6bf980 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1b2780 con 0x5641ab6bf060 2024-09-12T01:58:06.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.139+0000 7f626a59c640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 -- 172.21.15.39:0/580279724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 msgr2=0x5641ab6d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 -- 172.21.15.39:0/580279724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 msgr2=0x5641ab6cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ab6cfad0 con 0x5641ab6bf980 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626a59c640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:06.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f627355d740 10 client.0 _ll_register_callbacks cb 0x7f6260031980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625c01f040 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f626ad9d640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f625c000c00 tx=0x7f625c005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=233baf4339f099ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.140+0000 7f624eff5640 10 client.25253 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.141+0000 7f624eff5640 1 -- 172.21.15.39:0/580279724 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c03c050 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.141+0000 7f624eff5640 1 -- 172.21.15.39:0/580279724 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f625c0035f0 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.141+0000 7f624eff5640 1 -- 172.21.15.39:0/580279724 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f625c032070 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.141+0000 7f627355d740 10 client.25253 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.141+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5641ab745270 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f624eff5640 1 -- 172.21.15.39:0/580279724 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f625c024040 con 0x5641ab6bf980 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 10 client.25253 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 10 client.25253 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:58:06.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 20 client.25253 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab747760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 4 client.25253 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f10eb086", "release": true, "await": true}] 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f10eb086", "release": true, "await": true}) -- 0x5641ab631b90 con 0x5641ab6d9cd0 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f626a59c640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab747760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.142+0000 7f626a59c640 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab747760 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1115b7d30d5abe1 server_cookie=de8808a7efc3ed50 in_seq=0 out_seq=0 2024-09-12T01:58:06.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.143+0000 7f624eff5640 10 client.25253 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f624eff5640 1 -- 172.21.15.39:0/580279724 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5641ab631b90 con 0x5641ab6d9cd0 2024-09-12T01:58:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f624eff5640 10 client.25253 handle_command_reply: tid=0 2024-09-12T01:58:06.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 client.25253 shutdown 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 msgr2=0x5641ab6d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f625c000c00 tx=0x7f625c005d30 comp rx=0 tx=0).stop 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 shutdown_connections 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5641ab6d9cd0 0x5641ab747760 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f624eff5640 0 client.25253 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.144+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5641ab6ca240 0x5641ab6cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5641ab6bf980 0x5641ab6d2a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 1 --2- 172.21.15.39:0/580279724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641ab6bf060 0x5641ab6d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 >> 172.21.15.39:0/580279724 conn(0x5641ab6bb5f0 msgr2=0x5641ab6c0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 shutdown_connections 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 1 -- 172.21.15.39:0/580279724 wait complete. 2024-09-12T01:58:06.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.145+0000 7f627355d740 20 client.25253 trim_cache size 0 max 16384 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 25, 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 4, 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "f10eb086": { 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 4, 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T01:58:06.149 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 144.5, 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:06.150 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:06.151 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:06.151 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.147+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 msgr2=0x7f62540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.147+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 0x7f62540a50c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6264009fd0 tx=0x7f6264010430 comp rx=0 tx=0).stop 2024-09-12T01:58:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.147+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 msgr2=0x7f626c109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.147+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f626400efd0 tx=0x7f626400c6a0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 shutdown_connections 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f626c102ef0 0x7f626c109020 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f62540a2c00 0x7f62540a50c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f626c102570 0x7f626c108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 --2- 172.21.15.39:0/2384267198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f626c100e20 0x7f626c10d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 >> 172.21.15.39:0/2384267198 conn(0x7f626c0fc7d0 msgr2=0x7f626c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 shutdown_connections 2024-09-12T01:58:06.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:06.148+0000 7f6271184640 1 -- 172.21.15.39:0/2384267198 wait complete. 2024-09-12T01:58:06.386 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:06.921 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f10eb086', total seconds elapsed: 29.3 2024-09-12T01:58:07.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:06 smithi039 ceph-mon[31204]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:07.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:06 smithi172 ceph-mon[35073]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:07.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:06 smithi044 ceph-mon[35259]: pgmap v373: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:07.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 -- 172.21.15.39:0/1728617704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00781082a0 msgr2=0x7f007810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 --2- 172.21.15.39:0/1728617704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00781082a0 0x7f007810ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0070009c10 tx=0x7f007002a6f0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 -- 172.21.15.39:0/1728617704 shutdown_connections 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 --2- 172.21.15.39:0/1728617704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00781082a0 0x7f007810ec40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 --2- 172.21.15.39:0/1728617704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 --2- 172.21.15.39:0/1728617704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0078102d30 0x7f0078103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.511+0000 7f00801c4640 1 -- 172.21.15.39:0/1728617704 >> 172.21.15.39:0/1728617704 conn(0x7f00780fc7d0 msgr2=0x7f00780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.512+0000 7f00801c4640 1 -- 172.21.15.39:0/1728617704 shutdown_connections 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.512+0000 7f00801c4640 1 -- 172.21.15.39:0/1728617704 wait complete. 2024-09-12T01:58:07.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 Processor -- start 2024-09-12T01:58:07.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 -- start start 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0078102d30 0x7f00781985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00781082a0 0x7f007819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0078112050 con 0x7f00781082a0 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0078111ed0 con 0x7f0078102d30 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f00801c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00781121d0 con 0x7f00781036e0 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f007d75f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f007d75f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50848/0 (socket says 172.21.15.39:50848) 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.513+0000 7f007d75f640 1 -- 172.21.15.39:0/3590051358 learned_addr learned my addr 172.21.15.39:0/3590051358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007df60640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0078102d30 0x7f00781985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007e761640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00781082a0 0x7f007819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 -- 172.21.15.39:0/3590051358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0078102d30 msgr2=0x7f00781985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0078102d30 0x7f00781985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 -- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00781082a0 msgr2=0x7f007819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00781082a0 0x7f007819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 -- 172.21.15.39:0/3590051358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007819d5a0 con 0x7f00781036e0 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f007d75f640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f006800e9f0 tx=0x7f006800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f006effd640 1 -- 172.21.15.39:0/3590051358 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006800ccc0 con 0x7f00781036e0 2024-09-12T01:58:07.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007819d890 con 0x7f00781036e0 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f006effd640 1 -- 172.21.15.39:0/3590051358 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0068010910 con 0x7f00781036e0 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.514+0000 7f006effd640 1 -- 172.21.15.39:0/3590051358 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068018920 con 0x7f00781036e0 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.515+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00781a5170 con 0x7f00781036e0 2024-09-12T01:58:07.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 Processor -- start 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 -- start start 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f006effd640 1 -- 172.21.15.39:0/3590051358 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0068010ac0 con 0x7f00781036e0 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5576393172e0 con 0x5576393b1dc0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5576392bece0 con 0x5576393bc680 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.518+0000 7f008259d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5576393132a0 con 0x5576393b14a0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007d75f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007df60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50860/0 (socket says 172.21.15.39:50860) 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007d75f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393bea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:42304/0 (socket says 172.21.15.39:42304) 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 -- 172.21.15.39:0/1743818173 learned_addr learned my addr 172.21.15.39:0/1743818173 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 -- 172.21.15.39:0/1743818173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 msgr2=0x5576393bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 -- 172.21.15.39:0/1743818173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 msgr2=0x5576393bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393bc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007e761640 1 -- 172.21.15.39:0/1743818173 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576392a3440 con 0x5576393b14a0 2024-09-12T01:58:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.519+0000 7f007df60640 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f007e761640 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0070009c10 tx=0x7f0070009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a31eccd9e9c3a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f006effd640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 0x7f00640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f007df60640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 0x7f00640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f0063fff640 1 -- 172.21.15.39:0/1743818173 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070041030 con 0x5576393b14a0 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f006effd640 1 -- 172.21.15.39:0/3590051358 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00680cf410 con 0x7f00781036e0 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f0063fff640 1 -- 172.21.15.39:0/1743818173 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0070037040 con 0x5576393b14a0 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.520+0000 7f0063fff640 1 -- 172.21.15.39:0/1743818173 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070036040 con 0x5576393b14a0 2024-09-12T01:58:07.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 -- 172.21.15.39:0/1743818173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 msgr2=0x5576393b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0070009c10 tx=0x7f0070009300 comp rx=0 tx=0).stop 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f007df60640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 0x7f00640a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5576393ae890 tx=0x7f0074009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 -- 172.21.15.39:0/1743818173 shutdown_connections 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393bc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 --2- 172.21.15.39:0/1743818173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393b1880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.521+0000 7f008259d740 1 -- 172.21.15.39:0/1743818173 >> 172.21.15.39:0/1743818173 conn(0x5576393ada30 msgr2=0x5576393ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.522+0000 7f008259d740 1 -- 172.21.15.39:0/1743818173 shutdown_connections 2024-09-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.522+0000 7f008259d740 1 -- 172.21.15.39:0/1743818173 wait complete. 2024-09-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.522+0000 7f008259d740 1 -- start start 2024-09-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.522+0000 7f008259d740 1 Processor -- start 2024-09-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.522+0000 7f008259d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393b14a0 0x5576393bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b1dc0 0x5576393b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5576393c3660 con 0x5576393bc680 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5576392d2050 con 0x5576393b14a0 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5576393c37e0 con 0x5576393b1dc0 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f008259d740 10 client.0 _ll_register_callbacks cb 0x557639312160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44656/0 (socket says 172.21.15.39:44656) 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 -- 172.21.15.39:0/2512517090 learned_addr learned my addr 172.21.15.39:0/2512517090 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007d75f640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b1dc0 0x5576393b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 -- 172.21.15.39:0/2512517090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b1dc0 msgr2=0x5576393b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b1dc0 0x5576393b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 -- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393b14a0 msgr2=0x5576393bc000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393b14a0 0x5576393bc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 -- 172.21.15.39:0/2512517090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576390883c0 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f007e761640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0070005cc0 tx=0x7f007002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d21daeb3edec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.523+0000 7f00617fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070041040 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00700306e0 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0070037040 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0070036040 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f008259d740 10 client.15663 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.524+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576393cf050 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0070037040 con 0x5576393bc680 2024-09-12T01:58:07.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f007003c040 con 0x5576393bc680 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 10 client.15663 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 20 client.15663 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5576393d03a0 0x5576393d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 4 client.15663 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.525+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557639324850 con 0x5576393d03a0 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.526+0000 7f007df60640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5576393d03a0 0x5576393d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.526+0000 7f00617fa640 10 client.15663 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.526+0000 7f007df60640 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5576393d03a0 0x5576393d2790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0db2112a16e789 server_cookie=92f3c68db9147154 in_seq=0 out_seq=0 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.527+0000 7f00617fa640 1 -- 172.21.15.39:0/2512517090 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557639324850 con 0x5576393d03a0 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.527+0000 7f00617fa640 10 client.15663 handle_command_reply: tid=0 2024-09-12T01:58:07.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.527+0000 7f008259d740 1 client.15663 shutdown 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.527+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 msgr2=0x5576393b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.527+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0070005cc0 tx=0x7f007002a6f0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 shutdown_connections 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5576393d03a0 0x5576393d2790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f00617fa640 0 client.15663 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393bc680 0x5576393b9830 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b1dc0 0x5576393b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 --2- 172.21.15.39:0/2512517090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393b14a0 0x5576393bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 >> 172.21.15.39:0/2512517090 conn(0x5576393ada30 msgr2=0x5576393acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 shutdown_connections 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 1 -- 172.21.15.39:0/2512517090 wait complete. 2024-09-12T01:58:07.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.528+0000 7f008259d740 20 client.15663 trim_cache size 0 max 16384 2024-09-12T01:58:07.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 Processor -- start 2024-09-12T01:58:07.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 -- start start 2024-09-12T01:58:07.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393bb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393d5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ade30 con 0x5576393b1dc0 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ab700 con 0x5576393bc680 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f008259d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00781a9550 con 0x5576393b14a0 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.563+0000 7f007d75f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007e761640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393d5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007d75f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44662/0 (socket says 172.21.15.39:44662) 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007d75f640 1 -- 172.21.15.39:0/3718373924 learned_addr learned my addr 172.21.15.39:0/3718373924 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 -- 172.21.15.39:0/3718373924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 msgr2=0x5576393d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393d5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 -- 172.21.15.39:0/3718373924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 msgr2=0x5576393d57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 -- 172.21.15.39:0/3718373924 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576393b12d0 con 0x5576393b14a0 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007e761640 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393d5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007d75f640 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.564+0000 7f007df60640 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393bb220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5576393ba420 tx=0x7f007401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4313eb419525d0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.565+0000 7f00637fe640 1 -- 172.21.15.39:0/3718373924 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074003ac0 con 0x5576393b14a0 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.565+0000 7f00637fe640 1 -- 172.21.15.39:0/3718373924 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557639324850 con 0x5576393b14a0 2024-09-12T01:58:07.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.565+0000 7f00637fe640 1 -- 172.21.15.39:0/3718373924 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074020690 con 0x5576393b14a0 2024-09-12T01:58:07.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- 172.21.15.39:0/3718373924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 msgr2=0x5576393bb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393bb220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5576393ba420 tx=0x7f007401a000 comp rx=0 tx=0).stop 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- 172.21.15.39:0/3718373924 shutdown_connections 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x5576393d5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x5576393d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 --2- 172.21.15.39:0/3718373924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5576393b14a0 0x5576393bb220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- 172.21.15.39:0/3718373924 >> 172.21.15.39:0/3718373924 conn(0x5576393ada30 msgr2=0x5576393bab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- 172.21.15.39:0/3718373924 shutdown_connections 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- 172.21.15.39:0/3718373924 wait complete. 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 -- start start 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.566+0000 7f008259d740 1 Processor -- start 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x55763942f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55763942f790 0x557639439cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00781a9bc0 con 0x5576393b1dc0 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ab030 con 0x5576393bc680 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00781aa290 con 0x55763942f790 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f008259d740 10 client.0 _ll_register_callbacks cb 0x7f0074009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f007df60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f007df60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44678/0 (socket says 172.21.15.39:44678) 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f007df60640 1 -- 172.21.15.39:0/3428227304 learned_addr learned my addr 172.21.15.39:0/3428227304 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f007d75f640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x55763942f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.567+0000 7f007e761640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55763942f790 0x557639439cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 -- 172.21.15.39:0/3428227304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55763942f790 msgr2=0x557639439cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55763942f790 0x557639439cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 -- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 msgr2=0x55763942f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x55763942f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 -- 172.21.15.39:0/3428227304 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576393ae6c0 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007d75f640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x55763942f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f007df60640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0074009a10 tx=0x7f0074029dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22c3ac1e2ddaa27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f00617fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074003e40 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0074029330 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.568+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557639324850 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0074029530 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 10 client.15669 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55763943b5a0 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0074035070 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00740049f0 con 0x5576393b1dc0 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 10 client.15669 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:07.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 20 client.15669 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55763943bc00 0x55763943dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 4 client.15669 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.569+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557639324850 con 0x55763943bc00 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f007d75f640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55763943bc00 0x55763943dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f007d75f640 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55763943bc00 0x55763943dff0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8317d4e616d78e7f server_cookie=d8e0edd9cabebdf8 in_seq=0 out_seq=0 2024-09-12T01:58:07.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f00617fa640 10 client.15669 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f00617fa640 1 -- 172.21.15.39:0/3428227304 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557639324850 con 0x55763943bc00 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f00617fa640 10 client.15669 handle_command_reply: tid=0 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f008259d740 1 client.15669 shutdown 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 msgr2=0x55763942ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.570+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0074009a10 tx=0x7f0074029dc0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 shutdown_connections 2024-09-12T01:58:07.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55763943bc00 0x55763943dff0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55763942f790 0x557639439cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5576393bc680 0x55763942f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 --2- 172.21.15.39:0/3428227304 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5576393b1dc0 0x55763942ec70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 >> 172.21.15.39:0/3428227304 conn(0x5576393ada30 msgr2=0x5576393b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f00617fa640 0 client.15669 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 shutdown_connections 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 1 -- 172.21.15.39:0/3428227304 wait complete. 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f008259d740 20 client.15669 trim_cache size 0 max 16384 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:58:07.575 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: "4accf5af-974f-4574-ab32-ab774e612d82": { 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "4accf5af-974f-4574-ab32-ab774e612d82", 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:07.576 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.571+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 msgr2=0x7f00640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 0x7f00640a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5576393ae890 tx=0x7f0074009260 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 msgr2=0x7f0078198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f006800e9f0 tx=0x7f006800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 shutdown_connections 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00781082a0 0x7f007819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f00640a2b80 0x7f00640a5040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00781036e0 0x7f0078198b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 --2- 172.21.15.39:0/3590051358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0078102d30 0x7f00781985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 >> 172.21.15.39:0/3590051358 conn(0x7f00780fc7d0 msgr2=0x7f0078105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 shutdown_connections 2024-09-12T01:58:07.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:07.572+0000 7f00801c4640 1 -- 172.21.15.39:0/3590051358 wait complete. 2024-09-12T01:58:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 -- 172.21.15.39:0/217242458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 msgr2=0x7f2540108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 --2- 172.21.15.39:0/217242458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f2540108e80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2538009ca0 tx=0x7f253802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 -- 172.21.15.39:0/217242458 shutdown_connections 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 --2- 172.21.15.39:0/217242458 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f2540108e80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 --2- 172.21.15.39:0/217242458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 0x7f25401020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 --2- 172.21.15.39:0/217242458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f2540100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 -- 172.21.15.39:0/217242458 >> 172.21.15.39:0/217242458 conn(0x7f25400fc1e0 msgr2=0x7f25400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 -- 172.21.15.39:0/217242458 shutdown_connections 2024-09-12T01:58:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.907+0000 7f2545713640 1 -- 172.21.15.39:0/217242458 wait complete. 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.908+0000 7f2545713640 1 Processor -- start 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.908+0000 7f2545713640 1 -- start start 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 0x7f254019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f254019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f254010c6c0 con 0x7f25401025f0 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f254010c540 con 0x7f2540101c30 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f2545713640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f254010c840 con 0x7f2540100a40 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50904/0 (socket says 172.21.15.39:50904) 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 -- 172.21.15.39:0/4161606514 learned_addr learned my addr 172.21.15.39:0/4161606514 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253f7fe640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f254019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253e7fc640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 0x7f254019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 -- 172.21.15.39:0/4161606514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 msgr2=0x7f254019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 0x7f254019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.909+0000 7f253effd640 1 -- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 msgr2=0x7f254019f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f253effd640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f254019f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f253effd640 1 -- 172.21.15.39:0/4161606514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25401968b0 con 0x7f2540100a40 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f253f7fe640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f254019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f253effd640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f253000d950 tx=0x7f253000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f2527fff640 1 -- 172.21.15.39:0/4161606514 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530017070 con 0x7f2540100a40 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f2527fff640 1 -- 172.21.15.39:0/4161606514 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2530009c30 con 0x7f2540100a40 2024-09-12T01:58:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f2527fff640 1 -- 172.21.15.39:0/4161606514 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253000f620 con 0x7f2540100a40 2024-09-12T01:58:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2540196b40 con 0x7f2540100a40 2024-09-12T01:58:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.910+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2540197040 con 0x7f2540100a40 2024-09-12T01:58:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.914+0000 7f25484a3740 1 Processor -- start 2024-09-12T01:58:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.914+0000 7f25484a3740 1 -- start start 2024-09-12T01:58:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.914+0000 7f2527fff640 1 -- 172.21.15.39:0/4161606514 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f253001a070 con 0x7f2540100a40 2024-09-12T01:58:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.914+0000 7f25484a3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e93dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e93dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f25484a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e942da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e93dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44702/0 (socket says 172.21.15.39:44702) 2024-09-12T01:58:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f25484a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e945830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f2527fff640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 0x7f25280a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253f7fe640 1 -- 172.21.15.39:0/1842205906 learned_addr learned my addr 172.21.15.39:0/1842205906 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253effd640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e942da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56127e8a12f0 con 0x56127e93d9a0 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56127e849270 con 0x56127e93e2e0 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56127e89d2b0 con 0x56127e943370 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e945830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f2527fff640 1 -- 172.21.15.39:0/4161606514 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f25300ce9f0 con 0x7f2540100a40 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253f7fe640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 0x7f25280a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 -- 172.21.15.39:0/1842205906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 msgr2=0x56127e942da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e942da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 -- 172.21.15.39:0/1842205906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 msgr2=0x56127e93dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e93dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253e7fc640 1 -- 172.21.15.39:0/1842205906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127e848340 con 0x56127e943370 2024-09-12T01:58:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.915+0000 7f253effd640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e942da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.916+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e945830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2534005d00 tx=0x7f253400bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c75c06bdb8131a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.916+0000 7f253f7fe640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 0x7f25280a5170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2538009ca0 tx=0x7f253802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.916+0000 7f25257fa640 1 -- 172.21.15.39:0/1842205906 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534024070 con 0x56127e943370 2024-09-12T01:58:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.916+0000 7f25257fa640 1 -- 172.21.15.39:0/1842205906 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f253400ddd0 con 0x56127e943370 2024-09-12T01:58:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.916+0000 7f25257fa640 1 -- 172.21.15.39:0/1842205906 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253401fdd0 con 0x56127e943370 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 msgr2=0x56127e945830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e945830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2534005d00 tx=0x7f253400bbe0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 shutdown_connections 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e945830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e942da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 --2- 172.21.15.39:0/1842205906 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e93dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 >> 172.21.15.39:0/1842205906 conn(0x56127e939010 msgr2=0x56127e939410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 shutdown_connections 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- 172.21.15.39:0/1842205906 wait complete. 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 -- start start 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.917+0000 7f25484a3740 1 Processor -- start 2024-09-12T01:58:07.920 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e947bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 0x56127e94f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56127e946340 con 0x56127e93d9a0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56127e82a290 con 0x56127e943370 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56127e9464c0 con 0x56127e93e2e0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e947bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f25484a3740 10 client.0 _ll_register_callbacks cb 0x56127e85b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50920/0 (socket says 172.21.15.39:50920) 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253e7fc640 1 -- 172.21.15.39:0/1902471082 learned_addr learned my addr 172.21.15.39:0/1902471082 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253f7fe640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 0x56127e94f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 -- 172.21.15.39:0/1902471082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 msgr2=0x56127e948110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.921 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 -- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 msgr2=0x56127e94f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 0x56127e94f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253effd640 1 -- 172.21.15.39:0/1902471082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127e5b4210 con 0x56127e93d9a0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.918+0000 7f253f7fe640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 0x56127e94f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f253effd640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e947bd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x56127e93ed10 tx=0x7f25300907f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65ff711b32e1768 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f2522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253009b310 con 0x56127e93d9a0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2530097980 con 0x56127e93d9a0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253400ddd0 con 0x56127e93d9a0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f253006a0d0 con 0x56127e93d9a0 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f25484a3740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:07.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56127e680620 con 0x56127e93d9a0 2024-09-12T01:58:07.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.919+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f253009f610 con 0x56127e93d9a0 2024-09-12T01:58:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f253009f160 con 0x56127e93d9a0 2024-09-12T01:58:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 20 client.15681 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9537b0 0x56127e955ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 4 client.15681 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.920+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f253400ddd0 con 0x56127e9537b0 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.921+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9537b0 0x56127e955ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.921+0000 7f2522ff5640 10 client.15681 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.921+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9537b0 0x56127e955ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52026a5af159980 server_cookie=4c45ee15d50d694 in_seq=0 out_seq=0 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f2522ff5640 1 -- 172.21.15.39:0/1902471082 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f253400ddd0 con 0x56127e9537b0 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f2522ff5640 10 client.15681 handle_command_reply: tid=0 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 client.15681 shutdown 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 msgr2=0x56127e947bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e947bd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x56127e93ed10 tx=0x7f25300907f0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 shutdown_connections 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9537b0 0x56127e955ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e943370 0x56127e94f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f2522ff5640 0 client.15681 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e93e2e0 0x56127e948110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 --2- 172.21.15.39:0/1902471082 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e93d9a0 0x56127e947bd0 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x56127e93ed10 tx=0x7f25300907f0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 >> 172.21.15.39:0/1902471082 conn(0x56127e939010 msgr2=0x56127e93a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 shutdown_connections 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.922+0000 7f25484a3740 1 -- 172.21.15.39:0/1902471082 wait complete. 2024-09-12T01:58:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.923+0000 7f25484a3740 20 client.15681 trim_cache size 0 max 16384 2024-09-12T01:58:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 Processor -- start 2024-09-12T01:58:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 -- start start 2024-09-12T01:58:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e9481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e947130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a9530 con 0x56127e9537b0 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a6e00 con 0x56127e93e2e0 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f25484a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a4c50 con 0x56127e943370 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f253f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44718/0 (socket says 172.21.15.39:44718) 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e947130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f253f7fe640 1 -- 172.21.15.39:0/3370872744 learned_addr learned my addr 172.21.15.39:0/3370872744 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.938+0000 7f253effd640 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e9481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 -- 172.21.15.39:0/3370872744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 msgr2=0x56127e947130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e947130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 -- 172.21.15.39:0/3370872744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 msgr2=0x56127e9481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.939 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e9481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.940 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 -- 172.21.15.39:0/3370872744 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127e945c40 con 0x56127e9537b0 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f253f7fe640 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2538009c40 tx=0x7f2538045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eff9a5ba1e0c894 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f2524ff9640 1 -- 172.21.15.39:0/3370872744 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538030880 con 0x56127e9537b0 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f2524ff9640 1 -- 172.21.15.39:0/3370872744 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2538036040 con 0x56127e9537b0 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.939+0000 7f2524ff9640 1 -- 172.21.15.39:0/3370872744 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538054d00 con 0x56127e9537b0 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 -- 172.21.15.39:0/3370872744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 msgr2=0x56127e94f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2538009c40 tx=0x7f2538045000 comp rx=0 tx=0).stop 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 -- 172.21.15.39:0/3370872744 shutdown_connections 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e9537b0 0x56127e94f110 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e943370 0x56127e947130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 --2- 172.21.15.39:0/3370872744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e9481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 -- 172.21.15.39:0/3370872744 >> 172.21.15.39:0/3370872744 conn(0x56127e939010 msgr2=0x56127e9379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 -- 172.21.15.39:0/3370872744 shutdown_connections 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.940+0000 7f25484a3740 1 -- 172.21.15.39:0/3370872744 wait complete. 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 -- start start 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 Processor -- start 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e94c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 0x56127e94db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a52c0 con 0x56127e943370 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a6730 con 0x56127e93e2e0 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25401a5990 con 0x56127e9537b0 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f25484a3740 10 client.0 _ll_register_callbacks cb 0x7f253009b1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44724/0 (socket says 172.21.15.39:44724) 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 -- 172.21.15.39:0/1543805827 learned_addr learned my addr 172.21.15.39:0/1543805827 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253effd640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e94c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253f7fe640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 0x56127e94db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 -- 172.21.15.39:0/1543805827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 msgr2=0x56127e94db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 0x56127e94db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 -- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 msgr2=0x56127e94c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e94c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.941+0000 7f253e7fc640 1 -- 172.21.15.39:0/1543805827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127e94e130 con 0x56127e943370 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f253f7fe640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 0x56127e94db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f253e7fc640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f253401f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0796d5b0611df1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f2522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534024040 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f253400dc80 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2538036040 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f253400dea0 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f25484a3740 10 client.15687 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56127e9be460 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.942+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2534025040 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f253401f830 con 0x56127e943370 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 10 client.15687 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 20 client.15687 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9bea10 0x56127e9c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 4 client.15687 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2538036040 con 0x56127e9bea10 2024-09-12T01:58:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f253effd640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9bea10 0x56127e9c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f253effd640 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9bea10 0x56127e9c0e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ce7aebc6965647a server_cookie=a1008d7952908250 in_seq=0 out_seq=0 2024-09-12T01:58:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.943+0000 7f2522ff5640 10 client.15687 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f2522ff5640 1 -- 172.21.15.39:0/1543805827 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2538036040 con 0x56127e9bea10 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f2522ff5640 10 client.15687 handle_command_reply: tid=0 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 client.15687 shutdown 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 msgr2=0x56127e94cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2534000c00 tx=0x7f253401f570 comp rx=0 tx=0).stop 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 shutdown_connections 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56127e9bea10 0x56127e9c0e00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f2522ff5640 0 client.15687 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56127e9537b0 0x56127e94db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56127e943370 0x56127e94cb10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 --2- 172.21.15.39:0/1543805827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56127e93e2e0 0x56127e94c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 >> 172.21.15.39:0/1543805827 conn(0x56127e939010 msgr2=0x56127e9379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 shutdown_connections 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 1 -- 172.21.15.39:0/1543805827 wait complete. 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.947+0000 7f25484a3740 20 client.15687 trim_cache size 0 max 16384 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:58:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:58:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 msgr2=0x7f25280a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 0x7f25280a5170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2538009ca0 tx=0x7f253802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 msgr2=0x7f254006a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f253000d950 tx=0x7f253000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 shutdown_connections 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f25401025f0 0x7f254019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2540101c30 0x7f254019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f25280a2cb0 0x7f25280a5170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 --2- 172.21.15.39:0/4161606514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2540100a40 0x7f254006a410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 >> 172.21.15.39:0/4161606514 conn(0x7f25400fc1e0 msgr2=0x7f2540104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 shutdown_connections 2024-09-12T01:58:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:07.948+0000 7f2545713640 1 -- 172.21.15.39:0/4161606514 wait complete. 2024-09-12T01:58:08.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:07 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:58:08.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:07 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:58:08.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:07 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:58:08.428 INFO:tasks.cephfs.filesystem:scrub status for tag:4accf5af-974f-4574-ab32-ab774e612d82 - {'path': '/', 'tag': '4accf5af-974f-4574-ab32-ab774e612d82', 'options': 'recursive,force'} 2024-09-12T01:58:09.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:08 smithi039 ceph-mon[31204]: pgmap v374: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T01:58:09.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:08 smithi172 ceph-mon[35073]: pgmap v374: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T01:58:09.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:08 smithi044 ceph-mon[35259]: pgmap v374: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-12T01:58:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:10 smithi172 ceph-mon[35073]: pgmap v375: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T01:58:11.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:10 smithi039 ceph-mon[31204]: pgmap v375: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T01:58:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:10 smithi044 ceph-mon[35259]: pgmap v375: 97 pgs: 97 active+clean; 662 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T01:58:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:13 smithi172 ceph-mon[35073]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:13.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:13 smithi039 ceph-mon[31204]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:13.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:13 smithi044 ceph-mon[35259]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:15.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:15 smithi039 ceph-mon[31204]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:15 smithi044 ceph-mon[35259]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:15.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:15 smithi172 ceph-mon[35073]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:16.040 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 93% (12110/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.407 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:16.408 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T01:58:16.413 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:58:16.572 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:58:16.575 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:58:16.575 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:58:17.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:17 smithi172 ceph-mon[35073]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:17.310 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:58:17.390 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:58:17.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:17 smithi039 ceph-mon[31204]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:17.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:17 smithi044 ceph-mon[35259]: pgmap v378: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T01:58:17.432 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:58:17.434 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:58:17.434 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:58:17.477 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:58:17.480 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T01:58:17.480 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:58:17.497 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-12T01:58:17.500 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-12T01:58:17.501 DEBUG:teuthology.orchestra.run.smithi039:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-12T01:58:17.560 INFO:tasks.workunit.client.0.smithi039.stderr:+ set -e 2024-09-12T01:58:17.561 INFO:tasks.workunit.client.0.smithi039.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-12T01:58:17.562 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into 'xfstests-dev'... 2024-09-12T01:58:19.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:19 smithi039 ceph-mon[31204]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:19.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:19.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:19.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:19 smithi044 ceph-mon[35259]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:19.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:19 smithi172 ceph-mon[35073]: pgmap v379: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:19.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:58:19.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:19.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:20.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:20.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:20.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:20.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:20.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:58:20.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:58:20.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/1799225975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 msgr2=0x7f6ea8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/1799225975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8100e40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009900 tx=0x7f6ea402a410 comp rx=0 tx=0).stop 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/1799225975 shutdown_connections 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/1799225975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 0x7f6ea8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/1799225975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 0x7f6ea81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/1799225975 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8100e40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/1799225975 >> 172.21.15.39:0/1799225975 conn(0x7f6ea80fc1e0 msgr2=0x7f6ea80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/1799225975 shutdown_connections 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.047+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/1799225975 wait complete. 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 Processor -- start 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 -- start start 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 0x7f6ea8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 0x7f6ea819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810d810 con 0x7f6ea8100a40 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810d690 con 0x7f6ea81025f0 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eaf2f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea810d990 con 0x7f6ea8101c30 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.051 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44440/0 (socket says 172.21.15.39:44440) 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 -- 172.21.15.39:0/2164482848 learned_addr learned my addr 172.21.15.39:0/2164482848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead88e640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 0x7f6ea819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6eac88c640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 0x7f6ea8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 -- 172.21.15.39:0/2164482848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 msgr2=0x7f6ea8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 0x7f6ea8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 -- 172.21.15.39:0/2164482848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 msgr2=0x7f6ea819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 0x7f6ea819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.048+0000 7f6ead08d640 1 -- 172.21.15.39:0/2164482848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea819fa40 con 0x7f6ea8100a40 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6ead08d640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4031610 tx=0x7f6ea40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6e9e7fc640 1 -- 172.21.15.39:0/2164482848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea403f030 con 0x7f6ea8100a40 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6e9e7fc640 1 -- 172.21.15.39:0/2164482848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea4003ce0 con 0x7f6ea8100a40 2024-09-12T01:58:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea819fcd0 con 0x7f6ea8100a40 2024-09-12T01:58:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6e9e7fc640 1 -- 172.21.15.39:0/2164482848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4035070 con 0x7f6ea8100a40 2024-09-12T01:58:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.049+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea81a01c0 con 0x7f6ea8100a40 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.051+0000 7f6e9e7fc640 1 -- 172.21.15.39:0/2164482848 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6ea4042030 con 0x7f6ea8100a40 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 Processor -- start 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 -- start start 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561e181152f0 con 0x561e181b22e0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561e180bd270 con 0x561e181b19a0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eb208d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e181112b0 con 0x561e181b7370 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44450/0 (socket says 172.21.15.39:44450) 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6ead08d640 1 -- 172.21.15.39:0/3984966558 learned_addr learned my addr 172.21.15.39:0/3984966558 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6ead88e640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6eac88c640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6e9e7fc640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 0x7f6e940a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.052+0000 7f6ead88e640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 0x7f6e940a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6e9e7fc640 1 -- 172.21.15.39:0/2164482848 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6ea40ef520 con 0x7f6ea8100a40 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 -- 172.21.15.39:0/3984966558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 msgr2=0x561e181b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 -- 172.21.15.39:0/3984966558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 msgr2=0x561e181b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 -- 172.21.15.39:0/3984966558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e180bc340 con 0x561e181b22e0 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6eac88c640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead88e640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ecf70 tx=0x7f6ea402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836146ca415a26b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6ead88e640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 0x7f6e940a50f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009fd0 tx=0x7f6ea0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6e937fe640 1 -- 172.21.15.39:0/3984966558 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4049070 con 0x561e181b22e0 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6e937fe640 1 -- 172.21.15.39:0/3984966558 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea40bbe40 con 0x561e181b22e0 2024-09-12T01:58:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.053+0000 7f6e937fe640 1 -- 172.21.15.39:0/3984966558 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea403bd70 con 0x561e181b22e0 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- 172.21.15.39:0/3984966558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 msgr2=0x561e181b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ecf70 tx=0x7f6ea402a410 comp rx=0 tx=0).stop 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- 172.21.15.39:0/3984966558 shutdown_connections 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b22e0 0x561e181b6da0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3984966558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- 172.21.15.39:0/3984966558 >> 172.21.15.39:0/3984966558 conn(0x561e181ad010 msgr2=0x561e181ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- 172.21.15.39:0/3984966558 shutdown_connections 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- 172.21.15.39:0/3984966558 wait complete. 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 -- start start 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.054+0000 7f6eb208d740 1 Processor -- start 2024-09-12T01:58:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 0x561e181c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561e181ba100 con 0x561e181b19a0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561e1809e290 con 0x561e181b7370 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e181ba280 con 0x561e181b22e0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eb208d740 10 client.0 _ll_register_callbacks cb 0x561e180cf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44458/0 (socket says 172.21.15.39:44458) 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 -- 172.21.15.39:0/1380837411 learned_addr learned my addr 172.21.15.39:0/1380837411 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6eac88c640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead88e640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 0x561e181c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 -- 172.21.15.39:0/1380837411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 msgr2=0x561e181c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 -- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 msgr2=0x561e181c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 0x561e181c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 -- 172.21.15.39:0/1380837411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e17e28210 con 0x561e181b19a0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead88e640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 0x561e181c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4031440 tx=0x7f6ea40b7ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dfa01fa9987bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6e90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.055+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4049040 con 0x561e181b19a0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6ea403bd70 con 0x561e181b19a0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ea40bbe40 con 0x561e181b19a0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ea40c0140 con 0x561e181b19a0 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 10 client.15699 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e17ef4620 con 0x561e181b19a0 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea40bbe40 con 0x561e181b19a0 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ea40b7b90 con 0x561e181b19a0 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 10 client.15699 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 20 client.15699 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e181cb790 0x561e181cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 4 client.15699 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e18122a20 con 0x561e181cb790 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.056+0000 7f6eac88c640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e181cb790 0x561e181cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.057+0000 7f6e90ff9640 10 client.15699 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.057+0000 7f6eac88c640 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e181cb790 0x561e181cdb80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc52f21301dd1491 server_cookie=968a5d42d1baa454 in_seq=0 out_seq=0 2024-09-12T01:58:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1380837411 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e18122a20 con 0x561e181cb790 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6e90ff9640 10 client.15699 handle_command_reply: tid=0 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 client.15699 shutdown 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 msgr2=0x561e181bfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4031440 tx=0x7f6ea40b7ae0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 shutdown_connections 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e181cb790 0x561e181cdb80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b7370 0x561e181c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6e90ff9640 0 client.15699 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1380837411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181bfcb0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 >> 172.21.15.39:0/1380837411 conn(0x561e181ad010 msgr2=0x561e181ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 shutdown_connections 2024-09-12T01:58:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 1 -- 172.21.15.39:0/1380837411 wait complete. 2024-09-12T01:58:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.058+0000 7f6eb208d740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.072+0000 7f6eb208d740 1 Processor -- start 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.072+0000 7f6eb208d740 1 -- start start 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b22e0 0x561e181c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a95b0 con 0x561e181b19a0 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a6e80 con 0x561e181b22e0 2024-09-12T01:58:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eb208d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a4cd0 con 0x561e181b7370 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44466/0 (socket says 172.21.15.39:44466) 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 -- 172.21.15.39:0/3807127619 learned_addr learned my addr 172.21.15.39:0/3807127619 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6eac88c640 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b22e0 0x561e181c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 -- 172.21.15.39:0/3807127619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 msgr2=0x561e181ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 -- 172.21.15.39:0/3807127619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b22e0 msgr2=0x561e181c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b22e0 0x561e181c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 -- 172.21.15.39:0/3807127619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e181ce1e0 con 0x561e181b19a0 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6ead08d640 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ba0f0 tx=0x7f6ea403b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf13df41ca3de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6e92ffd640 1 -- 172.21.15.39:0/3807127619 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4049070 con 0x561e181b19a0 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6e92ffd640 1 -- 172.21.15.39:0/3807127619 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea40bbe40 con 0x561e181b19a0 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.073+0000 7f6e92ffd640 1 -- 172.21.15.39:0/3807127619 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003800 con 0x561e181b19a0 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- 172.21.15.39:0/3807127619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 msgr2=0x561e181adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ba0f0 tx=0x7f6ea403b870 comp rx=0 tx=0).stop 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- 172.21.15.39:0/3807127619 shutdown_connections 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b7370 0x561e181ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b22e0 0x561e181c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 --2- 172.21.15.39:0/3807127619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b19a0 0x561e181adec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- 172.21.15.39:0/3807127619 >> 172.21.15.39:0/3807127619 conn(0x561e181ad010 msgr2=0x561e181bfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- 172.21.15.39:0/3807127619 shutdown_connections 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- 172.21.15.39:0/3807127619 wait complete. 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 -- start start 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.074+0000 7f6eb208d740 1 Processor -- start 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a5340 con 0x561e181b7370 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a67b0 con 0x561e181b19a0 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea81a5a10 con 0x561e181b22e0 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eb208d740 10 client.0 _ll_register_callbacks cb 0x7f6ea0009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44484/0 (socket says 172.21.15.39:44484) 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 -- 172.21.15.39:0/1938893088 learned_addr learned my addr 172.21.15.39:0/1938893088 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6eac88c640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 -- 172.21.15.39:0/1938893088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 msgr2=0x561e181c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 -- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 msgr2=0x561e181c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 -- 172.21.15.39:0/1938893088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e181c60e0 con 0x561e181b7370 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6ead88e640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0003ce0 tx=0x7f6ea0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb073d81449b8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.075+0000 7f6e90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00127e0 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6ea0012980 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ea40bbe40 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ea0012b80 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 10 client.15705 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e181c74c0 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea40bbe40 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ea0010460 con 0x561e181b7370 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 10 client.15705 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 20 client.15705 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e18236b00 0x561e18238f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 4 client.15705 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e1811cd70 con 0x561e18236b00 2024-09-12T01:58:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.076+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e18236b00 0x561e18238f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.077+0000 7f6ead08d640 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e18236b00 0x561e18238f20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746a11e16dd14f57 server_cookie=2119b9d1bb86904f in_seq=0 out_seq=0 2024-09-12T01:58:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.077+0000 7f6e90ff9640 10 client.15705 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.287+0000 7f6e90ff9640 1 -- 172.21.15.39:0/1938893088 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e1811cd70 con 0x561e18236b00 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.287+0000 7f6e90ff9640 10 client.15705 handle_command_reply: tid=0 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.287+0000 7f6eb208d740 1 client.15705 shutdown 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 msgr2=0x561e181c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0003ce0 tx=0x7f6ea0009e60 comp rx=0 tx=0).stop 2024-09-12T01:58:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 shutdown_connections 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561e18236b00 0x561e18238f20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561e181b7370 0x561e181c5ad0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e181b22e0 0x561e181c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 --2- 172.21.15.39:0/1938893088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561e181b19a0 0x561e181c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6e90ff9640 0 client.15705 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 >> 172.21.15.39:0/1938893088 conn(0x561e181ad010 msgr2=0x561e181ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 shutdown_connections 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 1 -- 172.21.15.39:0/1938893088 wait complete. 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.288+0000 7f6eb208d740 20 client.15705 trim_cache size 0 max 16384 2024-09-12T01:58:21.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:58:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:58:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:58:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:58:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 msgr2=0x7f6e940a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 0x7f6e940a50f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009fd0 tx=0x7f6ea0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 msgr2=0x7f6ea8197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4031610 tx=0x7f6ea40043b0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 shutdown_connections 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ea81025f0 0x7f6ea819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f6e940a2c30 0x7f6e940a50f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ea8101c30 0x7f6ea8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 --2- 172.21.15.39:0/2164482848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6ea8100a40 0x7f6ea8197e20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 >> 172.21.15.39:0/2164482848 conn(0x7f6ea80fc1e0 msgr2=0x7f6ea8104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 shutdown_connections 2024-09-12T01:58:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:21.289+0000 7f6eaf2f1640 1 -- 172.21.15.39:0/2164482848 wait complete. 2024-09-12T01:58:21.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:21 smithi039 ceph-mon[31204]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:21.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:21 smithi044 ceph-mon[35259]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:21.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:21 smithi172 ceph-mon[35073]: pgmap v380: 97 pgs: 97 active+clean; 663 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-12T01:58:22.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:22 smithi039 ceph-mon[31204]: pgmap v381: 97 pgs: 97 active+clean; 1018 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-09-12T01:58:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:22 smithi044 ceph-mon[35259]: pgmap v381: 97 pgs: 97 active+clean; 1018 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-09-12T01:58:22.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:22 smithi172 ceph-mon[35073]: pgmap v381: 97 pgs: 97 active+clean; 1018 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-09-12T01:58:24.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:24 smithi039 ceph-mon[31204]: pgmap v382: 97 pgs: 97 active+clean; 15 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 1.2 MiB/s wr, 43 op/s 2024-09-12T01:58:24.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:24 smithi044 ceph-mon[35259]: pgmap v382: 97 pgs: 97 active+clean; 15 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 1.2 MiB/s wr, 43 op/s 2024-09-12T01:58:24.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:24 smithi172 ceph-mon[35073]: pgmap v382: 97 pgs: 97 active+clean; 15 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 1.2 MiB/s wr, 43 op/s 2024-09-12T01:58:26.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:26 smithi039 ceph-mon[31204]: pgmap v383: 97 pgs: 97 active+clean; 16 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-12T01:58:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:26 smithi044 ceph-mon[35259]: pgmap v383: 97 pgs: 97 active+clean; 16 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-12T01:58:26.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:26 smithi172 ceph-mon[35073]: pgmap v383: 97 pgs: 97 active+clean; 16 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 76 op/s 2024-09-12T01:58:28.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:28 smithi039 ceph-mon[31204]: pgmap v384: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2024-09-12T01:58:28.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:28 smithi044 ceph-mon[35259]: pgmap v384: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2024-09-12T01:58:28.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:28 smithi172 ceph-mon[35073]: pgmap v384: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2024-09-12T01:58:30.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:30 smithi039 ceph-mon[31204]: pgmap v385: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 91 op/s 2024-09-12T01:58:30.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:30 smithi044 ceph-mon[35259]: pgmap v385: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 91 op/s 2024-09-12T01:58:30.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:30 smithi172 ceph-mon[35073]: pgmap v385: 97 pgs: 97 active+clean; 16 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 1.3 MiB/s wr, 91 op/s 2024-09-12T01:58:32.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:32 smithi039 ceph-mon[31204]: pgmap v386: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.5 MiB/s wr, 98 op/s 2024-09-12T01:58:32.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:32 smithi044 ceph-mon[35259]: pgmap v386: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.5 MiB/s wr, 98 op/s 2024-09-12T01:58:32.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:32 smithi172 ceph-mon[35073]: pgmap v386: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.5 MiB/s wr, 98 op/s 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 -- 172.21.15.39:0/3251688385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 msgr2=0x7fa7ec1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 --2- 172.21.15.39:0/3251688385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1031d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009900 tx=0x7fa7e002a410 comp rx=0 tx=0).stop 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 -- 172.21.15.39:0/3251688385 shutdown_connections 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 --2- 172.21.15.39:0/3251688385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec103710 0x7fa7ec109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 --2- 172.21.15.39:0/3251688385 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1031d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 --2- 172.21.15.39:0/3251688385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec101b60 0x7fa7ec101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 -- 172.21.15.39:0/3251688385 >> 172.21.15.39:0/3251688385 conn(0x7fa7ec0fd2e0 msgr2=0x7fa7ec0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 -- 172.21.15.39:0/3251688385 shutdown_connections 2024-09-12T01:58:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 -- 172.21.15.39:0/3251688385 wait complete. 2024-09-12T01:58:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.390+0000 7fa7f465e640 1 Processor -- start 2024-09-12T01:58:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 -- start start 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec101b60 0x7fa7ec197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec103710 0x7fa7ec19f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec10d7c0 con 0x7fa7ec102d50 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec10d640 con 0x7fa7ec103710 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f465e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec10d940 con 0x7fa7ec101b60 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53940/0 (socket says 172.21.15.39:53940) 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/1200349487 learned_addr learned my addr 172.21.15.39:0/1200349487 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec101b60 0x7fa7ec197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec103710 0x7fa7ec19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/1200349487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec101b60 msgr2=0x7fa7ec197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec101b60 0x7fa7ec197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/1200349487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec103710 msgr2=0x7fa7ec19f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec103710 0x7fa7ec19f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.391+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/1200349487 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec19f9d0 con 0x7fa7ec102d50 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009230 tx=0x7fa7e0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1200349487 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e003f030 con 0x7fa7ec102d50 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1200349487 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e0003ce0 con 0x7fa7ec102d50 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ec19fc60 con 0x7fa7ec102d50 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1200349487 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0035070 con 0x7fa7ec102d50 2024-09-12T01:58:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.392+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ec1a01a0 con 0x7fa7ec102d50 2024-09-12T01:58:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.394+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1200349487 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa7e0042030 con 0x7fa7ec102d50 2024-09-12T01:58:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 Processor -- start 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 -- start start 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588da830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ff588362f0 con 0x55ff588d29a0 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff587de270 con 0x55ff588d32e0 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff588322b0 con 0x55ff588d8370 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f2bfb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f2bfb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53956/0 (socket says 172.21.15.39:53956) 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f2bfb640 1 -- 172.21.15.39:0/3543630860 learned_addr learned my addr 172.21.15.39:0/3543630860 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.395+0000 7fa7df7fe640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 0x7fa7d80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 0x7fa7d80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 -- 172.21.15.39:0/3543630860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 msgr2=0x55ff588da830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588da830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 -- 172.21.15.39:0/3543630860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 msgr2=0x55ff588d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 -- 172.21.15.39:0/3543630860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff587dd340 con 0x55ff588d32e0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7df7fe640 1 -- 172.21.15.39:0/1200349487 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7e00ef920 con 0x7fa7ec102d50 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588d7da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800bbc0 tx=0x7fa7e80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cb459987610872 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 0x7fa7d80a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009fd0 tx=0x7fa7e4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7dcbfe640 1 -- 172.21.15.39:0/3543630860 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004030 con 0x55ff588d32e0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7dcbfe640 1 -- 172.21.15.39:0/3543630860 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e8005500 con 0x55ff588d32e0 2024-09-12T01:58:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.396+0000 7fa7dcbfe640 1 -- 172.21.15.39:0/3543630860 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004cb0 con 0x55ff588d32e0 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 -- 172.21.15.39:0/3543630860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 msgr2=0x55ff588d7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588d7da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800bbc0 tx=0x7fa7e80107a0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 -- 172.21.15.39:0/3543630860 shutdown_connections 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588d7da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/3543630860 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 -- 172.21.15.39:0/3543630860 >> 172.21.15.39:0/3543630860 conn(0x55ff588ce010 msgr2=0x55ff588ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 -- 172.21.15.39:0/3543630860 shutdown_connections 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.397+0000 7fa7f73fe740 1 -- 172.21.15.39:0/3543630860 wait complete. 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 -- start start 2024-09-12T01:58:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 Processor -- start 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588dd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ff588db340 con 0x55ff588d29a0 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff587bf290 con 0x55ff588d32e0 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff588db4c0 con 0x55ff588d8370 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f73fe740 10 client.0 _ll_register_callbacks cb 0x55ff587f0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f23fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f23fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53970/0 (socket says 172.21.15.39:53970) 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f23fa640 1 -- 172.21.15.39:0/856640125 learned_addr learned my addr 172.21.15.39:0/856640125 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.398+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588dd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 -- 172.21.15.39:0/856640125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 msgr2=0x55ff588e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 -- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 msgr2=0x55ff588dd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588dd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 -- 172.21.15.39:0/856640125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff58549210 con 0x55ff588d29a0 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8000c00 tx=0x7fa7e800bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4ace2569202b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e802b060 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7e8004bc0 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e8005500 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7e8004440 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f73fe740 10 client.15717 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.399+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff58615620 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e8005500 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7e8011a10 con 0x55ff588d29a0 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 10 client.15717 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 20 client.15717 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:34.407 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff588e85a0 0x55ff588ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 4 client.15717 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff58843a20 con 0x55ff588e85a0 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.400+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff588e85a0 0x55ff588ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.401+0000 7fa7d5ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.401+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff588e85a0 0x55ff588ea9b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e08ada6df69edd server_cookie=3fd2dc68d9be361e in_seq=0 out_seq=0 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.401+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/856640125 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff58843a20 con 0x55ff588e85a0 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.401+0000 7fa7d5ffb640 10 client.15717 handle_command_reply: tid=0 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.401+0000 7fa7f73fe740 1 client.15717 shutdown 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 msgr2=0x55ff588dcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8000c00 tx=0x7fa7e800bfa0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 shutdown_connections 2024-09-12T01:58:34.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff588e85a0 0x55ff588ea9b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d32e0 0x55ff588dd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/856640125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d29a0 0x55ff588dcbc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7d5ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 >> 172.21.15.39:0/856640125 conn(0x55ff588ce010 msgr2=0x55ff588cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 shutdown_connections 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 1 -- 172.21.15.39:0/856640125 wait complete. 2024-09-12T01:58:34.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.402+0000 7fa7f73fe740 20 client.15717 trim_cache size 0 max 16384 2024-09-12T01:58:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 Processor -- start 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 -- start start 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 0x55ff588cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1ab860 con 0x55ff588d32e0 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1a9130 con 0x55ff588d29a0 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1a6f80 con 0x55ff588d8370 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53984/0 (socket says 172.21.15.39:53984) 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/739077972 learned_addr learned my addr 172.21.15.39:0/739077972 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.417+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 0x55ff588cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/739077972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 msgr2=0x55ff588ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/739077972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 msgr2=0x55ff588cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 0x55ff588cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/739077972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff588cde30 con 0x55ff588d32e0 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 0x55ff588cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00b8c10 tx=0x7fa7e00dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441735678f0ab2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7d7fff640 1 -- 172.21.15.39:0/739077972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0049040 con 0x55ff588d32e0 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7d7fff640 1 -- 172.21.15.39:0/739077972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e00bc240 con 0x55ff588d32e0 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.418+0000 7fa7d7fff640 1 -- 172.21.15.39:0/739077972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e003b580 con 0x55ff588d32e0 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- 172.21.15.39:0/739077972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 msgr2=0x55ff588e4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00b8c10 tx=0x7fa7e00dc040 comp rx=0 tx=0).stop 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- 172.21.15.39:0/739077972 shutdown_connections 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d8370 0x55ff588ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e4060 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/739077972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d29a0 0x55ff588cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- 172.21.15.39:0/739077972 >> 172.21.15.39:0/739077972 conn(0x55ff588ce010 msgr2=0x55ff588cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- 172.21.15.39:0/739077972 shutdown_connections 2024-09-12T01:58:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- 172.21.15.39:0/739077972 wait complete. 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- start start 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 Processor -- start 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 0x55ff588e1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 0x55ff588e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1a75f0 con 0x55ff588d32e0 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1a8a60 con 0x55ff588d8370 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.419+0000 7fa7f73fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1a7cc0 con 0x55ff588d29a0 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f73fe740 10 client.0 _ll_register_callbacks cb 0x7fa7e4009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f23fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 0x55ff588e1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f23fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 0x55ff588e1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:60434/0 (socket says 172.21.15.39:60434) 2024-09-12T01:58:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f23fa640 1 -- 172.21.15.39:0/2872136028 learned_addr learned my addr 172.21.15.39:0/2872136028 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 0x55ff588e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53994/0 (socket says 172.21.15.39:53994) 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/2872136028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 msgr2=0x55ff588e1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 0x55ff588e1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 msgr2=0x55ff588e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 0x55ff588e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 -- 172.21.15.39:0/2872136028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff588e3370 con 0x55ff588d32e0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f2bfb640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 0x55ff588e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f1bf9640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ed7a0 tx=0x7fa7e002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eff4a90f8f5188b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0049070 con 0x55ff588d32e0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7e00dc0b0 con 0x55ff588d32e0 2024-09-12T01:58:34.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.420+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e00bc240 con 0x55ff588d32e0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7e003b560 con 0x55ff588d32e0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 10 client.15723 fetch_fsmap learned FSMap version 25 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff58953290 con 0x55ff588d32e0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e00bc240 con 0x55ff588d32e0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7e00bc4a0 con 0x55ff588d32e0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 10 client.15723 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 20 client.15723 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff58953d10 0x55ff58956100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 4 client.15723 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff5883dd70 con 0x55ff58953d10 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.421+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff58953d10 0x55ff58956100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.422+0000 7fa7f23fa640 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff58953d10 0x55ff58956100 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee773501eeb5130 server_cookie=5d3c8d00efac3c1 in_seq=0 out_seq=0 2024-09-12T01:58:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.422+0000 7fa7d5ffb640 10 client.15723 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:34.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:34 smithi039 ceph-mon[31204]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-09-12T01:58:34.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:34 smithi044 ceph-mon[35259]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-09-12T01:58:34.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:34 smithi172 ceph-mon[35073]: pgmap v387: 97 pgs: 97 active+clean; 18 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-09-12T01:58:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7d5ffb640 1 -- 172.21.15.39:0/2872136028 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff5883dd70 con 0x55ff58953d10 2024-09-12T01:58:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7d5ffb640 10 client.15723 handle_command_reply: tid=0 2024-09-12T01:58:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 client.15723 shutdown 2024-09-12T01:58:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 msgr2=0x55ff588e1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.911 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ed7a0 tx=0x7fa7e002a410 comp rx=0 tx=0).stop 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 shutdown_connections 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ff58953d10 0x55ff58956100 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff588d8370 0x55ff588e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ff588d32e0 0x55ff588e1d50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 --2- 172.21.15.39:0/2872136028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff588d29a0 0x55ff588e1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7d5ffb640 0 client.15723 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 >> 172.21.15.39:0/2872136028 conn(0x55ff588ce010 msgr2=0x55ff588cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 shutdown_connections 2024-09-12T01:58:34.912 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 1 -- 172.21.15.39:0/2872136028 wait complete. 2024-09-12T01:58:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.910+0000 7fa7f73fe740 20 client.15723 trim_cache size 0 max 16384 2024-09-12T01:58:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:58:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:58:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:58:34.913 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 msgr2=0x7fa7d80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 0x7fa7d80a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009fd0 tx=0x7fa7e4004ab0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 msgr2=0x7fa7ec1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009230 tx=0x7fa7e0004360 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 shutdown_connections 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7ec103710 0x7fa7ec19f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ec102d50 0x7fa7ec1982f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa7d80a2cb0 0x7fa7d80a5170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 --2- 172.21.15.39:0/1200349487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7ec101b60 0x7fa7ec197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:34.914 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 >> 172.21.15.39:0/1200349487 conn(0x7fa7ec0fd2e0 msgr2=0x7fa7ec1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 shutdown_connections 2024-09-12T01:58:34.915 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:34.911+0000 7fa7f465e640 1 -- 172.21.15.39:0/1200349487 wait complete. 2024-09-12T01:58:36.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:36 smithi039 ceph-mon[31204]: pgmap v388: 97 pgs: 97 active+clean; 16 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 651 KiB/s wr, 115 op/s 2024-09-12T01:58:36.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:36 smithi044 ceph-mon[35259]: pgmap v388: 97 pgs: 97 active+clean; 16 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 651 KiB/s wr, 115 op/s 2024-09-12T01:58:36.732 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 44% (1919/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 58% (2550/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3040/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 89% (3900/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-12T01:58:36.738 INFO:tasks.workunit.client.0.smithi039.stderr:+ cd xfstests-dev 2024-09-12T01:58:36.738 INFO:tasks.workunit.client.0.smithi039.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-12T01:58:36.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:36 smithi172 ceph-mon[35073]: pgmap v388: 97 pgs: 97 active+clean; 16 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 651 KiB/s wr, 115 op/s 2024-09-12T01:58:38.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:58:38.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:38 smithi039 ceph-mon[31204]: pgmap v389: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 698 KiB/s wr, 246 op/s 2024-09-12T01:58:38.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:38 smithi044 ceph-mon[35259]: pgmap v389: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 698 KiB/s wr, 246 op/s 2024-09-12T01:58:38.728 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:38 smithi172 ceph-mon[35073]: pgmap v389: 97 pgs: 97 active+clean; 18 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 698 KiB/s wr, 246 op/s 2024-09-12T01:58:39.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- 172.21.15.39:0/1500140368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf810c180 msgr2=0x7f1bf810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/1500140368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf810c180 0x7f1bf810e600 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009ca0 tx=0x7f1bf002a950 comp rx=0 tx=0).stop 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- 172.21.15.39:0/1500140368 shutdown_connections 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/1500140368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf810c180 0x7f1bf810e600 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/1500140368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf81036c0 0x7f1bf810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/1500140368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf8102da0 0x7f1bf8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- 172.21.15.39:0/1500140368 >> 172.21.15.39:0/1500140368 conn(0x7f1bf80fc7a0 msgr2=0x7f1bf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- 172.21.15.39:0/1500140368 shutdown_connections 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- 172.21.15.39:0/1500140368 wait complete. 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 Processor -- start 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.239+0000 7f1bfd94a640 1 -- start start 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf81036c0 0x7f1bf81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf810c180 0x7f1bf819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8111f60 con 0x7f1bf8102da0 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8111de0 con 0x7f1bf810c180 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bfd94a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81120e0 con 0x7f1bf81036c0 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54008/0 (socket says 172.21.15.39:54008) 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/3937625485 learned_addr learned my addr 172.21.15.39:0/3937625485 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf81036c0 0x7f1bf81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf810c180 0x7f1bf819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/3937625485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf81036c0 msgr2=0x7f1bf81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf81036c0 0x7f1bf81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/3937625485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf810c180 msgr2=0x7f1bf819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf810c180 0x7f1bf819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/3937625485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf819d430 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.240+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1be800e9f0 tx=0x7f1be800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.241+0000 7f1bfc948640 1 -- 172.21.15.39:0/3937625485 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be800cd80 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.241+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf819d720 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.241+0000 7f1bfc948640 1 -- 172.21.15.39:0/3937625485 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1be8005500 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.241+0000 7f1bfc948640 1 -- 172.21.15.39:0/3937625485 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8010690 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.241+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf81a5000 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bfc948640 1 -- 172.21.15.39:0/3937625485 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1be80046c0 con 0x7f1bf8102da0 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 Processor -- start 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 -- start start 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4e012e0 con 0x55e9b4ea6680 2024-09-12T01:58:39.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4da8ce0 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.243+0000 7f1bffd23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4dfd2a0 con 0x55e9b4e9bdc0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40872/0 (socket says 172.21.15.39:40872) 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 -- 172.21.15.39:0/4083715017 learned_addr learned my addr 172.21.15.39:0/4083715017 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 -- 172.21.15.39:0/4083715017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 msgr2=0x55e9b4ea6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 -- 172.21.15.39:0/4083715017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 msgr2=0x55e9b4ea8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bfc948640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 0x7f1be00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 -- 172.21.15.39:0/4083715017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b4d8d440 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:39.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bfc948640 1 -- 172.21.15.39:0/3937625485 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1be80cf410 con 0x7f1bf8102da0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 0x7f1be00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0035000 tx=0x7f1bf00093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce545a82ceb69700 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.244+0000 7f1bddffb640 1 -- 172.21.15.39:0/4083715017 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf004c070 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bddffb640 1 -- 172.21.15.39:0/4083715017 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf0003e50 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bddffb640 1 -- 172.21.15.39:0/4083715017 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0034040 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 -- 172.21.15.39:0/4083715017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 msgr2=0x55e9b4e9b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 0x7f1be00a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0049000 tx=0x7f1bf004c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0035000 tx=0x7f1bf00093e0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 -- 172.21.15.39:0/4083715017 shutdown_connections 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 --2- 172.21.15.39:0/4083715017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e9b880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 -- 172.21.15.39:0/4083715017 >> 172.21.15.39:0/4083715017 conn(0x55e9b4e97a30 msgr2=0x55e9b4e97e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 -- 172.21.15.39:0/4083715017 shutdown_connections 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.245+0000 7f1bffd23740 1 -- 172.21.15.39:0/4083715017 wait complete. 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 -- start start 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 Processor -- start 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4ea9250 con 0x55e9b4ea6680 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4dbc050 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e9b4ea93d0 con 0x55e9b4e9bdc0 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bffd23740 10 client.0 _ll_register_callbacks cb 0x55e9b4dfc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40876/0 (socket says 172.21.15.39:40876) 2024-09-12T01:58:39.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54028/0 (socket says 172.21.15.39:54028) 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/2326359243 learned_addr learned my addr 172.21.15.39:0/2326359243 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.246+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 -- 172.21.15.39:0/2326359243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 msgr2=0x55e9b4ea3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 -- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 msgr2=0x55e9b4ea5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 -- 172.21.15.39:0/2326359243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b4b723c0 con 0x55e9b4ea6680 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0005cc0 tx=0x7f1bf00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a7ac4b57cc262 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0054070 con 0x55e9b4ea6680 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1bf0003970 con 0x55e9b4ea6680 2024-09-12T01:58:39.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf0003e50 con 0x55e9b4ea6680 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bf0060050 con 0x55e9b4ea6680 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bffd23740 10 client.15735 fetch_fsmap learned FSMap version 26 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e9b4eb4b40 con 0x55e9b4ea6680 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.247+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf0003e50 con 0x55e9b4ea6680 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1bf0043040 con 0x55e9b4ea6680 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 10 client.15735 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 20 client.15735 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4eb5e90 0x55e9b4eb8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 4 client.15735 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9b4e0e850 con 0x55e9b4eb5e90 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4eb5e90 0x55e9b4eb8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bd6ffd640 10 client.15735 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.248+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4eb5e90 0x55e9b4eb8280 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4845c639189bc835 server_cookie=bce401fac6eed280 in_seq=0 out_seq=0 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/2326359243 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9b4e0e850 con 0x55e9b4eb5e90 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bd6ffd640 10 client.15735 handle_command_reply: tid=0 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 client.15735 shutdown 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 msgr2=0x55e9b4ea3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0005cc0 tx=0x7f1bf00048f0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 shutdown_connections 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4eb5e90 0x55e9b4eb8280 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4ea3790 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ea3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 --2- 172.21.15.39:0/2326359243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ea5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 >> 172.21.15.39:0/2326359243 conn(0x55e9b4e97a30 msgr2=0x55e9b4e96b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bd6ffd640 0 client.15735 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:39.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 shutdown_connections 2024-09-12T01:58:39.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 1 -- 172.21.15.39:0/2326359243 wait complete. 2024-09-12T01:58:39.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.250+0000 7f1bffd23740 20 client.15735 trim_cache size 0 max 16384 2024-09-12T01:58:39.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.267+0000 7f1bffd23740 1 Processor -- start 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 -- start start 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4e9e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4ea6680 0x55e9b4ebaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81afea0 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81ad770 con 0x55e9b4e9bdc0 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bffd23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81ab5c0 con 0x55e9b4ea6680 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54036/0 (socket says 172.21.15.39:54036) 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/1749719564 learned_addr learned my addr 172.21.15.39:0/1749719564 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4e9e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/1749719564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4ea6680 msgr2=0x55e9b4ebaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4ea6680 0x55e9b4ebaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/1749719564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 msgr2=0x55e9b4e9e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4e9e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 -- 172.21.15.39:0/1749719564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b4ea2200 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4e9e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.268+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1be80980e0 tx=0x7f1be8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a863e3fbca9cfe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bdd7fa640 1 -- 172.21.15.39:0/1749719564 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80b9070 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bdd7fa640 1 -- 172.21.15.39:0/1749719564 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1be80a0030 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bdd7fa640 1 -- 172.21.15.39:0/1749719564 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be80a46c0 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 -- 172.21.15.39:0/1749719564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 msgr2=0x55e9b4e97e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1be80980e0 tx=0x7f1be8004a40 comp rx=0 tx=0).stop 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 -- 172.21.15.39:0/1749719564 shutdown_connections 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4ea6680 0x55e9b4ebaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4e9e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 --2- 172.21.15.39:0/1749719564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4e97e10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 -- 172.21.15.39:0/1749719564 >> 172.21.15.39:0/1749719564 conn(0x55e9b4e97a30 msgr2=0x55e9b4e9e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 -- 172.21.15.39:0/1749719564 shutdown_connections 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.269+0000 7f1bffd23740 1 -- 172.21.15.39:0/1749719564 wait complete. 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 -- start start 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 Processor -- start 2024-09-12T01:58:39.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ebb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ebb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81abc30 con 0x55e9b4ea6680 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81ad0a0 con 0x55e9b4e9bdc0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81ac300 con 0x55e9b4e9b4a0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bffd23740 10 client.0 _ll_register_callbacks cb 0x7f1bf004a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bf67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ebb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bf77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54046/0 (socket says 172.21.15.39:54046) 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.270+0000 7f1bf77fe640 1 -- 172.21.15.39:0/3522640048 learned_addr learned my addr 172.21.15.39:0/3522640048 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ebb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 -- 172.21.15.39:0/3522640048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9b4a0 msgr2=0x55e9b4ebb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ebb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 -- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 msgr2=0x55e9b4ebb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ebb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 -- 172.21.15.39:0/3522640048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b4ea6310 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf67fc640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ebb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bf77fe640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1bf002ae70 tx=0x7f1bf0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86c607c24b611cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0054040 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1bf0040070 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be80a0030 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1bf006c050 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bffd23740 10 client.15741 fetch_fsmap learned FSMap version 26 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.271+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e9b4f20240 con 0x55e9b4ea6680 2024-09-12T01:58:39.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1be80a0030 con 0x55e9b4ea6680 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1bf00467d0 con 0x55e9b4ea6680 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 10 client.15741 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 20 client.15741 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4f208a0 0x55e9b4f22cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 4 client.15741 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9b4e985e0 con 0x55e9b4f208a0 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4f208a0 0x55e9b4f22cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bf6ffd640 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4f208a0 0x55e9b4f22cc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea331157d4bea8 server_cookie=eaa013adbc5b3b74 in_seq=0 out_seq=0 2024-09-12T01:58:39.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.272+0000 7f1bd6ffd640 10 client.15741 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:39.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.273+0000 7f1bd6ffd640 1 -- 172.21.15.39:0/3522640048 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e9b4e985e0 con 0x55e9b4f208a0 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.273+0000 7f1bd6ffd640 10 client.15741 handle_command_reply: tid=0 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.273+0000 7f1bffd23740 1 client.15741 shutdown 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 msgr2=0x55e9b4eb87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1bf002ae70 tx=0x7f1bf0005c50 comp rx=0 tx=0).stop 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 shutdown_connections 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e9b4f208a0 0x55e9b4f22cc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bd6ffd640 0 client.15741 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e9b4ea6680 0x55e9b4eb87d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9b4e9bdc0 0x55e9b4ebb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 --2- 172.21.15.39:0/3522640048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9b4e9b4a0 0x55e9b4ebb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 >> 172.21.15.39:0/3522640048 conn(0x55e9b4e97a30 msgr2=0x55e9b4e9e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 shutdown_connections 2024-09-12T01:58:39.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 1 -- 172.21.15.39:0/3522640048 wait complete. 2024-09-12T01:58:39.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bffd23740 20 client.15741 trim_cache size 0 max 16384 2024-09-12T01:58:39.279 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:39.279 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-12T01:58:39.279 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2024-09-12T01:58:39.279 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 msgr2=0x7f1be00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 0x7f1be00a5040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0049000 tx=0x7f1bf004c000 comp rx=0 tx=0).stop 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 msgr2=0x7f1bf8198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.274+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1be800e9f0 tx=0x7f1be800edf0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 shutdown_connections 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bf810c180 0x7f1bf819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1be00a2b80 0x7f1be00a5040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bf81036c0 0x7f1bf81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 --2- 172.21.15.39:0/3937625485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1bf8102da0 0x7f1bf8198480 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:39.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 >> 172.21.15.39:0/3937625485 conn(0x7f1bf80fc7a0 msgr2=0x7f1bf80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:39.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 shutdown_connections 2024-09-12T01:58:39.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:39.275+0000 7f1bfd94a640 1 -- 172.21.15.39:0/3937625485 wait complete. 2024-09-12T01:58:39.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:39 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:39.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:39 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:39.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:39 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:40.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:40 smithi039 ceph-mon[31204]: pgmap v390: 97 pgs: 97 active+clean; 23 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-12T01:58:40.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:40 smithi044 ceph-mon[35259]: pgmap v390: 97 pgs: 97 active+clean; 23 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-12T01:58:40.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:40 smithi172 ceph-mon[35073]: pgmap v390: 97 pgs: 97 active+clean; 23 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 1.3 MiB/s wr, 647 op/s 2024-09-12T01:58:41.996 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:58:41.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:42.257 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:42.640 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:42 smithi039 ceph-mon[31204]: pgmap v391: 97 pgs: 97 active+clean; 30 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.9 MiB/s wr, 748 op/s 2024-09-12T01:58:42.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:42 smithi044 ceph-mon[35259]: pgmap v391: 97 pgs: 97 active+clean; 30 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.9 MiB/s wr, 748 op/s 2024-09-12T01:58:42.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 -- 172.21.15.39:0/67007595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc4103760 msgr2=0x7fabc4107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 --2- 172.21.15.39:0/67007595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc4103760 0x7fabc4107ba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009930 tx=0x7fabb802a420 comp rx=0 tx=0).stop 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 -- 172.21.15.39:0/67007595 shutdown_connections 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 --2- 172.21.15.39:0/67007595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc41082e0 0x7fabc410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 --2- 172.21.15.39:0/67007595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc4103760 0x7fabc4107ba0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 --2- 172.21.15.39:0/67007595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4102db0 0x7fabc4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 -- 172.21.15.39:0/67007595 >> 172.21.15.39:0/67007595 conn(0x7fabc40fc7d0 msgr2=0x7fabc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 -- 172.21.15.39:0/67007595 shutdown_connections 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.724+0000 7fabcb28d640 1 -- 172.21.15.39:0/67007595 wait complete. 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 Processor -- start 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 -- start start 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc4102db0 0x7fabc4100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:42.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4103760 0x7fabc4100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4112070 con 0x7fabc41082e0 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4111ef0 con 0x7fabc4102db0 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabcb28d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabc41121f0 con 0x7fabc4103760 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33940/0 (socket says 172.21.15.39:33940) 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 -- 172.21.15.39:0/3407240741 learned_addr learned my addr 172.21.15.39:0/3407240741 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc8828640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4103760 0x7fabc4100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc9029640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc4102db0 0x7fabc4100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 -- 172.21.15.39:0/3407240741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4103760 msgr2=0x7fabc4100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4103760 0x7fabc4100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 -- 172.21.15.39:0/3407240741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc4102db0 msgr2=0x7fabc4100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc4102db0 0x7fabc4100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.725+0000 7fabc982a640 1 -- 172.21.15.39:0/3407240741 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc41a6aa0 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabc982a640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e970 tx=0x7fabbc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00ccc0 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc41a6d90 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabbc00ce60 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc010490 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.726+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41a7250 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.727+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc4103190 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.728+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fabbc005020 con 0x7fabc41082e0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.729+0000 7fabc27fc640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 0x7fabac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.729+0000 7fabc9029640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 0x7fabac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:42.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.729+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fabbc0cf450 con 0x7fabc41082e0 2024-09-12T01:58:42.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.729+0000 7fabc9029640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 0x7fabac0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabb4005fd0 tx=0x7fabb4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:42.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.733+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabbc09c3c0 con 0x7fabc41082e0 2024-09-12T01:58:42.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:42 smithi172 ceph-mon[35073]: pgmap v391: 97 pgs: 97 active+clean; 30 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.9 MiB/s wr, 748 op/s 2024-09-12T01:58:42.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.969+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc410a2c0 con 0x7fabc41082e0 2024-09-12T01:58:42.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.969+0000 7fabc27fc640 1 -- 172.21.15.39:0/3407240741 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7fabbc09bcc0 con 0x7fabc41082e0 2024-09-12T01:58:42.970 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:58:42.970 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":26,"btime":"2024-09-12T01:58:38:369483+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:58:37.812093+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T01:58:42.970 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 26 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 msgr2=0x7fabac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 0x7fabac0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabb4005fd0 tx=0x7fabb4009680 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 msgr2=0x7fabc4101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00e970 tx=0x7fabbc00ed70 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 shutdown_connections 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fabc41082e0 0x7fabc4101490 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fabac0a2b80 0x7fabac0a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc4103760 0x7fabc4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 --2- 172.21.15.39:0/3407240741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabc4102db0 0x7fabc4100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:42.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 >> 172.21.15.39:0/3407240741 conn(0x7fabc40fc7d0 msgr2=0x7fabc4105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:42.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 shutdown_connections 2024-09-12T01:58:42.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:42.972+0000 7fabcb28d640 1 -- 172.21.15.39:0/3407240741 wait complete. 2024-09-12T01:58:43.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:43 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3407240741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:43.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:58:43.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:43 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3407240741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:43 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3407240741' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:43.982 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 -- 172.21.15.39:0/1675073577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e01082a0 msgr2=0x7fd7e010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/1675073577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e01082a0 0x7fd7e010ec40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009cd0 tx=0x7fd7d802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 -- 172.21.15.39:0/1675073577 shutdown_connections 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/1675073577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e01082a0 0x7fd7e010ec40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/1675073577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 0x7fd7e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/1675073577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e0102d30 0x7fd7e0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 -- 172.21.15.39:0/1675073577 >> 172.21.15.39:0/1675073577 conn(0x7fd7e00fc7d0 msgr2=0x7fd7e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 -- 172.21.15.39:0/1675073577 shutdown_connections 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 -- 172.21.15.39:0/1675073577 wait complete. 2024-09-12T01:58:44.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.463+0000 7fd7e5a93640 1 Processor -- start 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 -- start start 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 0x7fd7e0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e01082a0 0x7fd7e0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01120a0 con 0x7fd7e0102d30 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0111f20 con 0x7fd7e01036e0 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7e5a93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0112220 con 0x7fd7e01082a0 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33966/0 (socket says 172.21.15.39:33966) 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 -- 172.21.15.39:0/105278029 learned_addr learned my addr 172.21.15.39:0/105278029 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7deffd640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 0x7fd7e0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7dffff640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e01082a0 0x7fd7e0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 -- 172.21.15.39:0/105278029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e01082a0 msgr2=0x7fd7e0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e01082a0 0x7fd7e0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 -- 172.21.15.39:0/105278029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 msgr2=0x7fd7e0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 0x7fd7e0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 -- 172.21.15.39:0/105278029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e01a69d0 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.464+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000d950 tx=0x7fd7d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.465+0000 7fd7dcff9640 1 -- 172.21.15.39:0/105278029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0017070 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.465+0000 7fd7dcff9640 1 -- 172.21.15.39:0/105278029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d0009c30 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.465+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e01a6cc0 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.465+0000 7fd7dcff9640 1 -- 172.21.15.39:0/105278029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000f6b0 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.465+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e01a71f0 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.467+0000 7fd7dcff9640 1 -- 172.21.15.39:0/105278029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd7d00109d0 con 0x7fd7e0102d30 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.467+0000 7fd7e7e6c740 1 Processor -- start 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.467+0000 7fd7e7e6c740 1 -- start start 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed821ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed8229760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557ed81822f0 con 0x557ed821c5d0 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ed8129cf0 con 0x557ed8227370 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ed817e2b0 con 0x557ed821db40 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed821ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dcff9640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 0x7fd7c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed8229760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:53462/0 (socket says 172.21.15.39:53462) 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed821ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33978/0 (socket says 172.21.15.39:33978) 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 -- 172.21.15.39:0/1411525919 learned_addr learned my addr 172.21.15.39:0/1411525919 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 0x7fd7c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 -- 172.21.15.39:0/1411525919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 msgr2=0x557ed8229760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed8229760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dcff9640 1 -- 172.21.15.39:0/105278029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7d00ceb70 con 0x7fd7e0102d30 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 -- 172.21.15.39:0/1411525919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 msgr2=0x557ed821ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed821ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.468+0000 7fd7dffff640 1 -- 172.21.15.39:0/1411525919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed810e3a0 con 0x557ed821db40 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.469+0000 7fd7dffff640 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009430 tx=0x7fd7d8031a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9690304fce694d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.469+0000 7fd7dffff640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 0x7fd7c80a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8047000 tx=0x7fd7d804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.469+0000 7fd7c5ffb640 1 -- 172.21.15.39:0/1411525919 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8004410 con 0x557ed821db40 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.469+0000 7fd7c5ffb640 1 -- 172.21.15.39:0/1411525919 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d8036070 con 0x557ed821db40 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.469+0000 7fd7c5ffb640 1 -- 172.21.15.39:0/1411525919 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d804a450 con 0x557ed821db40 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1411525919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 msgr2=0x557ed821c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009430 tx=0x7fd7d8031a70 comp rx=0 tx=0).stop 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1411525919 shutdown_connections 2024-09-12T01:58:44.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed8229760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed821ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1411525919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821db40 0x557ed821c090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1411525919 >> 172.21.15.39:0/1411525919 conn(0x557ed81e5310 msgr2=0x557ed8218c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1411525919 shutdown_connections 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1411525919 wait complete. 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.470+0000 7fd7e7e6c740 1 -- start start 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 Processor -- start 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821c5d0 0x557ed8226d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed8224640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x557ed8229fb0 con 0x557ed821db40 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ed813d060 con 0x557ed821c5d0 2024-09-12T01:58:44.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ed822a130 con 0x557ed8227370 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7e7e6c740 10 client.0 _ll_register_callbacks cb 0x557ed7e908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33984/0 (socket says 172.21.15.39:33984) 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821c5d0 0x557ed8226d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 -- 172.21.15.39:0/551005988 learned_addr learned my addr 172.21.15.39:0/551005988 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7dffff640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed8224640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 -- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 msgr2=0x557ed8224640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed8224640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 -- 172.21.15.39:0/551005988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821c5d0 msgr2=0x557ed8226d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.471+0000 7fd7deffd640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821c5d0 0x557ed8226d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7deffd640 1 -- 172.21.15.39:0/551005988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed7ef33c0 con 0x557ed821db40 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7deffd640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4012700 tx=0x7fd7d4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fe0d8a845e25d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4004030 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7d40041d0 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7d8036070 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7d40043d0 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7e7e6c740 10 client.15759 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed8235b40 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d8036070 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.472+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd7d4003af0 con 0x557ed821db40 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 10 client.15759 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 10 client.15759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 20 client.15759 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:44.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed8237050 0x557ed8239490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 4 client.15759 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ed818f860 con 0x557ed8237050 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed8237050 0x557ed8239490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed8237050 0x557ed8239490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58d747cc57f9c857 server_cookie=b3d0d912d9763e21 in_seq=0 out_seq=0 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.473+0000 7fd7beffd640 10 client.15759 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7beffd640 1 -- 172.21.15.39:0/551005988 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ed818f860 con 0x557ed8237050 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7beffd640 10 client.15759 handle_command_reply: tid=0 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 client.15759 shutdown 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 msgr2=0x557ed8224030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4012700 tx=0x7fd7d4012bc0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 shutdown_connections 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed8237050 0x557ed8239490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed8224640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed8224030 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7beffd640 0 client.15759 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/551005988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821c5d0 0x557ed8226d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 >> 172.21.15.39:0/551005988 conn(0x557ed81e5310 msgr2=0x557ed821e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 shutdown_connections 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/551005988 wait complete. 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.474+0000 7fd7e7e6c740 20 client.15759 trim_cache size 0 max 16384 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.487+0000 7fd7e7e6c740 1 Processor -- start 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.487+0000 7fd7e7e6c740 1 -- start start 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 0x557ed823ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed823f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01b20c0 con 0x557ed821c5d0 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01af990 con 0x557ed821db40 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01ad7e0 con 0x557ed8227370 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 0x557ed823ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33998/0 (socket says 172.21.15.39:33998) 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 -- 172.21.15.39:0/1107367341 learned_addr learned my addr 172.21.15.39:0/1107367341 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7dffff640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed823f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 -- 172.21.15.39:0/1107367341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 msgr2=0x557ed823f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed823f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 -- 172.21.15.39:0/1107367341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 msgr2=0x557ed823ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 0x557ed823ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 -- 172.21.15.39:0/1107367341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed822a180 con 0x557ed821c5d0 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7dffff640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed823f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7deffd640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 0x557ed823ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.488+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0097890 tx=0x7fd7d0097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a0cbf974dbf868 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7c57fa640 1 -- 172.21.15.39:0/1107367341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0020040 con 0x557ed821c5d0 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7c57fa640 1 -- 172.21.15.39:0/1107367341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d0099730 con 0x557ed821c5d0 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7c57fa640 1 -- 172.21.15.39:0/1107367341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0097180 con 0x557ed821c5d0 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1107367341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 msgr2=0x557ed82332b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0097890 tx=0x7fd7d0097040 comp rx=0 tx=0).stop 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1107367341 shutdown_connections 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed8227370 0x557ed823f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed821db40 0x557ed823ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/1107367341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821c5d0 0x557ed82332b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1107367341 >> 172.21.15.39:0/1107367341 conn(0x557ed81e5310 msgr2=0x557ed8222900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1107367341 shutdown_connections 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.489+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/1107367341 wait complete. 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 -- start start 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 Processor -- start 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821c5d0 0x557ed822b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed822bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01ade50 con 0x557ed821db40 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01af2c0 con 0x557ed8227370 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e01ae520 con 0x557ed821c5d0 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7e7e6c740 10 client.0 _ll_register_callbacks cb 0x7fd7d4009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7deffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34006/0 (socket says 172.21.15.39:34006) 2024-09-12T01:58:44.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7deffd640 1 -- 172.21.15.39:0/3712906693 learned_addr learned my addr 172.21.15.39:0/3712906693 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821c5d0 0x557ed822b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.490+0000 7fd7dffff640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed822bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 -- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821c5d0 msgr2=0x557ed822b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821c5d0 0x557ed822b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 -- 172.21.15.39:0/3712906693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 msgr2=0x557ed822bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed822bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 -- 172.21.15.39:0/3712906693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed8218510 con 0x557ed821db40 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7deffd640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x557ed8225670 tx=0x7fd7d400f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5093235e95a2ee10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4003f90 con 0x557ed821db40 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7d4004130 con 0x557ed821db40 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7d0099730 con 0x557ed821db40 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7d4038050 con 0x557ed821db40 2024-09-12T01:58:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7e7e6c740 10 client.15765 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557ed82a1f40 con 0x557ed821db40 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d0099730 con 0x557ed821db40 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.491+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd7d40035f0 con 0x557ed821db40 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 10 client.15765 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 10 client.15765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 20 client.15765 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed82a26f0 0x557ed82a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 4 client.15765 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ed8189d70 con 0x557ed82a26f0 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed82a26f0 0x557ed82a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7beffd640 10 client.15765 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7df7fe640 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed82a26f0 0x557ed82a4b10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e77a78fd9554715a server_cookie=953322b44b8cca43 in_seq=0 out_seq=0 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7beffd640 1 -- 172.21.15.39:0/3712906693 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ed8189d70 con 0x557ed82a26f0 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7beffd640 10 client.15765 handle_command_reply: tid=0 2024-09-12T01:58:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.492+0000 7fd7e7e6c740 1 client.15765 shutdown 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 msgr2=0x557ed822b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x557ed8225670 tx=0x7fd7d400f820 comp rx=0 tx=0).stop 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 shutdown_connections 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x557ed82a26f0 0x557ed82a4b10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ed8227370 0x557ed822bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x557ed821db40 0x557ed822b780 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 --2- 172.21.15.39:0/3712906693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed821c5d0 0x557ed822b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 >> 172.21.15.39:0/3712906693 conn(0x557ed81e5310 msgr2=0x557ed8217d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7beffd640 0 client.15765 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 shutdown_connections 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 1 -- 172.21.15.39:0/3712906693 wait complete. 2024-09-12T01:58:44.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.493+0000 7fd7e7e6c740 20 client.15765 trim_cache size 0 max 16384 2024-09-12T01:58:44.510 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:58:44.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 msgr2=0x7fd7c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 0x7fd7c80a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8047000 tx=0x7fd7d804a000 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 msgr2=0x7fd7e0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000d950 tx=0x7fd7d000de10 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 shutdown_connections 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fd7c80a2c00 0x7fd7c80a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7e01082a0 0x7fd7e0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7e01036e0 0x7fd7e0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 --2- 172.21.15.39:0/105278029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7e0102d30 0x7fd7e0100990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 >> 172.21.15.39:0/105278029 conn(0x7fd7e00fc7d0 msgr2=0x7fd7e0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 shutdown_connections 2024-09-12T01:58:44.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:44.494+0000 7fd7e5a93640 1 -- 172.21.15.39:0/105278029 wait complete. 2024-09-12T01:58:44.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:44 smithi039 ceph-mon[31204]: pgmap v392: 97 pgs: 97 active+clean; 37 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 930 op/s 2024-09-12T01:58:44.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:44 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:44 smithi044 ceph-mon[35259]: pgmap v392: 97 pgs: 97 active+clean; 37 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 930 op/s 2024-09-12T01:58:44.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:44 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:44 smithi172 ceph-mon[35073]: pgmap v392: 97 pgs: 97 active+clean; 37 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 930 op/s 2024-09-12T01:58:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:44 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:58:45.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:58:45.828 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:46.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.324+0000 7f9d79d2b640 1 -- 172.21.15.39:0/1606084596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102570 msgr2=0x7f9d741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.324+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/1606084596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102570 0x7f9d741029b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009900 tx=0x7f9d5c02a480 comp rx=0 tx=0).stop 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 -- 172.21.15.39:0/1606084596 shutdown_connections 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/1606084596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74102ef0 0x7f9d7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/1606084596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102570 0x7f9d741029b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/1606084596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74100e20 0x7f9d74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 -- 172.21.15.39:0/1606084596 >> 172.21.15.39:0/1606084596 conn(0x7f9d740fc7d0 msgr2=0x7f9d740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 -- 172.21.15.39:0/1606084596 shutdown_connections 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 -- 172.21.15.39:0/1606084596 wait complete. 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 Processor -- start 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.325+0000 7f9d79d2b640 1 -- start start 2024-09-12T01:58:46.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 0x7f9d741984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74102570 0x7f9d74198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74110f80 con 0x7f9d74102ef0 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74110e00 con 0x7f9d74100e20 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d79d2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74111100 con 0x7f9d74102570 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 0x7f9d741984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34014/0 (socket says 172.21.15.39:34014) 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 -- 172.21.15.39:0/2933986236 learned_addr learned my addr 172.21.15.39:0/2933986236 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74102570 0x7f9d74198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 -- 172.21.15.39:0/2933986236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74102570 msgr2=0x7f9d74198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74102570 0x7f9d74198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 -- 172.21.15.39:0/2933986236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 msgr2=0x7f9d741984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 0x7f9d741984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 -- 172.21.15.39:0/2933986236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7419d470 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d737fe640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 0x7f9d741984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d73fff640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e970 tx=0x7f9d6c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.326+0000 7f9d70ff9640 1 -- 172.21.15.39:0/2933986236 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00ccc0 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.327+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7419d760 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.327+0000 7f9d70ff9640 1 -- 172.21.15.39:0/2933986236 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d6c00ce60 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.327+0000 7f9d70ff9640 1 -- 172.21.15.39:0/2933986236 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c010490 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.327+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a5040 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.329+0000 7f9d70ff9640 1 -- 172.21.15.39:0/2933986236 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9d6c005020 con 0x7f9d74102ef0 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.329+0000 7f9d7c104740 1 Processor -- start 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.329+0000 7f9d7c104740 1 -- start start 2024-09-12T01:58:46.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e435090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e435a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e446b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55871e39b2f0 con 0x55871e444780 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55871e342cf0 con 0x55871e4355d0 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d7c104740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55871e3972b0 con 0x55871e436b40 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e446b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d70ff9640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 0x7f9d600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e435a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e446b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34026/0 (socket says 172.21.15.39:34026) 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d72ffd640 1 -- 172.21.15.39:0/3682584073 learned_addr learned my addr 172.21.15.39:0/3682584073 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d73fff640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 0x7f9d600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e435090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d70ff9640 1 -- 172.21.15.39:0/2933986236 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d6c0cf480 con 0x7f9d74102ef0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 -- 172.21.15.39:0/3682584073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 msgr2=0x55871e435090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e435090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 -- 172.21.15.39:0/3682584073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 msgr2=0x55871e446b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e446b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 -- 172.21.15.39:0/3682584073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e3273a0 con 0x55871e4355d0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e435090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.330+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e435a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005fd0 tx=0x7f9d64011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19eda9b29c8a02fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d73fff640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 0x7f9d600a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0986c0 tx=0x7f9d6c066970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d69ffb640 1 -- 172.21.15.39:0/3682584073 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64004d20 con 0x55871e4355d0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d69ffb640 1 -- 172.21.15.39:0/3682584073 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d6400f9a0 con 0x55871e4355d0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d69ffb640 1 -- 172.21.15.39:0/3682584073 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64004510 con 0x55871e4355d0 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 -- 172.21.15.39:0/3682584073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 msgr2=0x55871e435a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e435a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005fd0 tx=0x7f9d64011c70 comp rx=0 tx=0).stop 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 -- 172.21.15.39:0/3682584073 shutdown_connections 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e446b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e435a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3682584073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e435090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.331+0000 7f9d7c104740 1 -- 172.21.15.39:0/3682584073 >> 172.21.15.39:0/3682584073 conn(0x55871e3fe310 msgr2=0x55871e431c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- 172.21.15.39:0/3682584073 shutdown_connections 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- 172.21.15.39:0/3682584073 wait complete. 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- start start 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 Processor -- start 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e444150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e444780 0x55871e4419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55871e447480 con 0x55871e436b40 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55871e356060 con 0x55871e4355d0 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55871e447600 con 0x55871e444780 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.332+0000 7f9d7c104740 10 client.0 _ll_register_callbacks cb 0x55871e0a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34028/0 (socket says 172.21.15.39:34028) 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 -- 172.21.15.39:0/3687352401 learned_addr learned my addr 172.21.15.39:0/3687352401 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e444150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e444780 0x55871e4419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 -- 172.21.15.39:0/3687352401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e444780 msgr2=0x55871e4419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e444780 0x55871e4419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 -- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 msgr2=0x55871e444150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e444150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 -- 172.21.15.39:0/3687352401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871e10c3c0 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e444150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d737fe640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005f40 tx=0x7f9d64003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611cfd05e7dca00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64005000 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d640051a0 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.333+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d6400f9a0 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d640053a0 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55871e452e60 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d6400f9a0 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9d64018070 con 0x55871e436b40 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:46.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 10 client.15777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 20 client.15777 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e454260 0x55871e456650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 4 client.15777 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55871e3a8860 con 0x55871e454260 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.334+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e454260 0x55871e456650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.335+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e454260 0x55871e456650 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcf1fe7eb33200d6 server_cookie=b5baf4b7b347acca in_seq=0 out_seq=0 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.335+0000 7f9d52ffd640 10 client.15777 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d52ffd640 1 -- 172.21.15.39:0/3687352401 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55871e3a8860 con 0x55871e454260 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d52ffd640 10 client.15777 handle_command_reply: tid=0 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 client.15777 shutdown 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 msgr2=0x55871e441400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9d64005f40 tx=0x7f9d64003c60 comp rx=0 tx=0).stop 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 shutdown_connections 2024-09-12T01:58:46.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e454260 0x55871e456650 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e444780 0x55871e4419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e436b40 0x55871e441400 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 --2- 172.21.15.39:0/3687352401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e4355d0 0x55871e444150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d52ffd640 0 client.15777 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 >> 172.21.15.39:0/3687352401 conn(0x55871e3fe310 msgr2=0x55871e437960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 shutdown_connections 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 1 -- 172.21.15.39:0/3687352401 wait complete. 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.336+0000 7f9d7c104740 20 client.15777 trim_cache size 0 max 16384 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 Processor -- start 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 -- start start 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e4355d0 0x55871e436410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 0x55871e431e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741adb30 con 0x55871e444780 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ab400 con 0x55871e436b40 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d7c104740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741a9250 con 0x55871e4355d0 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 0x55871e431e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34032/0 (socket says 172.21.15.39:34032) 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.349+0000 7f9d72ffd640 1 -- 172.21.15.39:0/4111463125 learned_addr learned my addr 172.21.15.39:0/4111463125 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e4355d0 0x55871e436410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 -- 172.21.15.39:0/4111463125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e4355d0 msgr2=0x55871e436410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e4355d0 0x55871e436410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 -- 172.21.15.39:0/4111463125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 msgr2=0x55871e431e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 0x55871e431e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 -- 172.21.15.39:0/4111463125 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e456be0 con 0x55871e444780 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d737fe640 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 0x55871e431e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c006010 tx=0x7f9d5c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467234894de69975 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d697fa640 1 -- 172.21.15.39:0/4111463125 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c035040 con 0x55871e444780 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d697fa640 1 -- 172.21.15.39:0/4111463125 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5c003dc0 con 0x55871e444780 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.350+0000 7f9d697fa640 1 -- 172.21.15.39:0/4111463125 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c005620 con 0x55871e444780 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- 172.21.15.39:0/4111463125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 msgr2=0x55871e450720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c006010 tx=0x7f9d5c02a480 comp rx=0 tx=0).stop 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- 172.21.15.39:0/4111463125 shutdown_connections 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e444780 0x55871e450720 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e436b40 0x55871e431e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 --2- 172.21.15.39:0/4111463125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e4355d0 0x55871e436410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- 172.21.15.39:0/4111463125 >> 172.21.15.39:0/4111463125 conn(0x55871e3fe310 msgr2=0x55871e431700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- 172.21.15.39:0/4111463125 shutdown_connections 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- 172.21.15.39:0/4111463125 wait complete. 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 -- start start 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.351+0000 7f9d7c104740 1 Processor -- start 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e43de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e444780 0x55871e43e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741a98c0 con 0x55871e4355d0 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741aad30 con 0x55871e444780 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741a9f90 con 0x55871e436b40 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 10 client.0 _ll_register_callbacks cb 0x7f9d640093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34044/0 (socket says 172.21.15.39:34044) 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 -- 172.21.15.39:0/1985441708 learned_addr learned my addr 172.21.15.39:0/1985441708 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d737fe640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e43de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e444780 0x55871e43e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 -- 172.21.15.39:0/1985441708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 msgr2=0x55871e43de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e43de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 -- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e444780 msgr2=0x55871e43e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e444780 0x55871e43e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 -- 172.21.15.39:0/1985441708 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871e432960 con 0x55871e4355d0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d737fe640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e43de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d72ffd640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0314e0 tx=0x7f9d5c005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2954d77fdccd78b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c035070 con 0x55871e4355d0 2024-09-12T01:58:46.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5c003dc0 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.352+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d5c0038e0 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c041070 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 10 client.15783 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55871e4be920 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5c003dc0 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9d5c03d450 con 0x55871e4355d0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 10 client.15783 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 20 client.15783 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e4bef00 0x55871e4c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 4 client.15783 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55871e3a2d70 con 0x55871e4bef00 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.353+0000 7f9d737fe640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e4bef00 0x55871e4c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:46.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d737fe640 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e4bef00 0x55871e4c1320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4b6139e68af9477 server_cookie=a39cc19602626c60 in_seq=0 out_seq=0 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d52ffd640 10 client.15783 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d52ffd640 1 -- 172.21.15.39:0/1985441708 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55871e3a2d70 con 0x55871e4bef00 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d52ffd640 10 client.15783 handle_command_reply: tid=0 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 client.15783 shutdown 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 msgr2=0x55871e44ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0314e0 tx=0x7f9d5c005460 comp rx=0 tx=0).stop 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 shutdown_connections 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55871e4bef00 0x55871e4c1320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55871e444780 0x55871e43e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e436b40 0x55871e43de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 --2- 172.21.15.39:0/1985441708 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55871e4355d0 0x55871e44ccf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 >> 172.21.15.39:0/1985441708 conn(0x55871e3fe310 msgr2=0x55871e4370e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d52ffd640 0 client.15783 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:58:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 shutdown_connections 2024-09-12T01:58:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 1 -- 172.21.15.39:0/1985441708 wait complete. 2024-09-12T01:58:46.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.354+0000 7f9d7c104740 20 client.15783 trim_cache size 0 max 16384 2024-09-12T01:58:46.371 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 msgr2=0x7f9d600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 0x7f9d600a5040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0986c0 tx=0x7f9d6c066970 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 msgr2=0x7f9d7419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e970 tx=0x7f9d6c00ed70 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 shutdown_connections 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d74102ef0 0x7f9d7419cd90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9d600a2b80 0x7f9d600a5040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d74102570 0x7f9d74198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 --2- 172.21.15.39:0/2933986236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d74100e20 0x7f9d741984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 >> 172.21.15.39:0/2933986236 conn(0x7f9d740fc7d0 msgr2=0x7f9d74069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 shutdown_connections 2024-09-12T01:58:46.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:46.355+0000 7f9d79d2b640 1 -- 172.21.15.39:0/2933986236 wait complete. 2024-09-12T01:58:46.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:46 smithi039 ceph-mon[31204]: pgmap v393: 97 pgs: 97 active+clean; 43 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 961 op/s 2024-09-12T01:58:46.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:46 smithi044 ceph-mon[35259]: pgmap v393: 97 pgs: 97 active+clean; 43 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 961 op/s 2024-09-12T01:58:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:46 smithi172 ceph-mon[35073]: pgmap v393: 97 pgs: 97 active+clean; 43 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 961 op/s 2024-09-12T01:58:47.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:58:47.911 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-12T01:58:47.911 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.911 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-12T01:58:47.912 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.913 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:58:47.913 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T01:58:47.913 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-12T01:58:47.913 INFO:tasks.workunit.client.0.smithi039.stderr:+ make -j4 2024-09-12T01:58:47.921 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize -cfi 2024-09-12T01:58:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 -- 172.21.15.39:0/1726814447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1741025f0 msgr2=0x7fb174108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 --2- 172.21.15.39:0/1726814447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1741025f0 0x7fb174108e80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009ca0 tx=0x7fb16c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 -- 172.21.15.39:0/1726814447 shutdown_connections 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 --2- 172.21.15.39:0/1726814447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1741025f0 0x7fb174108e80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 --2- 172.21.15.39:0/1726814447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb174101c30 0x7fb1741020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 --2- 172.21.15.39:0/1726814447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb174100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 -- 172.21.15.39:0/1726814447 >> 172.21.15.39:0/1726814447 conn(0x7fb1740fc1e0 msgr2=0x7fb1740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.002+0000 7fb178842640 1 -- 172.21.15.39:0/1726814447 shutdown_connections 2024-09-12T01:58:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 -- 172.21.15.39:0/1726814447 wait complete. 2024-09-12T01:58:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 Processor -- start 2024-09-12T01:58:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 -- start start 2024-09-12T01:58:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb17406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1741025f0 0x7fb17419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb17410c6a0 con 0x7fb174101c30 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb17410c520 con 0x7fb174100a40 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.003+0000 7fb178842640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb17410c820 con 0x7fb1741025f0 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34056/0 (socket says 172.21.15.39:34056) 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 -- 172.21.15.39:0/707933366 learned_addr learned my addr 172.21.15.39:0/707933366 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb17259c640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb17406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb172d9d640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1741025f0 0x7fb17419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 -- 172.21.15.39:0/707933366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1741025f0 msgr2=0x7fb17419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1741025f0 0x7fb17419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 -- 172.21.15.39:0/707933366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 msgr2=0x7fb17406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb17406a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 -- 172.21.15.39:0/707933366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17419f9b0 con 0x7fb174101c30 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb17259c640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb17406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb171d9b640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00d950 tx=0x7fb15c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb16b7fe640 1 -- 172.21.15.39:0/707933366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c017030 con 0x7fb174101c30 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb16b7fe640 1 -- 172.21.15.39:0/707933366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c004020 con 0x7fb174101c30 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17419fc40 con 0x7fb174101c30 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.004+0000 7fb16b7fe640 1 -- 172.21.15.39:0/707933366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0047a0 con 0x7fb174101c30 2024-09-12T01:58:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.005+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741a0190 con 0x7fb174101c30 2024-09-12T01:58:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.007+0000 7fb16b7fe640 1 -- 172.21.15.39:0/707933366 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb15c0041d0 con 0x7fb174101c30 2024-09-12T01:58:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.007+0000 7fb17b5d3740 1 Processor -- start 2024-09-12T01:58:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 -- start start 2024-09-12T01:58:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb21780 0x56355eb23c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56355ea7b2f0 con 0x56355eb21780 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56355ea23270 con 0x56355eb1bdb0 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56355ea772b0 con 0x56355eb1c6f0 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:53562/0 (socket says 172.21.15.39:53562) 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 -- 172.21.15.39:0/3237324755 learned_addr learned my addr 172.21.15.39:0/3237324755 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb172d9d640 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb171d9b640 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb21780 0x56355eb23c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 -- 172.21.15.39:0/3237324755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 msgr2=0x56355eb1c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb1c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 -- 172.21.15.39:0/3237324755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb21780 msgr2=0x56355eb23c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.008+0000 7fb17259c640 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb21780 0x56355eb23c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb17259c640 1 -- 172.21.15.39:0/3237324755 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56355ea22340 con 0x56355eb1c6f0 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb16b7fe640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 0x7fb1600a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb172d9d640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 0x7fb1600a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb16b7fe640 1 -- 172.21.15.39:0/707933366 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb15c0ce9c0 con 0x7fb174101c30 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb17259c640 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1640114c0 tx=0x7fb164011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad126cc274fe7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb168ff9640 1 -- 172.21.15.39:0/3237324755 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164004020 con 0x56355eb1c6f0 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb168ff9640 1 -- 172.21.15.39:0/3237324755 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb164005500 con 0x56355eb1c6f0 2024-09-12T01:58:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.009+0000 7fb168ff9640 1 -- 172.21.15.39:0/3237324755 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164004de0 con 0x56355eb1c6f0 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- 172.21.15.39:0/3237324755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 msgr2=0x56355eb211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb172d9d640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 0x7fb1600a5170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb16c005e30 tx=0x7fb16c03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1640114c0 tx=0x7fb164011980 comp rx=0 tx=0).stop 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- 172.21.15.39:0/3237324755 shutdown_connections 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb21780 0x56355eb23c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb211b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/3237324755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb1c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- 172.21.15.39:0/3237324755 >> 172.21.15.39:0/3237324755 conn(0x56355eb13010 msgr2=0x56355eb13410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- 172.21.15.39:0/3237324755 shutdown_connections 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- 172.21.15.39:0/3237324755 wait complete. 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.010+0000 7fb17b5d3740 1 -- start start 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 Processor -- start 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb21780 0x56355eb2d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56355eb24750 con 0x56355eb1bdb0 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56355ea04290 con 0x56355eb21780 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56355eb248d0 con 0x56355eb1c6f0 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17b5d3740 10 client.0 _ll_register_callbacks cb 0x56355ea35140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34062/0 (socket says 172.21.15.39:34062) 2024-09-12T01:58:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 -- 172.21.15.39:0/721273185 learned_addr learned my addr 172.21.15.39:0/721273185 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb172d9d640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb21780 0x56355eb2d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb171d9b640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 -- 172.21.15.39:0/721273185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 msgr2=0x56355eb264b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb264b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 -- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb21780 msgr2=0x56355eb2d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb21780 0x56355eb2d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 -- 172.21.15.39:0/721273185 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56355e78e210 con 0x56355eb1bdb0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb17259c640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb164011e80 tx=0x7fb164005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1799c98b0496bd0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.011+0000 7fb159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164028030 con 0x56355eb1bdb0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb164005500 con 0x56355eb1bdb0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb164016040 con 0x56355eb1bdb0 2024-09-12T01:58:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb16401d040 con 0x56355eb1bdb0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb17b5d3740 10 client.15795 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56355e85a620 con 0x56355eb1bdb0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.012+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb164005500 con 0x56355eb1bdb0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb164023470 con 0x56355eb1bdb0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 10 client.15795 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 20 client.15795 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb31a50 0x56355eb33ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 4 client.15795 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56355ea88a20 con 0x56355eb31a50 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb171d9b640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb31a50 0x56355eb33ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb171d9b640 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb31a50 0x56355eb33ef0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14c3c1aa2cda1cd server_cookie=d52ab32cf80b3d27 in_seq=0 out_seq=0 2024-09-12T01:58:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.013+0000 7fb159ffb640 10 client.15795 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb159ffb640 1 -- 172.21.15.39:0/721273185 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56355ea88a20 con 0x56355eb31a50 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb159ffb640 10 client.15795 handle_command_reply: tid=0 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 client.15795 shutdown 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 msgr2=0x56355eb25f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb164011e80 tx=0x7fb164005270 comp rx=0 tx=0).stop 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 shutdown_connections 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb31a50 0x56355eb33ef0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb21780 0x56355eb2d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb1c6f0 0x56355eb264b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb159ffb640 0 client.15795 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/721273185 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb25f70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 >> 172.21.15.39:0/721273185 conn(0x56355eb13010 msgr2=0x56355eb14820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 shutdown_connections 2024-09-12T01:58:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 1 -- 172.21.15.39:0/721273185 wait complete. 2024-09-12T01:58:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.014+0000 7fb17b5d3740 20 client.15795 trim_cache size 0 max 16384 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.030+0000 7fb17b5d3740 1 Processor -- start 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 -- start start 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb26390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a9630 con 0x56355eb1c6f0 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a6f00 con 0x56355eb1bdb0 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a4d50 con 0x56355eb21780 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34072/0 (socket says 172.21.15.39:34072) 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 -- 172.21.15.39:0/66366405 learned_addr learned my addr 172.21.15.39:0/66366405 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17259c640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb26390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb172d9d640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 -- 172.21.15.39:0/66366405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 msgr2=0x56355eb387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 -- 172.21.15.39:0/66366405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 msgr2=0x56355eb26390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb26390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 -- 172.21.15.39:0/66366405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56355eb14ea0 con 0x56355eb1c6f0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb17259c640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb26390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.031+0000 7fb171d9b640 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009610 tx=0x7fb15c0d0d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c9413cd6906c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb15bfff640 1 -- 172.21.15.39:0/66366405 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c09b8d0 con 0x56355eb1c6f0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb15bfff640 1 -- 172.21.15.39:0/66366405 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c09b1d0 con 0x56355eb1c6f0 2024-09-12T01:58:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb15bfff640 1 -- 172.21.15.39:0/66366405 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c097840 con 0x56355eb1c6f0 2024-09-12T01:58:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 -- 172.21.15.39:0/66366405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 msgr2=0x56355eb2d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009610 tx=0x7fb15c0d0d90 comp rx=0 tx=0).stop 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 -- 172.21.15.39:0/66366405 shutdown_connections 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1c6f0 0x56355eb2d4b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/66366405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1bdb0 0x56355eb26390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.032+0000 7fb17b5d3740 1 -- 172.21.15.39:0/66366405 >> 172.21.15.39:0/66366405 conn(0x56355eb13010 msgr2=0x56355eb121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- 172.21.15.39:0/66366405 shutdown_connections 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- 172.21.15.39:0/66366405 wait complete. 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- start start 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 Processor -- start 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 0x56355eb2b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb2c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a53c0 con 0x56355eb1bdb0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a6830 con 0x56355eb1c6f0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741a5a90 con 0x56355eb21780 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17b5d3740 10 client.0 _ll_register_callbacks cb 0x7fb16c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17259c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34086/0 (socket says 172.21.15.39:34086) 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb17259c640 1 -- 172.21.15.39:0/2790266601 learned_addr learned my addr 172.21.15.39:0/2790266601 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb171d9b640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 0x56355eb2b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.033+0000 7fb172d9d640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb2c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 -- 172.21.15.39:0/2790266601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 msgr2=0x56355eb2c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb2c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 -- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 msgr2=0x56355eb2b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 0x56355eb2b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 -- 172.21.15.39:0/2790266601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56355eb2cf40 con 0x56355eb1bdb0 2024-09-12T01:58:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb171d9b640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 0x56355eb2b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17259c640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb164023910 tx=0x7fb1640236a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b3061681ddeff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb159ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16403a020 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb164011240 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c09b1d0 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb164028040 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17b5d3740 10 client.15801 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56355eb9cfe0 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.034+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c09b1d0 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb164003710 con 0x56355eb1bdb0 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 10 client.15801 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:48.039 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 20 client.15801 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb9da20 0x56355eb9fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 4 client.15801 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56355ea82d70 con 0x56355eb9da20 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb171d9b640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb9da20 0x56355eb9fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb159ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.040 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.035+0000 7fb171d9b640 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb9da20 0x56355eb9fe40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf4f900303bfc72 server_cookie=9b6766aad56f9961 in_seq=0 out_seq=0 2024-09-12T01:58:48.060 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.283+0000 7fb159ffb640 1 -- 172.21.15.39:0/2790266601 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56355ea82d70 con 0x56355eb9da20 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.283+0000 7fb159ffb640 10 client.15801 handle_command_reply: tid=0 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.283+0000 7fb17b5d3740 1 client.15801 shutdown 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 msgr2=0x56355eb2b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb164023910 tx=0x7fb1640236a0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 shutdown_connections 2024-09-12T01:58:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x56355eb9da20 0x56355eb9fe40 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56355eb21780 0x56355eb2c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56355eb1c6f0 0x56355eb2b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 --2- 172.21.15.39:0/2790266601 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56355eb1bdb0 0x56355eb2b3e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 >> 172.21.15.39:0/2790266601 conn(0x56355eb13010 msgr2=0x56355eb13ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb159ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 shutdown_connections 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 1 -- 172.21.15.39:0/2790266601 wait complete. 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.284+0000 7fb17b5d3740 20 client.15801 trim_cache size 0 max 16384 2024-09-12T01:58:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 msgr2=0x7fb1600a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 0x7fb1600a5170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb16c005e30 tx=0x7fb16c03d040 comp rx=0 tx=0).stop 2024-09-12T01:58:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 msgr2=0x7fb17419ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00d950 tx=0x7fb15c00de10 comp rx=0 tx=0).stop 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 shutdown_connections 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb1600a2cb0 0x7fb1600a5170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1741025f0 0x7fb17419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb174101c30 0x7fb17419ca80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 --2- 172.21.15.39:0/707933366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb174100a40 0x7fb17406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 >> 172.21.15.39:0/707933366 conn(0x7fb1740fc1e0 msgr2=0x7fb174104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 shutdown_connections 2024-09-12T01:58:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:58:48.285+0000 7fb178842640 1 -- 172.21.15.39:0/707933366 wait complete. 2024-09-12T01:58:48.526 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:48 smithi039 ceph-mon[31204]: pgmap v394: 97 pgs: 97 active+clean; 44 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 940 op/s 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 -- 172.21.15.39:0/2455570797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c8102df0 msgr2=0x7f98c81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 --2- 172.21.15.39:0/2455570797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c8102df0 0x7f98c81031d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009900 tx=0x7f98bc02a410 comp rx=0 tx=0).stop 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 -- 172.21.15.39:0/2455570797 shutdown_connections 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 --2- 172.21.15.39:0/2455570797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 --2- 172.21.15.39:0/2455570797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c81037a0 0x7f98c810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 --2- 172.21.15.39:0/2455570797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c8102df0 0x7f98c81031d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 -- 172.21.15.39:0/2455570797 >> 172.21.15.39:0/2455570797 conn(0x7f98c80fc7d0 msgr2=0x7f98c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 -- 172.21.15.39:0/2455570797 shutdown_connections 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.614+0000 7f98cee30640 1 -- 172.21.15.39:0/2455570797 wait complete. 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 Processor -- start 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 -- start start 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c8102df0 0x7f98c8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98c8112110 con 0x7f98c81037a0 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98c8111f90 con 0x7f98c8102df0 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cee30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98c8112290 con 0x7f98c810c2f0 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34102/0 (socket says 172.21.15.39:34102) 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 -- 172.21.15.39:0/3664181780 learned_addr learned my addr 172.21.15.39:0/3664181780 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c8102df0 0x7f98c8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 -- 172.21.15.39:0/3664181780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 msgr2=0x7f98c819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 -- 172.21.15.39:0/3664181780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c8102df0 msgr2=0x7f98c8198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c8102df0 0x7f98c8198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98c7fff640 1 -- 172.21.15.39:0/3664181780 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c819d600 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.615+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98c7fff640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f98b400e9f0 tx=0x7f98b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98c5ffb640 1 -- 172.21.15.39:0/3664181780 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b400ccc0 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c819d8f0 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c81a51d0 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98c5ffb640 1 -- 172.21.15.39:0/3664181780 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b4010910 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.616+0000 7f98c5ffb640 1 -- 172.21.15.39:0/3664181780 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4018860 con 0x7f98c81037a0 2024-09-12T01:58:48.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.618+0000 7f98c5ffb640 1 -- 172.21.15.39:0/3664181780 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f98b4010ac0 con 0x7f98c81037a0 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 Processor -- start 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 -- start start 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98c5ffb640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 0x7f98b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ede090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 0x55bc30eeb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc30e442f0 con 0x55bc30ede5d0 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc30debcf0 con 0x55bc30edfb40 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98d1209740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc30e402b0 con 0x55bc30ee9370 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98c5ffb640 1 -- 172.21.15.39:0/3664181780 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98b40cf500 con 0x7f98c81037a0 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 0x7f98b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98ccbcc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ede090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98ccbcc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ede090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:54028/0 (socket says 172.21.15.39:54028) 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.619+0000 7f98ccbcc640 1 -- 172.21.15.39:0/1231181753 learned_addr learned my addr 172.21.15.39:0/1231181753 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 0x55bc30eeb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 -- 172.21.15.39:0/1231181753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 msgr2=0x55bc30eeb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 0x55bc30eeb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 -- 172.21.15.39:0/1231181753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 msgr2=0x55bc30ede090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ede090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 -- 172.21.15.39:0/1231181753 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc30dd03a0 con 0x55bc30ede5d0 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 0x55bc30eeb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 0x7f98b80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f98c0008c60 tx=0x7f98c000d710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98c7fff640 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edea10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f98b409ba70 tx=0x7f98b4010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78ccc4cfb412e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98b2ffd640 1 -- 172.21.15.39:0/1231181753 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b40a0120 con 0x55bc30ede5d0 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98b2ffd640 1 -- 172.21.15.39:0/1231181753 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b40a49e0 con 0x55bc30ede5d0 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.620+0000 7f98b2ffd640 1 -- 172.21.15.39:0/1231181753 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b409b420 con 0x55bc30ede5d0 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- 172.21.15.39:0/1231181753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 msgr2=0x55bc30edea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edea10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f98b409ba70 tx=0x7f98b4010eb0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- 172.21.15.39:0/1231181753 shutdown_connections 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ee9370 0x55bc30eeb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edea10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 --2- 172.21.15.39:0/1231181753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ede090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- 172.21.15.39:0/1231181753 >> 172.21.15.39:0/1231181753 conn(0x55bc30ea7310 msgr2=0x55bc30edac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- 172.21.15.39:0/1231181753 shutdown_connections 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- 172.21.15.39:0/1231181753 wait complete. 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 -- start start 2024-09-12T01:58:48.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.621+0000 7f98d1209740 1 Processor -- start 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ee6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bc30eebfb0 con 0x55bc30ee9370 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc30dff060 con 0x55bc30edfb40 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc30eec130 con 0x55bc30ede5d0 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98d1209740 10 client.0 _ll_register_callbacks cb 0x55bc30b528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34120/0 (socket says 172.21.15.39:34120) 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 -- 172.21.15.39:0/3532610972 learned_addr learned my addr 172.21.15.39:0/3532610972 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98c7fff640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ee6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 -- 172.21.15.39:0/3532610972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 msgr2=0x55bc30ee8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 -- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 msgr2=0x55bc30ee6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ee6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.622+0000 7f98cd3cd640 1 -- 172.21.15.39:0/3532610972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc30bb53c0 con 0x55bc30ee9370 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011df0 tx=0x7f98c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb332e572db8b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0021030 con 0x55bc30ee9370 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98c001d440 con 0x55bc30ee9370 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98b40a49e0 con 0x55bc30ee9370 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98c0011e20 con 0x55bc30ee9370 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 10 client.15813 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:48.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc30ef7a50 con 0x55bc30ee9370 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98b40a49e0 con 0x55bc30ee9370 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f98c0026770 con 0x55bc30ee9370 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 10 client.15813 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 20 client.15813 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30efb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 4 client.15813 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.623+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc30e51860 con 0x55bc30ef8f60 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.624+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30efb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.624+0000 7f98a7fff640 10 client.15813 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.624+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30efb390 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da959319b9864438 server_cookie=3fcd549b83a70dd7 in_seq=0 out_seq=0 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98a7fff640 1 -- 172.21.15.39:0/3532610972 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc30e51860 con 0x55bc30ef8f60 2024-09-12T01:58:48.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98a7fff640 10 client.15813 handle_command_reply: tid=0 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 client.15813 shutdown 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 msgr2=0x55bc30ee6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011df0 tx=0x7f98c0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 shutdown_connections 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30efb390 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ee9370 0x55bc30ee6650 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30edfb40 0x55bc30ee6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98a7fff640 0 client.15813 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 --2- 172.21.15.39:0/3532610972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 >> 172.21.15.39:0/3532610972 conn(0x55bc30ea7310 msgr2=0x55bc30ee0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 shutdown_connections 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 1 -- 172.21.15.39:0/3532610972 wait complete. 2024-09-12T01:58:48.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.625+0000 7f98d1209740 20 client.15813 trim_cache size 0 max 16384 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.638+0000 7f98d1209740 1 Processor -- start 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.638+0000 7f98d1209740 1 -- start start 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 0x55bc30ef5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81add20 con 0x55bc30ede5d0 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81ab5f0 con 0x55bc30ee9370 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98d1209740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81a9440 con 0x55bc30edfb40 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34136/0 (socket says 172.21.15.39:34136) 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 -- 172.21.15.39:0/903990843 learned_addr learned my addr 172.21.15.39:0/903990843 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98c7fff640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 0x55bc30ef5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 -- 172.21.15.39:0/903990843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 msgr2=0x55bc30ef5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 0x55bc30ef5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 -- 172.21.15.39:0/903990843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 msgr2=0x55bc30ee5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 -- 172.21.15.39:0/903990843 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc30ee4ff0 con 0x55bc30ede5d0 2024-09-12T01:58:48.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98c7fff640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 0x55bc30ef5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f98bc031550 tx=0x7f98bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab9c304e87e9d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98b27fc640 1 -- 172.21.15.39:0/903990843 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc04a070 con 0x55bc30ede5d0 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.639+0000 7f98b27fc640 1 -- 172.21.15.39:0/903990843 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98bc005520 con 0x55bc30ede5d0 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98b27fc640 1 -- 172.21.15.39:0/903990843 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc035040 con 0x55bc30ede5d0 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 -- 172.21.15.39:0/903990843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 msgr2=0x55bc30edae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f98bc031550 tx=0x7f98bc000bc0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 -- 172.21.15.39:0/903990843 shutdown_connections 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30edfb40 0x55bc30ef5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 --2- 172.21.15.39:0/903990843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30ede5d0 0x55bc30edae10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 -- 172.21.15.39:0/903990843 >> 172.21.15.39:0/903990843 conn(0x55bc30ea7310 msgr2=0x55bc30eda700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 -- 172.21.15.39:0/903990843 shutdown_connections 2024-09-12T01:58:48.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.640+0000 7f98d1209740 1 -- 172.21.15.39:0/903990843 wait complete. 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 -- start start 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 Processor -- start 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30edfb40 0x55bc30ee34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81a9ab0 con 0x55bc30edfb40 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81aaf20 con 0x55bc30ee9370 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98c81aa180 con 0x55bc30ede5d0 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98d1209740 10 client.0 _ll_register_callbacks cb 0x7f98c0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.641+0000 7f98c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30edfb40 0x55bc30ee34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:54058/0 (socket says 172.21.15.39:54058) 2024-09-12T01:58:48.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 -- 172.21.15.39:0/2976255141 learned_addr learned my addr 172.21.15.39:0/2976255141 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 -- 172.21.15.39:0/2976255141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 msgr2=0x55bc30ee2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 -- 172.21.15.39:0/2976255141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30edfb40 msgr2=0x55bc30ee34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30edfb40 0x55bc30ee34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 -- 172.21.15.39:0/2976255141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc30f62c30 con 0x55bc30ee9370 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98cd3cd640 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011860 tx=0x7f98c0026960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1cbd09410addaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c0037070 con 0x55bc30ee9370 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98bc005520 con 0x55bc30ee9370 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.642+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98c0031450 con 0x55bc30ee9370 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f98c0021040 con 0x55bc30ee9370 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 10 client.25409 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:48.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc30f63e50 con 0x55bc30ee9370 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98bc005520 con 0x55bc30ee9370 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f98c0031b30 con 0x55bc30ee9370 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 10 client.25409 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 20 client.25409 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30f66630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 4 client.25409 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc30e4bd70 con 0x55bc30ef8f60 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.643+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30f66630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98ccbcc640 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30f66630 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa79b032ac65e1b server_cookie=d656c23b5a7c040c in_seq=0 out_seq=0 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98a7fff640 10 client.25409 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98a7fff640 1 -- 172.21.15.39:0/2976255141 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc30e4bd70 con 0x55bc30ef8f60 2024-09-12T01:58:48.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98a7fff640 10 client.25409 handle_command_reply: tid=0 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 client.25409 shutdown 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 msgr2=0x55bc30ee39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98c0011860 tx=0x7f98c0026960 comp rx=0 tx=0).stop 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 shutdown_connections 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55bc30ef8f60 0x55bc30f66630 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc30ee9370 0x55bc30ee39f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bc30edfb40 0x55bc30ee34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98a7fff640 0 client.25409 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 --2- 172.21.15.39:0/2976255141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc30ede5d0 0x55bc30ee2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 >> 172.21.15.39:0/2976255141 conn(0x55bc30ea7310 msgr2=0x55bc30eda700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 shutdown_connections 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 1 -- 172.21.15.39:0/2976255141 wait complete. 2024-09-12T01:58:48.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.644+0000 7f98d1209740 20 client.25409 trim_cache size 0 max 16384 2024-09-12T01:58:48.655 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:58:48.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 msgr2=0x7f98b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 0x7f98b80a5040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f98c0008c60 tx=0x7f98c000d710 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 msgr2=0x7f98c8198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f98b400e9f0 tx=0x7f98b400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 shutdown_connections 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f98b80a2b80 0x7f98b80a5040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98c810c2f0 0x7f98c819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f98c81037a0 0x7f98c8198b90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 --2- 172.21.15.39:0/3664181780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98c8102df0 0x7f98c8198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 >> 172.21.15.39:0/3664181780 conn(0x7f98c80fc7d0 msgr2=0x7f98c80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 shutdown_connections 2024-09-12T01:58:48.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:48.645+0000 7f98cee30640 1 -- 172.21.15.39:0/3664181780 wait complete. 2024-09-12T01:58:48.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:48 smithi044 ceph-mon[35259]: pgmap v394: 97 pgs: 97 active+clean; 44 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 940 op/s 2024-09-12T01:58:48.684 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-12T01:58:48.684 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file './config.guess' 2024-09-12T01:58:48.689 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file './config.sub' 2024-09-12T01:58:48.694 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file './install-sh' 2024-09-12T01:58:48.700 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file './ltmain.sh' 2024-09-12T01:58:48.724 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-12T01:58:48.725 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-12T01:58:48.734 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-12T01:58:48.742 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-12T01:58:48.751 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-12T01:58:48.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:48 smithi172 ceph-mon[35073]: pgmap v394: 97 pgs: 97 active+clean; 44 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 940 op/s 2024-09-12T01:58:48.759 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-12T01:58:48.770 INFO:tasks.workunit.client.0.smithi039.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-12T01:58:48.772 INFO:tasks.workunit.client.0.smithi039.stdout:cp include/install-sh . 2024-09-12T01:58:48.796 INFO:tasks.workunit.client.0.smithi039.stdout:aclocal -I m4 2024-09-12T01:58:50.171 INFO:tasks.workunit.client.0.smithi039.stdout:autoheader 2024-09-12T01:58:50.436 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:58:50.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:58:50.492 INFO:tasks.workunit.client.0.smithi039.stdout:autoconf 2024-09-12T01:58:50.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:50 smithi039 ceph-mon[31204]: pgmap v395: 97 pgs: 97 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 931 op/s 2024-09-12T01:58:50.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:50 smithi044 ceph-mon[35259]: pgmap v395: 97 pgs: 97 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 931 op/s 2024-09-12T01:58:50.680 INFO:tasks.workunit.client.0.smithi039.stdout:./configure \ 2024-09-12T01:58:50.680 INFO:tasks.workunit.client.0.smithi039.stdout: --libexecdir=/usr/lib \ 2024-09-12T01:58:50.681 INFO:tasks.workunit.client.0.smithi039.stdout: --exec_prefix=/var/lib 2024-09-12T01:58:50.725 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:50.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:50 smithi172 ceph-mon[35073]: pgmap v395: 97 pgs: 97 active+clean; 43 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 931 op/s 2024-09-12T01:58:50.874 INFO:tasks.workunit.client.0.smithi039.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-12T01:58:50.874 INFO:tasks.workunit.client.0.smithi039.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-12T01:58:50.875 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to print strings... printf 2024-09-12T01:58:50.876 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc... gcc 2024-09-12T01:58:50.982 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether the C compiler works... yes 2024-09-12T01:58:50.983 INFO:tasks.workunit.client.0.smithi039.stdout:checking for C compiler default output file name... a.out 2024-09-12T01:58:51.023 INFO:tasks.workunit.client.0.smithi039.stdout:checking for suffix of executables... 2024-09-12T01:58:51.085 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether we are cross compiling... no 2024-09-12T01:58:51.142 INFO:tasks.workunit.client.0.smithi039.stdout:checking for suffix of object files... o 2024-09-12T01:58:51.181 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether we are using the GNU C compiler... yes 2024-09-12T01:58:51.210 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether gcc accepts -g... yes 2024-09-12T01:58:51.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 -- 172.21.15.39:0/1292052598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610101de0 msgr2=0x7fe6101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 --2- 172.21.15.39:0/1292052598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610101de0 0x7fe6101021c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009900 tx=0x7fe60c02a410 comp rx=0 tx=0).stop 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 -- 172.21.15.39:0/1292052598 shutdown_connections 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 --2- 172.21.15.39:0/1292052598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 0x7fe61010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 --2- 172.21.15.39:0/1292052598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610102790 0x7fe6101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 --2- 172.21.15.39:0/1292052598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610101de0 0x7fe6101021c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 -- 172.21.15.39:0/1292052598 >> 172.21.15.39:0/1292052598 conn(0x7fe6100fd8c0 msgr2=0x7fe6100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 -- 172.21.15.39:0/1292052598 shutdown_connections 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.293+0000 7fe617a92640 1 -- 172.21.15.39:0/1292052598 wait complete. 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 Processor -- start 2024-09-12T01:58:51.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 -- start start 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 0x7fe61019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 0x7fe61019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe610111f90 con 0x7fe610102790 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe610111e10 con 0x7fe610106f10 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe617a92640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe610112110 con 0x7fe610101de0 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34162/0 (socket says 172.21.15.39:34162) 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe61502d640 1 -- 172.21.15.39:0/2300143560 learned_addr learned my addr 172.21.15.39:0/2300143560 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.294+0000 7fe61602f640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 0x7fe61019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61582e640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 0x7fe61019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 -- 172.21.15.39:0/2300143560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 msgr2=0x7fe61019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 0x7fe61019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 -- 172.21.15.39:0/2300143560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 msgr2=0x7fe61019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 0x7fe61019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 -- 172.21.15.39:0/2300143560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61019f6a0 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61582e640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 0x7fe61019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe61502d640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b4a0 tx=0x7fe60000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe606ffd640 1 -- 172.21.15.39:0/2300143560 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600014070 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61019f990 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe606ffd640 1 -- 172.21.15.39:0/2300143560 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe600010af0 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe606ffd640 1 -- 172.21.15.39:0/2300143560 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600017d10 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.295+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6101a7270 con 0x7fe610102790 2024-09-12T01:58:51.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.297+0000 7fe606ffd640 1 -- 172.21.15.39:0/2300143560 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe600017070 con 0x7fe610102790 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 Processor -- start 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 -- start start 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf256480 0x560ebf260800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf260d40 0x560ebf263130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560ebf1bb280 con 0x560ebf255b60 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560ebf162b10 con 0x560ebf260d40 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe619e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560ebf1b7240 con 0x560ebf256480 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe606ffd640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 0x7fe5fc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe61602f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe61602f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34168/0 (socket says 172.21.15.39:34168) 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.298+0000 7fe61602f640 1 -- 172.21.15.39:0/699488813 learned_addr learned my addr 172.21.15.39:0/699488813 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:51.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61582e640 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf256480 0x560ebf260800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61502d640 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf260d40 0x560ebf263130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe606ffd640 1 -- 172.21.15.39:0/2300143560 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe6000ce3f0 con 0x7fe610102790 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 0x7fe5fc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 -- 172.21.15.39:0/699488813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf256480 msgr2=0x560ebf260800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf256480 0x560ebf260800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 -- 172.21.15.39:0/699488813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf260d40 msgr2=0x560ebf263130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf260d40 0x560ebf263130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 -- 172.21.15.39:0/699488813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebf16f1f0 con 0x560ebf255b60 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe6080139c0 tx=0x7fe608013e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edd5760efb2a8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe61602f640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 0x7fe5fc0a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe60801c000 tx=0x7fe60801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe5fbfff640 1 -- 172.21.15.39:0/699488813 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60801dc60 con 0x560ebf255b60 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe5fbfff640 1 -- 172.21.15.39:0/699488813 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe608021070 con 0x560ebf255b60 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.299+0000 7fe5fbfff640 1 -- 172.21.15.39:0/699488813 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608004700 con 0x560ebf255b60 2024-09-12T01:58:51.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 -- 172.21.15.39:0/699488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 msgr2=0x560ebf255f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe6080139c0 tx=0x7fe608013e80 comp rx=0 tx=0).stop 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 -- 172.21.15.39:0/699488813 shutdown_connections 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf260d40 0x560ebf263130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf256480 0x560ebf260800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 --2- 172.21.15.39:0/699488813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf255f40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 -- 172.21.15.39:0/699488813 >> 172.21.15.39:0/699488813 conn(0x560ebf2520f0 msgr2=0x560ebf2524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 -- 172.21.15.39:0/699488813 shutdown_connections 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.300+0000 7fe619e6b740 1 -- 172.21.15.39:0/699488813 wait complete. 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 -- start start 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 Processor -- start 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf25dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf25e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560ebf263910 con 0x560ebf256480 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560ebf175f10 con 0x560ebf255b60 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560ebf263a90 con 0x560ebf260d40 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe619e6b740 10 client.0 _ll_register_callbacks cb 0x560ebf13ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34180/0 (socket says 172.21.15.39:34180) 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe61502d640 1 -- 172.21.15.39:0/2497697490 learned_addr learned my addr 172.21.15.39:0/2497697490 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.301+0000 7fe61582e640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf25dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61602f640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf25e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 -- 172.21.15.39:0/2497697490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 msgr2=0x560ebf25e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf25e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 -- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 msgr2=0x560ebf25dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf25dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 -- 172.21.15.39:0/2497697490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebef2c6a0 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61602f640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf25e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe61502d640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe600009420 tx=0x7fe60001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b18611a6efc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60001e040 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe600010ca0 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe608021070 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6000b3e60 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe619e6b740 10 client.15831 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ebf26f5d0 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe608021070 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.302+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe60001ecf0 con 0x560ebf256480 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 10 client.15831 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:51.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 20 client.15831 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf270ae0 0x560ebf272f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 4 client.15831 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ebf1c87f0 con 0x560ebf270ae0 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe61582e640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf270ae0 0x560ebf272f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe5f97fa640 10 client.15831 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.303+0000 7fe61582e640 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf270ae0 0x560ebf272f10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5b301c1bfc874 server_cookie=5f7497f14175e8d2 in_seq=0 out_seq=0 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe5f97fa640 1 -- 172.21.15.39:0/2497697490 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ebf1c87f0 con 0x560ebf270ae0 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe5f97fa640 10 client.15831 handle_command_reply: tid=0 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 client.15831 shutdown 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 msgr2=0x560ebf25e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe600009420 tx=0x7fe60001c000 comp rx=0 tx=0).stop 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 shutdown_connections 2024-09-12T01:58:51.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf270ae0 0x560ebf272f10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf25e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf25e1c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2497697490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf25dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 >> 172.21.15.39:0/2497697490 conn(0x560ebf2520f0 msgr2=0x560ebf251270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe5f97fa640 0 client.15831 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 shutdown_connections 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 1 -- 172.21.15.39:0/2497697490 wait complete. 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.304+0000 7fe619e6b740 20 client.15831 trim_cache size 0 max 16384 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 Processor -- start 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 -- start start 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf256480 0x560ebf25fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf278820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101b20f0 con 0x560ebf255b60 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101af9c0 con 0x560ebf256480 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe619e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101ad810 con 0x560ebf260d40 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34194/0 (socket says 172.21.15.39:34194) 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 -- 172.21.15.39:0/2407592366 learned_addr learned my addr 172.21.15.39:0/2407592366 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61502d640 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf256480 0x560ebf25fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 -- 172.21.15.39:0/2407592366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 msgr2=0x560ebf278820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf278820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 -- 172.21.15.39:0/2407592366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf256480 msgr2=0x560ebf25fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf256480 0x560ebf25fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 -- 172.21.15.39:0/2407592366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebf260550 con 0x560ebf255b60 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.322+0000 7fe61582e640 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009230 tx=0x7fe60c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c3006de797264b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe5fb7fe640 1 -- 172.21.15.39:0/2407592366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c035040 con 0x560ebf255b60 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe5fb7fe640 1 -- 172.21.15.39:0/2407592366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe60c049070 con 0x560ebf255b60 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe5fb7fe640 1 -- 172.21.15.39:0/2407592366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c005630 con 0x560ebf255b60 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 -- 172.21.15.39:0/2407592366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 msgr2=0x560ebf2585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009230 tx=0x7fe60c005a40 comp rx=0 tx=0).stop 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 -- 172.21.15.39:0/2407592366 shutdown_connections 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf278820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf256480 0x560ebf25fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 --2- 172.21.15.39:0/2407592366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf255b60 0x560ebf2585c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 -- 172.21.15.39:0/2407592366 >> 172.21.15.39:0/2407592366 conn(0x560ebf2520f0 msgr2=0x560ebf25f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.323+0000 7fe619e6b740 1 -- 172.21.15.39:0/2407592366 shutdown_connections 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 -- 172.21.15.39:0/2407592366 wait complete. 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 -- start start 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 Processor -- start 2024-09-12T01:58:51.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf268f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf265d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101ade80 con 0x560ebf256480 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101af2f0 con 0x560ebf255b60 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6101ae550 con 0x560ebf260d40 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe619e6b740 10 client.0 _ll_register_callbacks cb 0x7fe600096f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.324+0000 7fe61502d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34202/0 (socket says 172.21.15.39:34202) 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61582e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf268f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 -- 172.21.15.39:0/1963920433 learned_addr learned my addr 172.21.15.39:0/1963920433 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61602f640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf265d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 -- 172.21.15.39:0/1963920433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 msgr2=0x560ebf265d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf265d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 -- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 msgr2=0x560ebf268f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf268f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 -- 172.21.15.39:0/1963920433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebf266560 con 0x560ebf256480 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61582e640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf268f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe61502d640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe600098f10 tx=0x7fe60009a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a30adf55b1942c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe5f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60007d060 con 0x560ebf256480 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe600010ca0 con 0x560ebf256480 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe60c049070 con 0x560ebf256480 2024-09-12T01:58:51.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe60001e040 con 0x560ebf256480 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe619e6b740 10 client.15837 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.325+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ebf2dc3e0 con 0x560ebf256480 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe60c049070 con 0x560ebf256480 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe600010610 con 0x560ebf256480 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 20 client.15837 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf2dcb30 0x560ebf2def50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 4 client.15837 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560ebf1c2d00 con 0x560ebf2dcb30 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe61582e640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf2dcb30 0x560ebf2def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:51.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe5f97fa640 10 client.15837 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.326+0000 7fe61582e640 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf2dcb30 0x560ebf2def50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9186813ee506fa07 server_cookie=771d52f2efee15ab in_seq=0 out_seq=0 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe5f97fa640 1 -- 172.21.15.39:0/1963920433 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560ebf1c2d00 con 0x560ebf2dcb30 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe5f97fa640 10 client.15837 handle_command_reply: tid=0 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 client.15837 shutdown 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 msgr2=0x560ebf269490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe600098f10 tx=0x7fe60009a610 comp rx=0 tx=0).stop 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 shutdown_connections 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560ebf2dcb30 0x560ebf2def50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560ebf260d40 0x560ebf265d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560ebf256480 0x560ebf269490 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 --2- 172.21.15.39:0/1963920433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560ebf255b60 0x560ebf268f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 >> 172.21.15.39:0/1963920433 conn(0x560ebf2520f0 msgr2=0x560ebf25fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe5f97fa640 0 client.15837 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 shutdown_connections 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 1 -- 172.21.15.39:0/1963920433 wait complete. 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.327+0000 7fe619e6b740 20 client.15837 trim_cache size 0 max 16384 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "8e3dbe9e-3ce9-42f5-8d4f-7b8e5f405d45", 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-12T01:58:51.358 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 msgr2=0x7fe5fc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 0x7fe5fc0a50c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe60801c000 tx=0x7fe60801e000 comp rx=0 tx=0).stop 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 msgr2=0x7fe61019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b4a0 tx=0x7fe60000b960 comp rx=0 tx=0).stop 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 shutdown_connections 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe610106f10 0x7fe61019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe610102790 0x7fe61019ac30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe5fc0a2c00 0x7fe5fc0a50c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 --2- 172.21.15.39:0/2300143560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe610101de0 0x7fe61019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:51.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 >> 172.21.15.39:0/2300143560 conn(0x7fe6100fd8c0 msgr2=0x7fe6100febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:51.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 shutdown_connections 2024-09-12T01:58:51.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:51.328+0000 7fe617a92640 1 -- 172.21.15.39:0/2300143560 wait complete. 2024-09-12T01:58:51.414 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-12T01:58:51.422 INFO:tasks.workunit.client.0.smithi039.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-12T01:58:51.426 INFO:tasks.workunit.client.0.smithi039.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-12T01:58:51.427 INFO:tasks.workunit.client.0.smithi039.stdout:checking for egrep... /usr/bin/grep -E 2024-09-12T01:58:51.429 INFO:tasks.workunit.client.0.smithi039.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-12T01:58:51.433 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-12T01:58:51.435 INFO:tasks.workunit.client.0.smithi039.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-12T01:58:51.450 INFO:tasks.workunit.client.0.smithi039.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-12T01:58:52.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:58:52.423 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T01:58:52.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:58:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: pgmap v396: 97 pgs: 97 active+clean; 36 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 597 op/s 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub queued for path: / 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:58:52.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:52 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: pgmap v396: 97 pgs: 97 active+clean; 36 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 597 op/s 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub queued for path: / 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:52 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: pgmap v396: 97 pgs: 97 active+clean; 36 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 597 op/s 2024-09-12T01:58:52.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub queued for path: / 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:52.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:52 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:58:53.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.194+0000 7f4430ed5640 1 -- 172.21.15.39:0/407851575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c106a80 msgr2=0x7f442c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.194+0000 7f4430ed5640 1 --2- 172.21.15.39:0/407851575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c106a80 0x7f442c106e60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f441c009930 tx=0x7f441c02a420 comp rx=0 tx=0).stop 2024-09-12T01:58:53.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 -- 172.21.15.39:0/407851575 shutdown_connections 2024-09-12T01:58:53.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 --2- 172.21.15.39:0/407851575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c101420 0x7f442c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 --2- 172.21.15.39:0/407851575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c100a80 0x7f442c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 --2- 172.21.15.39:0/407851575 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c106a80 0x7f442c106e60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 -- 172.21.15.39:0/407851575 >> 172.21.15.39:0/407851575 conn(0x7f442c0fc7a0 msgr2=0x7f442c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 -- 172.21.15.39:0/407851575 shutdown_connections 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 -- 172.21.15.39:0/407851575 wait complete. 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.195+0000 7f4430ed5640 1 Processor -- start 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 -- start start 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c101420 0x7f442c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 0x7f442c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f442c110ea0 con 0x7f442c100a80 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f442c110d20 con 0x7f442c106a80 2024-09-12T01:58:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4430ed5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f442c111020 con 0x7f442c101420 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44864/0 (socket says 172.21.15.39:44864) 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 -- 172.21.15.39:0/197669441 learned_addr learned my addr 172.21.15.39:0/197669441 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f4429d9b640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c101420 0x7f442c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442ad9d640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 0x7f442c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 -- 172.21.15.39:0/197669441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c101420 msgr2=0x7f442c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c101420 0x7f442c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 -- 172.21.15.39:0/197669441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 msgr2=0x7f442c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 0x7f442c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 -- 172.21.15.39:0/197669441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c19d470 con 0x7f442c100a80 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442ad9d640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 0x7f442c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.196+0000 7f442a59c640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f441c009a50 tx=0x7f441c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.197+0000 7f441b7fe640 1 -- 172.21.15.39:0/197669441 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c03f030 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.197+0000 7f441b7fe640 1 -- 172.21.15.39:0/197669441 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f441c003ce0 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.197+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c19d700 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.197+0000 7f441b7fe640 1 -- 172.21.15.39:0/197669441 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c035070 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.197+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a5040 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.199+0000 7f441b7fe640 1 -- 172.21.15.39:0/197669441 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f441c042030 con 0x7f442c100a80 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.199+0000 7f44332ae740 1 Processor -- start 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 -- start start 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 0x5559bd9e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5559bd93e2e0 con 0x5559bd9d84a0 2024-09-12T01:58:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5559bd8e5ce0 con 0x5559bd9e3680 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f44332ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559bd93a2a0 con 0x5559bd9d8dc0 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44874/0 (socket says 172.21.15.39:44874) 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f442ad9d640 1 -- 172.21.15.39:0/3609120974 learned_addr learned my addr 172.21.15.39:0/3609120974 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f442a59c640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f441b7fe640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 0x7f44140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f4429d9b640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 0x5559bd9e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.200+0000 7f442ad9d640 1 -- 172.21.15.39:0/3609120974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 msgr2=0x5559bd9e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 -- 172.21.15.39:0/3609120974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 msgr2=0x5559bd9e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 0x5559bd9e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 -- 172.21.15.39:0/3609120974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559bd8ca440 con 0x5559bd9d84a0 2024-09-12T01:58:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f4429d9b640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 0x5559bd9e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f441b7fe640 1 -- 172.21.15.39:0/197669441 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f441c0ef700 con 0x7f442c100a80 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 0x7f44140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f442ad9d640 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f442400d340 tx=0x7f442400d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d32d8fe75be5b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f4418ff9640 1 -- 172.21.15.39:0/3609120974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442401a920 con 0x5559bd9d84a0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f4418ff9640 1 -- 172.21.15.39:0/3609120974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4424011500 con 0x5559bd9d84a0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.201+0000 7f4418ff9640 1 -- 172.21.15.39:0/3609120974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442400e3b0 con 0x5559bd9d84a0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- 172.21.15.39:0/3609120974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 msgr2=0x5559bd9d8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f442400d340 tx=0x7f442400d800 comp rx=0 tx=0).stop 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f442ad9d640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 0x7f44140a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f442401e000 tx=0x7f442401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- 172.21.15.39:0/3609120974 shutdown_connections 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9e3680 0x5559bd9e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 --2- 172.21.15.39:0/3609120974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9d8880 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- 172.21.15.39:0/3609120974 >> 172.21.15.39:0/3609120974 conn(0x5559bd9d4a30 msgr2=0x5559bd9d4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- 172.21.15.39:0/3609120974 shutdown_connections 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- 172.21.15.39:0/3609120974 wait complete. 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 -- start start 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.202+0000 7f44332ae740 1 Processor -- start 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9e3680 0x5559bd9e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5559bd9e6250 con 0x5559bd9d84a0 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5559bd8f9050 con 0x5559bd9d8dc0 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559bd9e63d0 con 0x5559bd9e3680 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 10 client.0 _ll_register_callbacks cb 0x5559bd939160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44882/0 (socket says 172.21.15.39:44882) 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 -- 172.21.15.39:0/2337457773 learned_addr learned my addr 172.21.15.39:0/2337457773 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f4429d9b640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442ad9d640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9e3680 0x5559bd9e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 -- 172.21.15.39:0/2337457773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9e3680 msgr2=0x5559bd9e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9e3680 0x5559bd9e07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 -- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 msgr2=0x5559bd9e0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 -- 172.21.15.39:0/2337457773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559bd6af3c0 con 0x5559bd9d84a0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f442a59c640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f441c0b88e0 tx=0x7f441c0314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba125f973050b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f4411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c0f5020 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f441c0b8580 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.203+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4424011500 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f441c049070 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 10 client.15849 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5559bd9f1c00 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4424011500 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f441c0b7c60 con 0x5559bd9d84a0 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 10 client.15849 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 20 client.15849 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bd9f3090 0x5559bd9f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 4 client.15849 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559bd94b850 con 0x5559bd9f3090 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.204+0000 7f4429d9b640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bd9f3090 0x5559bd9f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.205+0000 7f4429d9b640 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bd9f3090 0x5559bd9f5530 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6841cb99ce6a6a6 server_cookie=2317af17437208f1 in_seq=0 out_seq=0 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.205+0000 7f4411ffb640 10 client.15849 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.205+0000 7f4411ffb640 1 -- 172.21.15.39:0/2337457773 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559bd94b850 con 0x5559bd9f3090 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.205+0000 7f4411ffb640 10 client.15849 handle_command_reply: tid=0 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.205+0000 7f44332ae740 1 client.15849 shutdown 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 msgr2=0x5559bd9e2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f441c0b88e0 tx=0x7f441c0314b0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 shutdown_connections 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bd9f3090 0x5559bd9f5530 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9e3680 0x5559bd9e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 --2- 172.21.15.39:0/2337457773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9d84a0 0x5559bd9e2fb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 >> 172.21.15.39:0/2337457773 conn(0x5559bd9d4a30 msgr2=0x5559bd9da710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f4411ffb640 0 client.15849 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 shutdown_connections 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 1 -- 172.21.15.39:0/2337457773 wait complete. 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.206+0000 7f44332ae740 20 client.15849 trim_cache size 0 max 16384 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.223+0000 7f44332ae740 1 Processor -- start 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.223+0000 7f44332ae740 1 -- start start 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d84a0 0x5559bd9ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9db7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1afe70 con 0x5559bd9e3680 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1ad740 con 0x5559bd9d8dc0 2024-09-12T01:58:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f44332ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1ab590 con 0x5559bd9d84a0 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44890/0 (socket says 172.21.15.39:44890) 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 -- 172.21.15.39:0/1482858165 learned_addr learned my addr 172.21.15.39:0/1482858165 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f4429d9b640 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9db7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442a59c640 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d84a0 0x5559bd9ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 -- 172.21.15.39:0/1482858165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d84a0 msgr2=0x5559bd9ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d84a0 0x5559bd9ef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 -- 172.21.15.39:0/1482858165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 msgr2=0x5559bd9db7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9db7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 -- 172.21.15.39:0/1482858165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559bd9de7f0 con 0x5559bd9e3680 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f442ad9d640 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f442400d340 tx=0x7f44240084a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cbc10618ae369f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f4413fff640 1 -- 172.21.15.39:0/1482858165 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424008600 con 0x5559bd9e3680 2024-09-12T01:58:53.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f4413fff640 1 -- 172.21.15.39:0/1482858165 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4424011500 con 0x5559bd9e3680 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.224+0000 7f4413fff640 1 -- 172.21.15.39:0/1482858165 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442400eca0 con 0x5559bd9e3680 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- 172.21.15.39:0/1482858165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 msgr2=0x5559bd9fae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f442400d340 tx=0x7f44240084a0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- 172.21.15.39:0/1482858165 shutdown_connections 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9fae40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d8dc0 0x5559bd9db7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 --2- 172.21.15.39:0/1482858165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d84a0 0x5559bd9ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- 172.21.15.39:0/1482858165 >> 172.21.15.39:0/1482858165 conn(0x5559bd9d4a30 msgr2=0x5559bd9db0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- 172.21.15.39:0/1482858165 shutdown_connections 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- 172.21.15.39:0/1482858165 wait complete. 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 -- start start 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.225+0000 7f44332ae740 1 Processor -- start 2024-09-12T01:58:53.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 0x5559bd9eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1abc00 con 0x5559bd9e3680 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1ad070 con 0x5559bd9d84a0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f442c1ac2d0 con 0x5559bd9d8dc0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f44332ae740 10 client.0 _ll_register_callbacks cb 0x7f441c003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44900/0 (socket says 172.21.15.39:44900) 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 -- 172.21.15.39:0/478249344 learned_addr learned my addr 172.21.15.39:0/478249344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442a59c640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 0x5559bd9eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f4429d9b640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 -- 172.21.15.39:0/478249344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 msgr2=0x5559bd9ebed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9ebed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 -- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 msgr2=0x5559bd9eb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 0x5559bd9eb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 -- 172.21.15.39:0/478249344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559bd9e7740 con 0x5559bd9e3680 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442a59c640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 0x5559bd9eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f4429d9b640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9ebed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f442ad9d640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4424008290 tx=0x7f442400d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f5d9b4bb7af4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.226+0000 7f4411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442403e060 con 0x5559bd9e3680 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f442401a920 con 0x5559bd9e3680 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4424011500 con 0x5559bd9e3680 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4424008600 con 0x5559bd9e3680 2024-09-12T01:58:53.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 10 client.15855 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5559bda5da60 con 0x5559bd9e3680 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4424011500 con 0x5559bd9e3680 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f44240198f0 con 0x5559bd9e3680 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 10 client.15855 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 20 client.15855 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bda5dfb0 0x5559bda603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 4 client.15855 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.227+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5559bd945d60 con 0x5559bda5dfb0 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f442a59c640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bda5dfb0 0x5559bda603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f4411ffb640 10 client.15855 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f442a59c640 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bda5dfb0 0x5559bda603d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2304cb779436ec server_cookie=2d63a9e89ec1c890 in_seq=0 out_seq=0 2024-09-12T01:58:53.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f4411ffb640 1 -- 172.21.15.39:0/478249344 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5559bd945d60 con 0x5559bda5dfb0 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "8e3dbe9e-3ce9-42f5-8d4f-7b8e5f405d45": { 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "8e3dbe9e-3ce9-42f5-8d4f-7b8e5f405d45", 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:53.245 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:58:53.246 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:58:53.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f4411ffb640 10 client.15855 handle_command_reply: tid=0 2024-09-12T01:58:53.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 client.15855 shutdown 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 msgr2=0x5559bd9e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4424008290 tx=0x7f442400d800 comp rx=0 tx=0).stop 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 shutdown_connections 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5559bda5dfb0 0x5559bda603d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5559bd9e3680 0x5559bd9e6f10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559bd9d8dc0 0x5559bd9ebed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 --2- 172.21.15.39:0/478249344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559bd9d84a0 0x5559bd9eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.228+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 >> 172.21.15.39:0/478249344 conn(0x5559bd9d4a30 msgr2=0x5559bd9e22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4411ffb640 0 client.15855 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 shutdown_connections 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f44332ae740 1 -- 172.21.15.39:0/478249344 wait complete. 2024-09-12T01:58:53.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f44332ae740 20 client.15855 trim_cache size 0 max 16384 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 msgr2=0x7f44140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 0x7f44140a5040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f442401e000 tx=0x7f442401f000 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 msgr2=0x7f442c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f441c009a50 tx=0x7f441c004270 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 shutdown_connections 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f442c106a80 0x7f442c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f44140a2b80 0x7f44140a5040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c101420 0x7f442c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 --2- 172.21.15.39:0/197669441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f442c100a80 0x7f442c1984c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.229+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 >> 172.21.15.39:0/197669441 conn(0x7f442c0fc7a0 msgr2=0x7f442c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.230+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 shutdown_connections 2024-09-12T01:58:53.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:53.230+0000 7f4430ed5640 1 -- 172.21.15.39:0/197669441 wait complete. 2024-09-12T01:58:53.501 INFO:tasks.workunit.client.0.smithi039.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-12T01:58:53.505 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether ln -s works... yes 2024-09-12T01:58:53.509 INFO:tasks.workunit.client.0.smithi039.stdout:checking the maximum length of command line arguments... 1572864 2024-09-12T01:58:53.512 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-12T01:58:53.512 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-12T01:58:53.512 INFO:tasks.workunit.client.0.smithi039.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-12T01:58:53.512 INFO:tasks.workunit.client.0.smithi039.stdout:checking for objdump... objdump 2024-09-12T01:58:53.512 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to recognize dependent libraries... pass_all 2024-09-12T01:58:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:checking for dlltool... no 2024-09-12T01:58:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-12T01:58:53.514 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ar... ar 2024-09-12T01:58:53.604 INFO:tasks.workunit.client.0.smithi039.stdout:checking for archiver @FILE support... @ 2024-09-12T01:58:53.604 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strip... strip 2024-09-12T01:58:53.605 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ranlib... ranlib 2024-09-12T01:58:53.605 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gawk... gawk 2024-09-12T01:58:53.703 INFO:tasks.workunit.client.0.smithi039.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-12T01:58:53.704 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sysroot... no 2024-09-12T01:58:53.715 INFO:tasks.workunit.client.0.smithi039.stdout:checking for a working dd... /usr/bin/dd 2024-09-12T01:58:53.726 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-12T01:58:53.760 INFO:tasks.workunit.client.0.smithi039.stdout:checking for mt... no 2024-09-12T01:58:53.771 INFO:tasks.workunit.client.0.smithi039.stdout:checking if : is a manifest tool... no 2024-09-12T01:58:53.972 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to run the C preprocessor... gcc -E 2024-09-12T01:58:54.081 INFO:tasks.cephfs.filesystem:scrub status for tag:8e3dbe9e-3ce9-42f5-8d4f-7b8e5f405d45 - {'path': '/', 'tag': '8e3dbe9e-3ce9-42f5-8d4f-7b8e5f405d45', 'options': 'recursive,force'} 2024-09-12T01:58:54.173 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:54.175 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ANSI C header files... yes 2024-09-12T01:58:54.210 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/types.h... yes 2024-09-12T01:58:54.249 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/stat.h... yes 2024-09-12T01:58:54.290 INFO:tasks.workunit.client.0.smithi039.stdout:checking for stdlib.h... yes 2024-09-12T01:58:54.329 INFO:tasks.workunit.client.0.smithi039.stdout:checking for string.h... yes 2024-09-12T01:58:54.375 INFO:tasks.workunit.client.0.smithi039.stdout:checking for memory.h... yes 2024-09-12T01:58:54.417 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strings.h... yes 2024-09-12T01:58:54.458 INFO:tasks.workunit.client.0.smithi039.stdout:checking for inttypes.h... yes 2024-09-12T01:58:54.498 INFO:tasks.workunit.client.0.smithi039.stdout:checking for stdint.h... yes 2024-09-12T01:58:54.539 INFO:tasks.workunit.client.0.smithi039.stdout:checking for unistd.h... yes 2024-09-12T01:58:54.620 INFO:tasks.workunit.client.0.smithi039.stdout:checking for dlfcn.h... yes 2024-09-12T01:58:54.626 INFO:tasks.workunit.client.0.smithi039.stdout:checking for objdir... .libs 2024-09-12T01:58:54.631 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:54 smithi039 ceph-mon[31204]: pgmap v397: 97 pgs: 97 active+clean; 30 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 727 op/s 2024-09-12T01:58:54.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:54 smithi044 ceph-mon[35259]: pgmap v397: 97 pgs: 97 active+clean; 30 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 727 op/s 2024-09-12T01:58:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 -- 172.21.15.39:0/2841420692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410c590 msgr2=0x7f452410c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 --2- 172.21.15.39:0/2841420692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410c590 0x7f452410c9f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4518009ca0 tx=0x7f451802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 -- 172.21.15.39:0/2841420692 shutdown_connections 2024-09-12T01:58:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 --2- 172.21.15.39:0/2841420692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452410cf30 0x7f4524119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 --2- 172.21.15.39:0/2841420692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410c590 0x7f452410c9f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 --2- 172.21.15.39:0/2841420692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4524112640 0x7f4524112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 -- 172.21.15.39:0/2841420692 >> 172.21.15.39:0/2841420692 conn(0x7f452406cdc0 msgr2=0x7f452406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 -- 172.21.15.39:0/2841420692 shutdown_connections 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.715+0000 7f452baff640 1 -- 172.21.15.39:0/2841420692 wait complete. 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.716+0000 7f452baff640 1 Processor -- start 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.716+0000 7f452baff640 1 -- start start 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 0x7f45241a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 0x7f45241a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f452411c9a0 con 0x7f452410cf30 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f452411c820 con 0x7f452410c590 2024-09-12T01:58:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452baff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f452411cb20 con 0x7f4524112640 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44906/0 (socket says 172.21.15.39:44906) 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 -- 172.21.15.39:0/340667645 learned_addr learned my addr 172.21.15.39:0/340667645 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452989b640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 0x7f45241a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452a09c640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 0x7f45241a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 -- 172.21.15.39:0/340667645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 msgr2=0x7f45241a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 0x7f45241a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 -- 172.21.15.39:0/340667645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 msgr2=0x7f45241a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 0x7f45241a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 -- 172.21.15.39:0/340667645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45241a7e40 con 0x7f452410cf30 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452a09c640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 0x7f45241a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:58:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452989b640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 0x7f45241a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f452909a640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4518006010 tx=0x7f4518003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518031650 con 0x7f452410cf30 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.717+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45180317f0 con 0x7f452410cf30 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.718+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45241a80d0 con 0x7f452410cf30 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.718+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518030b20 con 0x7f452410cf30 2024-09-12T01:58:54.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.718+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45241afa10 con 0x7f452410cf30 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.719+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452410dcb0 con 0x7f452410cf30 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.720+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4518030cc0 con 0x7f452410cf30 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.720+0000 7f4522ffd640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 0x7f450c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.721+0000 7f452989b640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 0x7f450c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.721+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45180f03c0 con 0x7f452410cf30 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.721+0000 7f452989b640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 0x7f450c0a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f40 tx=0x7f4514005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:54.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.725+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45180bd3f0 con 0x7f452410cf30 2024-09-12T01:58:54.754 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:54 smithi172 ceph-mon[35073]: pgmap v397: 97 pgs: 97 active+clean; 30 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 727 op/s 2024-09-12T01:58:54.761 INFO:tasks.workunit.client.0.smithi039.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-12T01:58:54.761 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-12T01:58:54.798 INFO:tasks.workunit.client.0.smithi039.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-12T01:58:54.852 INFO:tasks.workunit.client.0.smithi039.stdout:checking if gcc static flag -static works... no 2024-09-12T01:58:54.906 INFO:tasks.workunit.client.0.smithi039.stdout:checking if gcc supports -c -o file.o... yes 2024-09-12T01:58:54.906 INFO:tasks.workunit.client.0.smithi039.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-12T01:58:54.912 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-12T01:58:54.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.940+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f452410c9f0 con 0x7f452410cf30 2024-09-12T01:58:54.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.940+0000 7f4522ffd640 1 -- 172.21.15.39:0/340667645 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11911 (secure 0 0 0) 0x7f452410c9f0 con 0x7f452410cf30 2024-09-12T01:58:54.941 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:58:54.941 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-12T01:58:43:389902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:58:42.815744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:58:54.941 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.942+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 msgr2=0x7f450c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.942+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 0x7f450c0a50c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f40 tx=0x7f4514005f90 comp rx=0 tx=0).stop 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 msgr2=0x7f45241a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4518006010 tx=0x7f4518003ce0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 shutdown_connections 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f450c0a2c00 0x7f450c0a50c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4524112640 0x7f45241a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f452410cf30 0x7f45241a33d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 --2- 172.21.15.39:0/340667645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f452410c590 0x7f45241a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 >> 172.21.15.39:0/340667645 conn(0x7f452406cdc0 msgr2=0x7f452410af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 shutdown_connections 2024-09-12T01:58:54.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:54.943+0000 7f452baff640 1 -- 172.21.15.39:0/340667645 wait complete. 2024-09-12T01:58:54.969 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether -lc should be explicitly linked in... no 2024-09-12T01:58:55.026 INFO:tasks.workunit.client.0.smithi039.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-12T01:58:55.026 INFO:tasks.workunit.client.0.smithi039.stdout:checking how to hardcode library paths into programs... immediate 2024-09-12T01:58:55.028 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether stripping libraries is possible... yes 2024-09-12T01:58:55.028 INFO:tasks.workunit.client.0.smithi039.stdout:checking if libtool supports shared libraries... yes 2024-09-12T01:58:55.028 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether to build shared libraries... yes 2024-09-12T01:58:55.028 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether to build static libraries... yes 2024-09-12T01:58:55.034 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc... (cached) gcc 2024-09-12T01:58:55.068 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-12T01:58:55.069 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-12T01:58:55.069 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-12T01:58:55.069 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gmake... /usr/bin/gmake 2024-09-12T01:58:55.069 INFO:tasks.workunit.client.0.smithi039.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-12T01:58:55.070 INFO:tasks.workunit.client.0.smithi039.stdout:checking for tar... /bin/tar 2024-09-12T01:58:55.070 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gzip... /bin/gzip 2024-09-12T01:58:55.096 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether gcc -MM is supported... yes 2024-09-12T01:58:55.096 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sort... /bin/sort 2024-09-12T01:58:55.096 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether ln -s works... yes 2024-09-12T01:58:55.096 INFO:tasks.workunit.client.0.smithi039.stdout:checking for rpm... /bin/rpm 2024-09-12T01:58:55.099 INFO:tasks.workunit.client.0.smithi039.stdout:checking for rpmbuild... no 2024-09-12T01:58:55.156 INFO:tasks.workunit.client.0.smithi039.stdout:checking assert.h usability... yes 2024-09-12T01:58:55.175 INFO:tasks.workunit.client.0.smithi039.stdout:checking assert.h presence... yes 2024-09-12T01:58:55.175 INFO:tasks.workunit.client.0.smithi039.stdout:checking for assert.h... yes 2024-09-12T01:58:55.223 INFO:tasks.workunit.client.0.smithi039.stdout:checking bstring.h usability... no 2024-09-12T01:58:55.252 INFO:tasks.workunit.client.0.smithi039.stdout:checking bstring.h presence... no 2024-09-12T01:58:55.252 INFO:tasks.workunit.client.0.smithi039.stdout:checking for bstring.h... no 2024-09-12T01:58:55.308 INFO:tasks.workunit.client.0.smithi039.stdout:checking libgen.h usability... yes 2024-09-12T01:58:55.324 INFO:tasks.workunit.client.0.smithi039.stdout:checking libgen.h presence... yes 2024-09-12T01:58:55.325 INFO:tasks.workunit.client.0.smithi039.stdout:checking for libgen.h... yes 2024-09-12T01:58:55.407 INFO:tasks.workunit.client.0.smithi039.stdout:checking dirent.h usability... yes 2024-09-12T01:58:55.425 INFO:tasks.workunit.client.0.smithi039.stdout:checking dirent.h presence... yes 2024-09-12T01:58:55.425 INFO:tasks.workunit.client.0.smithi039.stdout:checking for dirent.h... yes 2024-09-12T01:58:55.469 INFO:tasks.workunit.client.0.smithi039.stdout:checking errno.h usability... yes 2024-09-12T01:58:55.486 INFO:tasks.workunit.client.0.smithi039.stdout:checking errno.h presence... yes 2024-09-12T01:58:55.486 INFO:tasks.workunit.client.0.smithi039.stdout:checking for errno.h... yes 2024-09-12T01:58:55.536 INFO:tasks.workunit.client.0.smithi039.stdout:checking malloc.h usability... yes 2024-09-12T01:58:55.554 INFO:tasks.workunit.client.0.smithi039.stdout:checking malloc.h presence... yes 2024-09-12T01:58:55.554 INFO:tasks.workunit.client.0.smithi039.stdout:checking for malloc.h... yes 2024-09-12T01:58:55.629 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:55 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/340667645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.630 INFO:tasks.workunit.client.0.smithi039.stdout:checking uuid.h usability... no 2024-09-12T01:58:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T01:58:55.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T01:58:55.661 INFO:tasks.workunit.client.0.smithi039.stdout:checking uuid.h presence... no 2024-09-12T01:58:55.661 INFO:tasks.workunit.client.0.smithi039.stdout:checking for uuid.h... no 2024-09-12T01:58:55.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:55 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/340667645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.712 INFO:tasks.workunit.client.0.smithi039.stdout:checking uuid/uuid.h usability... yes 2024-09-12T01:58:55.734 INFO:tasks.workunit.client.0.smithi039.stdout:checking uuid/uuid.h presence... yes 2024-09-12T01:58:55.734 INFO:tasks.workunit.client.0.smithi039.stdout:checking for uuid/uuid.h... yes 2024-09-12T01:58:55.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:55 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/340667645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:58:55.800 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/uuid.h usability... no 2024-09-12T01:58:55.827 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/uuid.h presence... no 2024-09-12T01:58:55.827 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/uuid.h... no 2024-09-12T01:58:55.870 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/file.h usability... yes 2024-09-12T01:58:55.886 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/file.h presence... yes 2024-09-12T01:58:55.887 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/file.h... yes 2024-09-12T01:58:55.937 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fcntl.h usability... yes 2024-09-12T01:58:55.937 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:58:55.954 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fcntl.h presence... yes 2024-09-12T01:58:55.954 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/fcntl.h... yes 2024-09-12T01:58:56.014 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/syssgi.h usability... no 2024-09-12T01:58:56.042 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/syssgi.h presence... no 2024-09-12T01:58:56.042 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/syssgi.h... no 2024-09-12T01:58:56.251 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/param.h usability... yes 2024-09-12T01:58:56.271 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/param.h presence... yes 2024-09-12T01:58:56.271 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/param.h... yes 2024-09-12T01:58:56.287 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/stat.h... (cached) yes 2024-09-12T01:58:56.347 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/statvfs.h usability... yes 2024-09-12T01:58:56.363 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/statvfs.h presence... yes 2024-09-12T01:58:56.364 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/statvfs.h... yes 2024-09-12T01:58:56.418 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/time.h usability... yes 2024-09-12T01:58:56.436 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/time.h presence... yes 2024-09-12T01:58:56.436 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/time.h... yes 2024-09-12T01:58:56.481 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/ioctl.h usability... yes 2024-09-12T01:58:56.497 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/ioctl.h presence... yes 2024-09-12T01:58:56.497 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/ioctl.h... yes 2024-09-12T01:58:56.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 -- 172.21.15.39:0/2226416562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340103760 msgr2=0x7f6340107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 --2- 172.21.15.39:0/2226416562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340103760 0x7f6340107ba0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6330009930 tx=0x7f633002a420 comp rx=0 tx=0).stop 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 -- 172.21.15.39:0/2226416562 shutdown_connections 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 --2- 172.21.15.39:0/2226416562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 0x7f634010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 --2- 172.21.15.39:0/2226416562 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340103760 0x7f6340107ba0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 --2- 172.21.15.39:0/2226416562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340102db0 0x7f6340103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 -- 172.21.15.39:0/2226416562 >> 172.21.15.39:0/2226416562 conn(0x7f63400fc7d0 msgr2=0x7f63400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 -- 172.21.15.39:0/2226416562 shutdown_connections 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.475+0000 7f6347303640 1 -- 172.21.15.39:0/2226416562 wait complete. 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 Processor -- start 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 -- start start 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340103760 0x7f6340198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 0x7f634019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63401120c0 con 0x7f6340102db0 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6340111f40 con 0x7f6340103760 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f6347303640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112240 con 0x7f63401082e0 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44916/0 (socket says 172.21.15.39:44916) 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.476+0000 7f634509f640 1 -- 172.21.15.39:0/866621775 learned_addr learned my addr 172.21.15.39:0/866621775 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634489e640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340103760 0x7f6340198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f63458a0640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 0x7f634019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 -- 172.21.15.39:0/866621775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 msgr2=0x7f634019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 0x7f634019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 -- 172.21.15.39:0/866621775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340103760 msgr2=0x7f6340198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340103760 0x7f6340198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 -- 172.21.15.39:0/866621775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634019d580 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f634509f640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ea60 tx=0x7f633c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f63367fc640 1 -- 172.21.15.39:0/866621775 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cde0 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f63367fc640 1 -- 172.21.15.39:0/866621775 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c0035f0 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634019d870 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f63367fc640 1 -- 172.21.15.39:0/866621775 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c010670 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.477+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a5150 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.480+0000 7f63367fc640 1 -- 172.21.15.39:0/866621775 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f633c0037a0 con 0x7f6340102db0 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.480+0000 7f63496dc740 1 Processor -- start 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 -- start start 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b190f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19109140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556b1905d2a0 con 0x556b190f7640 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b19004b10 con 0x556b190f7f60 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63496dc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556b19059260 con 0x556b19106d50 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f63458a0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b190f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:53168/0 (socket says 172.21.15.39:53168) 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 -- 172.21.15.39:0/1352687598 learned_addr learned my addr 172.21.15.39:0/1352687598 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634489e640 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 -- 172.21.15.39:0/1352687598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 msgr2=0x556b19109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 -- 172.21.15.39:0/1352687598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 msgr2=0x556b190f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b190f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.481+0000 7f634509f640 1 -- 172.21.15.39:0/1352687598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b18dceb90 con 0x556b190f7f60 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f63367fc640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f63458a0640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f634509f640 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d73b0 tx=0x7f633c0d7870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e1225fc3ab0fa0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f63367fc640 1 -- 172.21.15.39:0/866621775 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f633c0cf3b0 con 0x7f6340102db0 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f632b7fe640 1 -- 172.21.15.39:0/1352687598 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09b9f0 con 0x556b190f7f60 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f632b7fe640 1 -- 172.21.15.39:0/1352687598 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c09c320 con 0x556b190f7f60 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.482+0000 7f632b7fe640 1 -- 172.21.15.39:0/1352687598 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09b580 con 0x556b190f7f60 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- 172.21.15.39:0/1352687598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 msgr2=0x556b19106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d73b0 tx=0x7f633c0d7870 comp rx=0 tx=0).stop 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63458a0640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 0x7f632c0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6338005fd0 tx=0x7f63380096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- 172.21.15.39:0/1352687598 shutdown_connections 2024-09-12T01:58:56.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7f60 0x556b19106810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 --2- 172.21.15.39:0/1352687598 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b190f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- 172.21.15.39:0/1352687598 >> 172.21.15.39:0/1352687598 conn(0x556b190f3cf0 msgr2=0x556b190f40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- 172.21.15.39:0/1352687598 shutdown_connections 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- 172.21.15.39:0/1352687598 wait complete. 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 -- start start 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.483+0000 7f63496dc740 1 Processor -- start 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b191046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556b19109920 con 0x556b190f7640 2024-09-12T01:58:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556b18fe56e0 con 0x556b19106d50 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556b19109aa0 con 0x556b190f7f60 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63496dc740 10 client.0 _ll_register_callbacks cb 0x556b19009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44930/0 (socket says 172.21.15.39:44930) 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 -- 172.21.15.39:0/2156840333 learned_addr learned my addr 172.21.15.39:0/2156840333 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63458a0640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b191046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634489e640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 -- 172.21.15.39:0/2156840333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 msgr2=0x556b19104190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19104190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 -- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 msgr2=0x556b191046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b191046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 -- 172.21.15.39:0/2156840333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b19112e80 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f63458a0640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b191046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f634509f640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f633c0a4360 tx=0x7f633c0cf720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161d8ddd04237138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.484+0000 7f6328ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09b760 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f633c098290 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c09c320 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f633c09b580 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 10 client.15873 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b19109920 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c09c320 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f633c09be80 con 0x556b190f7640 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 10 client.15873 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:56.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 10 client.15873 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 20 client.15873 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b19118d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 4 client.15873 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b1906a9d0 con 0x556b19116970 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.485+0000 7f634489e640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b19118d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.486+0000 7f634489e640 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b19118d60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278743e9a4dac9d7 server_cookie=a1090681aaf2d84e in_seq=0 out_seq=0 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.486+0000 7f6328ff9640 10 client.15873 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.486+0000 7f6328ff9640 1 -- 172.21.15.39:0/2156840333 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b1906a9d0 con 0x556b19116970 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.486+0000 7f6328ff9640 10 client.15873 handle_command_reply: tid=0 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.486+0000 7f63496dc740 1 client.15873 shutdown 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 msgr2=0x556b19103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f633c0a4360 tx=0x7f633c0cf720 comp rx=0 tx=0).stop 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 shutdown_connections 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b19118d60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f6328ff9640 0 client.15873 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b191046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 --2- 172.21.15.39:0/2156840333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b19103c50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 >> 172.21.15.39:0/2156840333 conn(0x556b190f3cf0 msgr2=0x556b190f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 shutdown_connections 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 1 -- 172.21.15.39:0/2156840333 wait complete. 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.487+0000 7f63496dc740 20 client.15873 trim_cache size 0 max 16384 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 Processor -- start 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 -- start start 2024-09-12T01:58:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 0x556b1911bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63401adcc0 con 0x556b190f7f60 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63401ab590 con 0x556b190f7640 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f63496dc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63401a93e0 con 0x556b19106d50 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f634489e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.504+0000 7f634509f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 0x556b1911bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634489e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44942/0 (socket says 172.21.15.39:44942) 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634489e640 1 -- 172.21.15.39:0/871079344 learned_addr learned my addr 172.21.15.39:0/871079344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f63458a0640 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 -- 172.21.15.39:0/871079344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 msgr2=0x556b19100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 -- 172.21.15.39:0/871079344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 msgr2=0x556b1911c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 -- 172.21.15.39:0/871079344 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b190ef260 con 0x556b190f7640 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634489e640 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f634509f640 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 0x556b1911bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d7170 tx=0x7f633c0d7870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a76792ec6427162 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f632affd640 1 -- 172.21.15.39:0/871079344 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09b9f0 con 0x556b190f7640 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f632affd640 1 -- 172.21.15.39:0/871079344 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c0d7d70 con 0x556b190f7640 2024-09-12T01:58:56.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.505+0000 7f632affd640 1 -- 172.21.15.39:0/871079344 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09be80 con 0x556b190f7640 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- 172.21.15.39:0/871079344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 msgr2=0x556b1911bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 0x556b1911bd80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d7170 tx=0x7f633c0d7870 comp rx=0 tx=0).stop 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- 172.21.15.39:0/871079344 shutdown_connections 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b19106d50 0x556b19100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7f60 0x556b1911c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 --2- 172.21.15.39:0/871079344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b190f7640 0x556b1911bd80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- 172.21.15.39:0/871079344 >> 172.21.15.39:0/871079344 conn(0x556b190f3cf0 msgr2=0x556b19112550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- 172.21.15.39:0/871079344 shutdown_connections 2024-09-12T01:58:56.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- 172.21.15.39:0/871079344 wait complete. 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.506+0000 7f63496dc740 1 -- start start 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 Processor -- start 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19119740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b19119c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63401a9a50 con 0x556b190f7640 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63401aaec0 con 0x556b19106d50 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63401aa120 con 0x556b190f7f60 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63496dc740 10 client.0 _ll_register_callbacks cb 0x7f633c0d7230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f63458a0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b19119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634509f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44950/0 (socket says 172.21.15.39:44950) 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634509f640 1 -- 172.21.15.39:0/3885324077 learned_addr learned my addr 172.21.15.39:0/3885324077 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634489e640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19119740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634509f640 1 -- 172.21.15.39:0/3885324077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 msgr2=0x556b19119740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.507+0000 7f634509f640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19119740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f634509f640 1 -- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 msgr2=0x556b19119c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f634509f640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b19119c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f634509f640 1 -- 172.21.15.39:0/3885324077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b1911a4b0 con 0x556b190f7640 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f63458a0640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b19119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f634509f640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d73b0 tx=0x7f633c0cf710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a435c120f962fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c09b9f0 con 0x556b190f7640 2024-09-12T01:58:56.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f633c0964f0 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633c0d7d70 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f633c09ffd0 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f63496dc740 10 client.15879 fetch_fsmap learned FSMap version 27 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b1911a4b0 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c0d7d70 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.508+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f633c097970 con 0x556b190f7640 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 10 client.15879 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 10 client.15879 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 20 client.15879 populate_metadata read hostname 'smithi039' 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b191834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 4 client.15879 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x556b19064d20 con 0x556b19116970 2024-09-12T01:58:56.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f634489e640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b191834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:58:56.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f6328ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:58:56.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:58:56.509+0000 7f634489e640 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b191834d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87504ee03595c317 server_cookie=424926ae97f182f in_seq=0 out_seq=0 2024-09-12T01:58:56.559 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/wait.h usability... yes 2024-09-12T01:58:56.584 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/wait.h presence... yes 2024-09-12T01:58:56.584 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/wait.h... yes 2024-09-12T01:58:56.599 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/types.h... (cached) yes 2024-09-12T01:58:56.605 INFO:tasks.workunit.client.0.smithi039.stdout:checking for strings.h... (cached) yes 2024-09-12T01:58:56.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:56 smithi039 ceph-mon[31204]: pgmap v398: 97 pgs: 97 active+clean; 30 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 634 op/s 2024-09-12T01:58:56.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:56 smithi044 ceph-mon[35259]: pgmap v398: 97 pgs: 97 active+clean; 30 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 634 op/s 2024-09-12T01:58:56.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:56 smithi172 ceph-mon[35073]: pgmap v398: 97 pgs: 97 active+clean; 30 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 634 op/s 2024-09-12T01:58:58.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:58 smithi044 ceph-mon[35259]: pgmap v399: 97 pgs: 97 active+clean; 32 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 650 op/s 2024-09-12T01:58:58.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:58 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:58:58.674 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:58 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:58:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:58 smithi172 ceph-mon[35073]: pgmap v399: 97 pgs: 97 active+clean; 32 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 650 op/s 2024-09-12T01:58:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:58 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:58:58.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:58 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:58:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:58 smithi039 ceph-mon[31204]: pgmap v399: 97 pgs: 97 active+clean; 32 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 650 op/s 2024-09-12T01:58:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:58 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:58:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:58 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:58:59.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:58:59 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:58:59.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:58:59 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:58:59.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:58:59 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:59:00.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.227+0000 7f6328ff9640 1 -- 172.21.15.39:0/3885324077 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556b19064d20 con 0x556b19116970 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.227+0000 7f6328ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.227+0000 7f63496dc740 1 client.15879 shutdown 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 msgr2=0x556b1911c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f633c0d73b0 tx=0x7f633c0cf710 comp rx=0 tx=0).stop 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 shutdown_connections 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x556b19116970 0x556b191834d0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556b19106d50 0x556b19119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556b190f7f60 0x556b19119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 --2- 172.21.15.39:0/3885324077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x556b190f7640 0x556b1911c3f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 >> 172.21.15.39:0/3885324077 conn(0x556b190f3cf0 msgr2=0x556b190f2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f6328ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 shutdown_connections 2024-09-12T01:59:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 1 -- 172.21.15.39:0/3885324077 wait complete. 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.228+0000 7f63496dc740 20 client.15879 trim_cache size 0 max 16384 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 27, 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 6, 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "609c884c": { 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 6, 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T01:59:00.230 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 133.4, 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:00.232 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:00.232 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:00.232 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:00.232 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:00.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 msgr2=0x7f632c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 0x7f632c0a5040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6338005fd0 tx=0x7f63380096e0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 msgr2=0x7f63401985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ea60 tx=0x7f633c00ef20 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 shutdown_connections 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63401082e0 0x7f634019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6340103760 0x7f6340198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 --2- 172.21.15.39:0/866621775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6340102db0 0x7f63401985d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 >> 172.21.15.39:0/866621775 conn(0x7f63400fc7d0 msgr2=0x7f6340105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 shutdown_connections 2024-09-12T01:59:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:00.229+0000 7f6347303640 1 -- 172.21.15.39:0/866621775 wait complete. 2024-09-12T01:59:00.592 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:00 smithi039 ceph-mon[31204]: pgmap v400: 97 pgs: 97 active+clean; 35 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 732 op/s 2024-09-12T01:59:00.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:00 smithi172 ceph-mon[35073]: pgmap v400: 97 pgs: 97 active+clean; 35 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 732 op/s 2024-09-12T01:59:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:00 smithi044 ceph-mon[35259]: pgmap v400: 97 pgs: 97 active+clean; 35 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 732 op/s 2024-09-12T01:59:00.932 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '609c884c', quiesce took 8.5 seconds. Will release after: 4.9 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 -- 172.21.15.39:0/464411692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 msgr2=0x7f79081049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 --2- 172.21.15.39:0/464411692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f79081049d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009ca0 tx=0x7f78f802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 -- 172.21.15.39:0/464411692 shutdown_connections 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 --2- 172.21.15.39:0/464411692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 0x7f7908109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 --2- 172.21.15.39:0/464411692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 0x7f7908107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 --2- 172.21.15.39:0/464411692 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f79081049d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 -- 172.21.15.39:0/464411692 >> 172.21.15.39:0/464411692 conn(0x7f79080fc1e0 msgr2=0x7f79080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 -- 172.21.15.39:0/464411692 shutdown_connections 2024-09-12T01:59:01.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.382+0000 7f790ca0e640 1 -- 172.21.15.39:0/464411692 wait complete. 2024-09-12T01:59:01.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 Processor -- start 2024-09-12T01:59:01.385 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 -- start start 2024-09-12T01:59:01.386 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 0x7f790819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 0x7f79081a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.383+0000 7f790ca0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f790810d850 con 0x7f79081025e0 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790ca0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f790810d6d0 con 0x7f7908104f10 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790ca0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f790810d9d0 con 0x7f7908107840 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44962/0 (socket says 172.21.15.39:44962) 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 -- 172.21.15.39:0/1880257839 learned_addr learned my addr 172.21.15.39:0/1880257839 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f7905d9b640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 0x7f790819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f7906d9d640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 0x7f79081a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 -- 172.21.15.39:0/1880257839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 msgr2=0x7f79081a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 0x7f79081a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 -- 172.21.15.39:0/1880257839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 msgr2=0x7f790819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 0x7f790819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 -- 172.21.15.39:0/1880257839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79081a1cb0 con 0x7f79081025e0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790659c640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f78f8031a40 tx=0x7f78f8031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f78f77fe640 1 -- 172.21.15.39:0/1880257839 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f802faa0 con 0x7f79081025e0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f78f77fe640 1 -- 172.21.15.39:0/1880257839 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78f802fc40 con 0x7f79081025e0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79081a1f40 con 0x7f79081025e0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f78f77fe640 1 -- 172.21.15.39:0/1880257839 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f803a790 con 0x7f79081025e0 2024-09-12T01:59:01.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.384+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79081a23a0 con 0x7f79081025e0 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.387+0000 7f78f77fe640 1 -- 172.21.15.39:0/1880257839 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f78f8030b30 con 0x7f79081025e0 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.387+0000 7f790f883740 1 Processor -- start 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.387+0000 7f790f883740 1 -- start start 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f78f77fe640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 0x7f78f00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b8f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f7370 0x55c49b8f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c49b8552f0 con 0x55c49b8f19a0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c49b7fd270 con 0x55c49b8f7370 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790f883740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c49b8512b0 con 0x55c49b8f22e0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790659c640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 0x7f78f00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b8f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44978/0 (socket says 172.21.15.39:44978) 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7906d9d640 1 -- 172.21.15.39:0/1373940110 learned_addr learned my addr 172.21.15.39:0/1373940110 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f78f77fe640 1 -- 172.21.15.39:0/1880257839 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f78f80f04e0 con 0x7f79081025e0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7906d9d640 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f7370 0x55c49b8f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 -- 172.21.15.39:0/1373940110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f7370 msgr2=0x55c49b8f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f7370 0x55c49b8f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 -- 172.21.15.39:0/1373940110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 msgr2=0x55c49b8f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 -- 172.21.15.39:0/1373940110 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c49b7fc340 con 0x55c49b8f22e0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f790659c640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 0x7f78f00a50f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78f80b96c0 tx=0x7f78f80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.388+0000 7f7905d9b640 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b8f6da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f790806ae60 tx=0x7f78fc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cfb33cc2c1f6077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f78f4ff9640 1 -- 172.21.15.39:0/1373940110 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004030 con 0x55c49b8f22e0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f78f4ff9640 1 -- 172.21.15.39:0/1373940110 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc0041d0 con 0x55c49b8f22e0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f78f4ff9640 1 -- 172.21.15.39:0/1373940110 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0116a0 con 0x55c49b8f22e0 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 -- 172.21.15.39:0/1373940110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 msgr2=0x55c49b8f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b8f6da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f790806ae60 tx=0x7f78fc0107a0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 -- 172.21.15.39:0/1373940110 shutdown_connections 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f7370 0x55c49b8f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b8f6da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 --2- 172.21.15.39:0/1373940110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.389+0000 7f790f883740 1 -- 172.21.15.39:0/1373940110 >> 172.21.15.39:0/1373940110 conn(0x55c49b8ed010 msgr2=0x55c49b8ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- 172.21.15.39:0/1373940110 shutdown_connections 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- 172.21.15.39:0/1373940110 wait complete. 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- start start 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 Processor -- start 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f22e0 0x55c49b8fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b903110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c49b8fa340 con 0x55c49b8f19a0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c49b7de290 con 0x55c49b8f22e0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c49b8fa4c0 con 0x55c49b8f7370 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f790f883740 10 client.0 _ll_register_callbacks cb 0x55c49b80f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44994/0 (socket says 172.21.15.39:44994) 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f7906d9d640 1 -- 172.21.15.39:0/341771088 learned_addr learned my addr 172.21.15.39:0/341771088 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.390+0000 7f7905d9b640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f22e0 0x55c49b8fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b903110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 -- 172.21.15.39:0/341771088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 msgr2=0x55c49b903110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b903110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 -- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f22e0 msgr2=0x55c49b8fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f22e0 0x55c49b8fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 -- 172.21.15.39:0/341771088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c49b568210 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f7906d9d640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7900003910 tx=0x7f790000b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3968d9b43fb709dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f78edffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900010ae0 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7900010c80 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc0041d0 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7900010e80 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f790f883740 10 client.15891 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.391+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c49b634620 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc0041d0 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f79000234e0 con 0x55c49b8f19a0 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 10 client.15891 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:01.400 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 20 client.15891 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b9078c0 0x55c49b909d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 4 client.15891 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c49b862a20 con 0x55c49b9078c0 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f7905d9b640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b9078c0 0x55c49b909d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f7905d9b640 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b9078c0 0x55c49b909d30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc88aedc110081e2 server_cookie=22fe6063c8db6e74 in_seq=0 out_seq=0 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.392+0000 7f78edffb640 10 client.15891 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f78edffb640 1 -- 172.21.15.39:0/341771088 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c49b862a20 con 0x55c49b9078c0 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f78edffb640 10 client.15891 handle_command_reply: tid=0 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 client.15891 shutdown 2024-09-12T01:59:01.401 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 msgr2=0x55c49b8fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7900003910 tx=0x7f790000b2e0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 shutdown_connections 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b9078c0 0x55c49b909d30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b903110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f78edffb640 0 client.15891 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f22e0 0x55c49b8fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 --2- 172.21.15.39:0/341771088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f19a0 0x55c49b8fbb90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.393+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 >> 172.21.15.39:0/341771088 conn(0x55c49b8ed010 msgr2=0x55c49b8ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.394+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 shutdown_connections 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.394+0000 7f790f883740 1 -- 172.21.15.39:0/341771088 wait complete. 2024-09-12T01:59:01.402 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.394+0000 7f790f883740 20 client.15891 trim_cache size 0 max 16384 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 Processor -- start 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 -- start start 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b8fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b8ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79081ad9d0 con 0x55c49b8f22e0 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79081ab2a0 con 0x55c49b8f19a0 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f790f883740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79081a90f0 con 0x55c49b8f7370 2024-09-12T01:59:01.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f7905d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f7905d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45002/0 (socket says 172.21.15.39:45002) 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f7905d9b640 1 -- 172.21.15.39:0/2716006666 learned_addr learned my addr 172.21.15.39:0/2716006666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.408+0000 7f7906d9d640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b8fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7906d9d640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b8ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 -- 172.21.15.39:0/2716006666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 msgr2=0x55c49b8ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b8ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 -- 172.21.15.39:0/2716006666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 msgr2=0x55c49b8fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b8fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 -- 172.21.15.39:0/2716006666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c49b8fb6d0 con 0x55c49b8f22e0 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7906d9d640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b8ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f7905d9b640 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00bb10 tx=0x7f78fc00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de23e39c94007d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f78effff640 1 -- 172.21.15.39:0/2716006666 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc01f020 con 0x55c49b8f22e0 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f78effff640 1 -- 172.21.15.39:0/2716006666 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc005520 con 0x55c49b8f22e0 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.409+0000 7f78effff640 1 -- 172.21.15.39:0/2716006666 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc029970 con 0x55c49b8f22e0 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- 172.21.15.39:0/2716006666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 msgr2=0x55c49b903030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00bb10 tx=0x7f78fc00b820 comp rx=0 tx=0).stop 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- 172.21.15.39:0/2716006666 shutdown_connections 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f7370 0x55c49b8ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f22e0 0x55c49b903030 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- 172.21.15.39:0/2716006666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b8fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- 172.21.15.39:0/2716006666 >> 172.21.15.39:0/2716006666 conn(0x55c49b8ed010 msgr2=0x55c49b8eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- 172.21.15.39:0/2716006666 shutdown_connections 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- 172.21.15.39:0/2716006666 wait complete. 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- start start 2024-09-12T01:59:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 Processor -- start 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b900520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b900a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79081a9760 con 0x55c49b8f7370 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79081aabd0 con 0x55c49b8f19a0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79081a9e30 con 0x55c49b8f22e0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f790f883740 10 client.0 _ll_register_callbacks cb 0x7f790000bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f7906d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45012/0 (socket says 172.21.15.39:45012) 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f7906d9d640 1 -- 172.21.15.39:0/790947196 learned_addr learned my addr 172.21.15.39:0/790947196 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.410+0000 7f7906d9d640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b900520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7905d9b640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b900a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 -- 172.21.15.39:0/790947196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 msgr2=0x55c49b900a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b900a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 -- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 msgr2=0x55c49b900520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b900520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 -- 172.21.15.39:0/790947196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c49b902080 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f7906d9d640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7900003630 tx=0x7f790000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf929c21e6495986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f78edffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900023b20 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f790001b040 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc005520 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7900023cc0 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f790f883740 10 client.15897 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c49b903300 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.411+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc005520 con 0x55c49b8f7370 2024-09-12T01:59:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f790003a070 con 0x55c49b8f7370 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 10 client.15897 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 20 client.15897 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b972c10 0x55c49b975030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 4 client.15897 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c49b85cd70 con 0x55c49b972c10 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f7905d9b640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b972c10 0x55c49b975030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f78edffb640 10 client.15897 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.412+0000 7f7905d9b640 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b972c10 0x55c49b975030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504315c5078972df server_cookie=93f6054629d2bb8c in_seq=0 out_seq=0 2024-09-12T01:59:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.651+0000 7f78edffb640 1 -- 172.21.15.39:0/790947196 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c49b85cd70 con 0x55c49b972c10 2024-09-12T01:59:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.651+0000 7f78edffb640 10 client.15897 handle_command_reply: tid=0 2024-09-12T01:59:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 client.15897 shutdown 2024-09-12T01:59:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 msgr2=0x55c49b901a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7900003630 tx=0x7f790000b600 comp rx=0 tx=0).stop 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 shutdown_connections 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c49b972c10 0x55c49b975030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c49b8f7370 0x55c49b901a70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c49b8f22e0 0x55c49b900a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 --2- 172.21.15.39:0/790947196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c49b8f19a0 0x55c49b900520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f78edffb640 0 client.15897 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 >> 172.21.15.39:0/790947196 conn(0x55c49b8ed010 msgr2=0x55c49b8eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 shutdown_connections 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 1 -- 172.21.15.39:0/790947196 wait complete. 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790f883740 20 client.15897 trim_cache size 0 max 16384 2024-09-12T01:59:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:59:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:59:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:59:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:59:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 msgr2=0x7f78f00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 0x7f78f00a50f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78f80b96c0 tx=0x7f78f80095c0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.652+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 msgr2=0x7f790819a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f78f8031a40 tx=0x7f78f8031ec0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 shutdown_connections 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f78f00a2c30 0x7f78f00a50f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7908107840 0x7f79081a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7908104f10 0x7f790819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 --2- 172.21.15.39:0/1880257839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79081025e0 0x7f790819a090 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 >> 172.21.15.39:0/1880257839 conn(0x7f79080fc1e0 msgr2=0x7f7908101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 shutdown_connections 2024-09-12T01:59:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:01.653+0000 7f790ca0e640 1 -- 172.21.15.39:0/1880257839 wait complete. 2024-09-12T01:59:02.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:02 smithi172 ceph-mon[35073]: pgmap v401: 97 pgs: 97 active+clean; 38 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.3 MiB/s wr, 684 op/s 2024-09-12T01:59:02.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:02 smithi039 ceph-mon[31204]: pgmap v401: 97 pgs: 97 active+clean; 38 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.3 MiB/s wr, 684 op/s 2024-09-12T01:59:02.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:02 smithi044 ceph-mon[35259]: pgmap v401: 97 pgs: 97 active+clean; 38 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.3 MiB/s wr, 684 op/s 2024-09-12T01:59:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:04 smithi172 ceph-mon[35073]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 772 op/s 2024-09-12T01:59:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:04 smithi039 ceph-mon[31204]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 772 op/s 2024-09-12T01:59:04.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:04 smithi044 ceph-mon[35259]: pgmap v402: 97 pgs: 97 active+clean; 34 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 772 op/s 2024-09-12T01:59:05.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:59:06.106 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:06.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.590+0000 7f1b925cb640 1 -- 172.21.15.39:0/2263381787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 msgr2=0x7f1b8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:06.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.590+0000 7f1b925cb640 1 --2- 172.21.15.39:0/2263381787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c101200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009900 tx=0x7f1b7c02a480 comp rx=0 tx=0).stop 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 -- 172.21.15.39:0/2263381787 shutdown_connections 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 --2- 172.21.15.39:0/2263381787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 0x7f1b8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 --2- 172.21.15.39:0/2263381787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 0x7f1b8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 --2- 172.21.15.39:0/2263381787 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c101200 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 -- 172.21.15.39:0/2263381787 >> 172.21.15.39:0/2263381787 conn(0x7f1b8c0fc7d0 msgr2=0x7f1b8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 -- 172.21.15.39:0/2263381787 shutdown_connections 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 -- 172.21.15.39:0/2263381787 wait complete. 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 Processor -- start 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.591+0000 7f1b925cb640 1 -- start start 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 0x7f1b8c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:06.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 0x7f1b8c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c110f80 con 0x7f1b8c100e20 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c110e00 con 0x7f1b8c102ef0 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b925cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c111100 con 0x7f1b8c102570 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42022/0 (socket says 172.21.15.39:42022) 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 -- 172.21.15.39:0/3947140568 learned_addr learned my addr 172.21.15.39:0/3947140568 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8b7fe640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 0x7f1b8c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b90b68640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 0x7f1b8c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 -- 172.21.15.39:0/3947140568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 msgr2=0x7f1b8c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 0x7f1b8c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 -- 172.21.15.39:0/3947140568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 msgr2=0x7f1b8c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 0x7f1b8c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 -- 172.21.15.39:0/3947140568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c19d4f0 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.592+0000 7f1b8bfff640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c006010 tx=0x7f1b7c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.593+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c03f070 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.593+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c19d780 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.593+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7c031c30 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.593+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c035030 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.593+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a50c0 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.594+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c1021b0 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.595+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1b7c042070 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.595+0000 7f1b897fa640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 0x7f1b740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.596+0000 7f1b8b7fe640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 0x7f1b740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.596+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1b7c0ef740 con 0x7f1b8c100e20 2024-09-12T01:59:06.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.596+0000 7f1b8b7fe640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 0x7f1b740a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0fff40 tx=0x7f1b80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:06.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.600+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b7c031de0 con 0x7f1b8c100e20 2024-09-12T01:59:06.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:06 smithi172 ceph-mon[35073]: pgmap v403: 97 pgs: 97 active+clean; 37 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.6 MiB/s wr, 589 op/s 2024-09-12T01:59:06.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.814+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b8c1998a0 con 0x7f1b8c100e20 2024-09-12T01:59:06.816 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:06 smithi039 ceph-mon[31204]: pgmap v403: 97 pgs: 97 active+clean; 37 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.6 MiB/s wr, 589 op/s 2024-09-12T01:59:06.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.816+0000 7f1b897fa640 1 -- 172.21.15.39:0/3947140568 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11911 (secure 0 0 0) 0x7f1b7c0bc6b0 con 0x7f1b8c100e20 2024-09-12T01:59:06.817 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:59:06.817 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-12T01:58:43:389902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:58:42.815744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:59:06.817 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-12T01:59:06.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 msgr2=0x7f1b740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:06.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 0x7f1b740a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0fff40 tx=0x7f1b80005f90 comp rx=0 tx=0).stop 2024-09-12T01:59:06.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 msgr2=0x7f1b8c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:06.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c006010 tx=0x7f1b7c003c10 comp rx=0 tx=0).stop 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 shutdown_connections 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b8c102ef0 0x7f1b8c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f1b740a2b80 0x7f1b740a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8c102570 0x7f1b8c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 --2- 172.21.15.39:0/3947140568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b8c100e20 0x7f1b8c198540 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 >> 172.21.15.39:0/3947140568 conn(0x7f1b8c0fc7d0 msgr2=0x7f1b8c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 shutdown_connections 2024-09-12T01:59:06.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:06.818+0000 7f1b925cb640 1 -- 172.21.15.39:0/3947140568 wait complete. 2024-09-12T01:59:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:06 smithi044 ceph-mon[35259]: pgmap v403: 97 pgs: 97 active+clean; 37 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.6 MiB/s wr, 589 op/s 2024-09-12T01:59:07.597 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:07 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3947140568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:07.629 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --set-id 609c884c --release --await' 2024-09-12T01:59:07.630 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --set-id 609c884c --release --await 2024-09-12T01:59:07.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:07 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3947140568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:07.891 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:07.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:07 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3947140568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:08.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 -- 172.21.15.39:0/2111517905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820101400 msgr2=0x7fe82010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2111517905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820101400 0x7fe82010d930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe818009cd0 tx=0x7fe81802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 -- 172.21.15.39:0/2111517905 shutdown_connections 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2111517905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820101400 0x7fe82010d930 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2111517905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.492+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2111517905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820106a60 0x7fe820106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.493+0000 7fe825ef5640 1 -- 172.21.15.39:0/2111517905 >> 172.21.15.39:0/2111517905 conn(0x7fe8200fc780 msgr2=0x7fe8200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.493+0000 7fe825ef5640 1 -- 172.21.15.39:0/2111517905 shutdown_connections 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.493+0000 7fe825ef5640 1 -- 172.21.15.39:0/2111517905 wait complete. 2024-09-12T01:59:08.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.493+0000 7fe825ef5640 1 Processor -- start 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 -- start start 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820101400 0x7fe820102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe820110e60 con 0x7fe820106a60 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe820110ce0 con 0x7fe820100a60 2024-09-12T01:59:08.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe825ef5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe820110fe0 con 0x7fe820101400 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42044/0 (socket says 172.21.15.39:42044) 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.494+0000 7fe81ffff640 1 -- 172.21.15.39:0/2995480842 learned_addr learned my addr 172.21.15.39:0/2995480842 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81effd640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820101400 0x7fe820102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 -- 172.21.15.39:0/2995480842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820101400 msgr2=0x7fe820102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820101400 0x7fe820102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 -- 172.21.15.39:0/2995480842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 msgr2=0x7fe820102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820102630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 -- 172.21.15.39:0/2995480842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201a68f0 con 0x7fe820106a60 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81ffff640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe818005cc0 tx=0x7fe818032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81cff9640 1 -- 172.21.15.39:0/2995480842 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818004040 con 0x7fe820106a60 2024-09-12T01:59:08.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81cff9640 1 -- 172.21.15.39:0/2995480842 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8180046c0 con 0x7fe820106a60 2024-09-12T01:59:08.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201a6b80 con 0x7fe820106a60 2024-09-12T01:59:08.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe81cff9640 1 -- 172.21.15.39:0/2995480842 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818030e00 con 0x7fe820106a60 2024-09-12T01:59:08.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.495+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a70c0 con 0x7fe820106a60 2024-09-12T01:59:08.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.498+0000 7fe81cff9640 1 -- 172.21.15.39:0/2995480842 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe8180305a0 con 0x7fe820106a60 2024-09-12T01:59:08.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.498+0000 7fe8282ce740 1 Processor -- start 2024-09-12T01:59:08.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.498+0000 7fe8282ce740 1 -- start start 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.498+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d39f060 0x559c1d39f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.498+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe8282ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559c1d304620 con 0x559c1d3aa240 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe8282ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c1d2abe50 con 0x559c1d39f980 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe8282ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559c1d3005e0 con 0x559c1d39f060 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81cff9640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 0x7fe8080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42050/0 (socket says 172.21.15.39:42050) 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59068/0 (socket says 172.21.15.39:59068) 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81effd640 1 -- 172.21.15.39:0/4203502083 learned_addr learned my addr 172.21.15.39:0/4203502083 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:08.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81ffff640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 0x7fe8080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81effd640 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d39f060 0x559c1d39f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81cff9640 1 -- 172.21.15.39:0/2995480842 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe81802e030 con 0x7fe820106a60 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 -- 172.21.15.39:0/4203502083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d39f060 msgr2=0x559c1d39f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d39f060 0x559c1d39f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 -- 172.21.15.39:0/4203502083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 msgr2=0x559c1d3ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 -- 172.21.15.39:0/4203502083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c1d29cd40 con 0x559c1d39f980 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81effd640 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81ffff640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 0x7fe8080a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe81804d000 tx=0x7fe8180e7ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.499+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81000aeb0 tx=0x7fe81000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31497c3ed9d2dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe805ffb640 1 -- 172.21.15.39:0/4203502083 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81001d070 con 0x559c1d39f980 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe805ffb640 1 -- 172.21.15.39:0/4203502083 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe810010d20 con 0x559c1d39f980 2024-09-12T01:59:08.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe805ffb640 1 -- 172.21.15.39:0/4203502083 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810018de0 con 0x559c1d39f980 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 -- 172.21.15.39:0/4203502083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 msgr2=0x559c1d3a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe81000aeb0 tx=0x7fe81000f790 comp rx=0 tx=0).stop 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 -- 172.21.15.39:0/4203502083 shutdown_connections 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d3aa240 0x559c1d3ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3a9d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 --2- 172.21.15.39:0/4203502083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d39f060 0x559c1d39f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 -- 172.21.15.39:0/4203502083 >> 172.21.15.39:0/4203502083 conn(0x559c1d39b5f0 msgr2=0x559c1d39b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.500+0000 7fe8282ce740 1 -- 172.21.15.39:0/4203502083 shutdown_connections 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 -- 172.21.15.39:0/4203502083 wait complete. 2024-09-12T01:59:08.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 -- start start 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 Processor -- start 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f060 0x559c1d3a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559c1d3ace10 con 0x559c1d39f980 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559c1d28cf10 con 0x559c1d39f060 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559c1d3acf90 con 0x559c1d3aa240 2024-09-12T01:59:08.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.501+0000 7fe8282ce740 10 client.0 _ll_register_callbacks cb 0x559c1d2b0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f060 0x559c1d3a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42062/0 (socket says 172.21.15.39:42062) 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 -- 172.21.15.39:0/1563079744 learned_addr learned my addr 172.21.15.39:0/1563079744 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81effd640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 -- 172.21.15.39:0/1563079744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 msgr2=0x559c1d3a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 -- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f060 msgr2=0x559c1d3a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f060 0x559c1d3a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 -- 172.21.15.39:0/1563079744 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c1d013580 con 0x559c1d39f980 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe81000a4f0 tx=0x7fe810018780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f098248666af2b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe7feffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81001d050 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe810010840 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe810010d20 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe810010a40 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe8282ce740 10 client.15915 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.502+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c1d0dd960 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe810010d20 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe810004b30 con 0x559c1d39f980 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 10 client.15915 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 10 client.15915 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 20 client.15915 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d3b9d90 0x559c1d3bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 4 client.15915 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:08.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c1d311b90 con 0x559c1d3b9d90 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.503+0000 7fe81effd640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d3b9d90 0x559c1d3bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.504+0000 7fe81effd640 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d3b9d90 0x559c1d3bc180 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa0aafd5bf28e77 server_cookie=be6f32c8f32459a1 in_seq=0 out_seq=0 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.504+0000 7fe7feffd640 10 client.15915 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.504+0000 7fe7feffd640 1 -- 172.21.15.39:0/1563079744 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c1d311b90 con 0x559c1d3b9d90 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.504+0000 7fe7feffd640 10 client.15915 handle_command_reply: tid=0 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.504+0000 7fe8282ce740 1 client.15915 shutdown 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 msgr2=0x559c1d3a7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe81000a4f0 tx=0x7fe810018780 comp rx=0 tx=0).stop 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 shutdown_connections 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d3b9d90 0x559c1d3bc180 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f980 0x559c1d3a7690 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1563079744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f060 0x559c1d3a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 >> 172.21.15.39:0/1563079744 conn(0x559c1d39b5f0 msgr2=0x559c1d3a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe7feffd640 0 client.15915 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 shutdown_connections 2024-09-12T01:59:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 1 -- 172.21.15.39:0/1563079744 wait complete. 2024-09-12T01:59:08.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.505+0000 7fe8282ce740 20 client.15915 trim_cache size 0 max 16384 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 Processor -- start 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 -- start start 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201b1f00 con 0x559c1d39f060 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201af7d0 con 0x559c1d39f980 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe8282ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201ad620 con 0x559c1d3aa240 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42064/0 (socket says 172.21.15.39:42064) 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe81effd640 1 -- 172.21.15.39:0/2148055341 learned_addr learned my addr 172.21.15.39:0/2148055341 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.522+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 -- 172.21.15.39:0/2148055341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 msgr2=0x559c1d3c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 -- 172.21.15.39:0/2148055341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 msgr2=0x559c1d3c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 -- 172.21.15.39:0/2148055341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c1d399bb0 con 0x559c1d39f060 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe81effd640 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe814009730 tx=0x7fe814009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e534c78a46c202 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe8057fa640 1 -- 172.21.15.39:0/2148055341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814013110 con 0x559c1d39f060 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe8057fa640 1 -- 172.21.15.39:0/2148055341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8140132b0 con 0x559c1d39f060 2024-09-12T01:59:08.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe8057fa640 1 -- 172.21.15.39:0/2148055341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814011780 con 0x559c1d39f060 2024-09-12T01:59:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe8282ce740 1 -- 172.21.15.39:0/2148055341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 msgr2=0x559c1d3a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.523+0000 7fe8282ce740 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe814009730 tx=0x7fe814009b60 comp rx=0 tx=0).stop 2024-09-12T01:59:08.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- 172.21.15.39:0/2148055341 shutdown_connections 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- 172.21.15.39:0/2148055341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3a9020 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- 172.21.15.39:0/2148055341 >> 172.21.15.39:0/2148055341 conn(0x559c1d39b5f0 msgr2=0x559c1d39a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- 172.21.15.39:0/2148055341 shutdown_connections 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- 172.21.15.39:0/2148055341 wait complete. 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- start start 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 Processor -- start 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201adc90 con 0x559c1d39f060 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201af100 con 0x559c1d39f980 2024-09-12T01:59:08.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.524+0000 7fe8282ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8201ae360 con 0x559c1d3aa240 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe8282ce740 10 client.0 _ll_register_callbacks cb 0x7fe814009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42070/0 (socket says 172.21.15.39:42070) 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 -- 172.21.15.39:0/1063938636 learned_addr learned my addr 172.21.15.39:0/1063938636 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 -- 172.21.15.39:0/1063938636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 msgr2=0x559c1d3af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 -- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 msgr2=0x559c1d3b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 -- 172.21.15.39:0/1063938636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c1d3afc10 con 0x559c1d39f060 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe81effd640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe814014010 tx=0x7fe814013520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4337e13a866955f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:08.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe7feffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8140035f0 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8140132b0 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.525+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe814026070 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe814003790 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 10 client.15921 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c1d425460 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8140132b0 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fe814011ba0 con 0x559c1d39f060 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 10 client.15921 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 10 client.15921 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 20 client.15921 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d425b30 0x559c1d427f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 4 client.15921 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "609c884c", "release": true, "await": true}] 2024-09-12T01:59:08.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "set_id": "609c884c", "release": true, "await": true}) -- 0x559c1d30c0a0 con 0x559c1d425b30 2024-09-12T01:59:08.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.526+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d425b30 0x559c1d427f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:08.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.527+0000 7fe81f7fe640 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d425b30 0x559c1d427f50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2da96d82e637acc server_cookie=62d375ffc68387f8 in_seq=0 out_seq=0 2024-09-12T01:59:08.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.527+0000 7fe7feffd640 10 client.15921 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.647+0000 7fe7feffd640 1 -- 172.21.15.39:0/1063938636 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559c1d30c0a0 con 0x559c1d425b30 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.647+0000 7fe7feffd640 10 client.15921 handle_command_reply: tid=0 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.647+0000 7fe8282ce740 1 client.15921 shutdown 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 msgr2=0x559c1d3b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe814014010 tx=0x7fe814013520 comp rx=0 tx=0).stop 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 shutdown_connections 2024-09-12T01:59:08.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559c1d425b30 0x559c1d427f50 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559c1d3aa240 0x559c1d3af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559c1d39f980 0x559c1d3b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 --2- 172.21.15.39:0/1063938636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559c1d39f060 0x559c1d3b2580 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 >> 172.21.15.39:0/1063938636 conn(0x559c1d39b5f0 msgr2=0x559c1d399f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe7feffd640 0 client.15921 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 shutdown_connections 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 1 -- 172.21.15.39:0/1063938636 wait complete. 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe8282ce740 20 client.15921 trim_cache size 0 max 16384 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:08.650 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 27, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 8, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "609c884c": { 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 8, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 133.4, 2024-09-12T01:59:08.651 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:08.652 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 msgr2=0x7fe8080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 0x7fe8080a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe81804d000 tx=0x7fe8180e7ba0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 msgr2=0x7fe8201030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.648+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe818005cc0 tx=0x7fe818032f40 comp rx=0 tx=0).stop 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 shutdown_connections 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe820106a60 0x7fe8201030b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe8080a2b80 0x7fe8080a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe820101400 0x7fe820102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 --2- 172.21.15.39:0/2995480842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe820100a60 0x7fe820102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 >> 172.21.15.39:0/2995480842 conn(0x7fe8200fc780 msgr2=0x7fe82006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 shutdown_connections 2024-09-12T01:59:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:08.649+0000 7fe825ef5640 1 -- 172.21.15.39:0/2995480842 wait complete. 2024-09-12T01:59:08.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:08 smithi039 ceph-mon[31204]: pgmap v404: 97 pgs: 97 active+clean; 37 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-12T01:59:08.660 INFO:tasks.workunit.client.0.smithi039.stdout:checking err.h usability... yes 2024-09-12T01:59:08.677 INFO:tasks.workunit.client.0.smithi039.stdout:checking err.h presence... yes 2024-09-12T01:59:08.677 INFO:tasks.workunit.client.0.smithi039.stdout:checking for err.h... yes 2024-09-12T01:59:08.721 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/falloc.h usability... yes 2024-09-12T01:59:08.736 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/falloc.h presence... yes 2024-09-12T01:59:08.736 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/falloc.h... yes 2024-09-12T01:59:08.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:08 smithi172 ceph-mon[35073]: pgmap v404: 97 pgs: 97 active+clean; 37 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-12T01:59:08.791 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-12T01:59:08.818 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-12T01:59:08.818 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-12T01:59:08.861 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-12T01:59:08.888 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-12T01:59:08.888 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-12T01:59:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:08 smithi044 ceph-mon[35259]: pgmap v404: 97 pgs: 97 active+clean; 37 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.6 MiB/s wr, 506 op/s 2024-09-12T01:59:08.936 INFO:tasks.workunit.client.0.smithi039.stdout:checking xfs/platform_defs.h usability... no 2024-09-12T01:59:08.962 INFO:tasks.workunit.client.0.smithi039.stdout:checking xfs/platform_defs.h presence... no 2024-09-12T01:59:08.962 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/platform_defs.h... no 2024-09-12T01:59:09.004 INFO:tasks.workunit.client.0.smithi039.stdout:checking btrfs/ioctl.h usability... no 2024-09-12T01:59:09.031 INFO:tasks.workunit.client.0.smithi039.stdout:checking btrfs/ioctl.h presence... no 2024-09-12T01:59:09.031 INFO:tasks.workunit.client.0.smithi039.stdout:checking for btrfs/ioctl.h... no 2024-09-12T01:59:09.088 INFO:tasks.workunit.client.0.smithi039.stdout:checking cifs/ioctl.h usability... no 2024-09-12T01:59:09.115 INFO:tasks.workunit.client.0.smithi039.stdout:checking cifs/ioctl.h presence... no 2024-09-12T01:59:09.115 INFO:tasks.workunit.client.0.smithi039.stdout:checking for cifs/ioctl.h... no 2024-09-12T01:59:09.246 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/mman.h usability... yes 2024-09-12T01:59:09.263 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/mman.h presence... yes 2024-09-12T01:59:09.263 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/mman.h... yes 2024-09-12T01:59:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/ext4.h usability... no 2024-09-12T01:59:09.341 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/ext4.h presence... no 2024-09-12T01:59:09.341 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/ext4.h... no 2024-09-12T01:59:09.385 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/xfs_log_format.h... no 2024-09-12T01:59:09.445 INFO:tasks.workunit.client.0.smithi039.stdout:checking for uuid_compare... no 2024-09-12T01:59:09.486 INFO:tasks.workunit.client.0.smithi039.stdout:checking for uuid_compare in -luuid... yes 2024-09-12T01:59:09.510 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '609c884c', total seconds elapsed: 17.1 2024-09-12T01:59:09.582 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/xfs.h... yes 2024-09-12T01:59:09.615 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/libxfs.h... no 2024-09-12T01:59:09.644 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-12T01:59:09.685 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/xqm.h... yes 2024-09-12T01:59:09.739 INFO:tasks.workunit.client.0.smithi039.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-12T01:59:09.776 INFO:tasks.workunit.client.0.smithi039.stdout:checking xfs/handle.h usability... yes 2024-09-12T01:59:09.791 INFO:tasks.workunit.client.0.smithi039.stdout:checking xfs/handle.h presence... yes 2024-09-12T01:59:09.791 INFO:tasks.workunit.client.0.smithi039.stdout:checking for xfs/handle.h... yes 2024-09-12T01:59:09.845 INFO:tasks.workunit.client.0.smithi039.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-12T01:59:09.882 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/acl.h usability... yes 2024-09-12T01:59:09.900 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/acl.h presence... yes 2024-09-12T01:59:09.900 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/acl.h... yes 2024-09-12T01:59:09.941 INFO:tasks.workunit.client.0.smithi039.stdout:checking acl/libacl.h usability... yes 2024-09-12T01:59:09.959 INFO:tasks.workunit.client.0.smithi039.stdout:checking acl/libacl.h presence... yes 2024-09-12T01:59:09.959 INFO:tasks.workunit.client.0.smithi039.stdout:checking for acl/libacl.h... yes 2024-09-12T01:59:10.000 INFO:tasks.workunit.client.0.smithi039.stdout:checking for acl_init in -lacl... yes 2024-09-12T01:59:10.092 INFO:tasks.workunit.client.0.smithi039.stdout:checking gdbm-ndbm.h usability... no 2024-09-12T01:59:10.124 INFO:tasks.workunit.client.0.smithi039.stdout:checking gdbm-ndbm.h presence... no 2024-09-12T01:59:10.124 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gdbm-ndbm.h... no 2024-09-12T01:59:10.165 INFO:tasks.workunit.client.0.smithi039.stdout:checking gdbm/ndbm.h usability... no 2024-09-12T01:59:10.194 INFO:tasks.workunit.client.0.smithi039.stdout:checking gdbm/ndbm.h presence... no 2024-09-12T01:59:10.194 INFO:tasks.workunit.client.0.smithi039.stdout:checking for gdbm/ndbm.h... no 2024-09-12T01:59:10.231 INFO:tasks.workunit.client.0.smithi039.stdout:checking ndbm.h usability... no 2024-09-12T01:59:10.259 INFO:tasks.workunit.client.0.smithi039.stdout:checking ndbm.h presence... no 2024-09-12T01:59:10.259 INFO:tasks.workunit.client.0.smithi039.stdout:checking for ndbm.h... no 2024-09-12T01:59:10.291 INFO:tasks.workunit.client.0.smithi039.stdout:checking libaio.h usability... yes 2024-09-12T01:59:10.309 INFO:tasks.workunit.client.0.smithi039.stdout:checking libaio.h presence... yes 2024-09-12T01:59:10.309 INFO:tasks.workunit.client.0.smithi039.stdout:checking for libaio.h... yes 2024-09-12T01:59:10.353 INFO:tasks.workunit.client.0.smithi039.stdout:checking liburing.h usability... no 2024-09-12T01:59:10.381 INFO:tasks.workunit.client.0.smithi039.stdout:checking liburing.h presence... no 2024-09-12T01:59:10.381 INFO:tasks.workunit.client.0.smithi039.stdout:checking for liburing.h... no 2024-09-12T01:59:10.419 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/capability.h usability... no 2024-09-12T01:59:10.446 INFO:tasks.workunit.client.0.smithi039.stdout:checking sys/capability.h presence... no 2024-09-12T01:59:10.446 INFO:tasks.workunit.client.0.smithi039.stdout:checking for sys/capability.h... no 2024-09-12T01:59:10.479 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/fiemap.h usability... yes 2024-09-12T01:59:10.494 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/fiemap.h presence... yes 2024-09-12T01:59:10.494 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/fiemap.h... yes 2024-09-12T01:59:10.532 INFO:tasks.workunit.client.0.smithi039.stdout:checking for fallocate... yes 2024-09-12T01:59:10.589 INFO:tasks.workunit.client.0.smithi039.stdout:checking for open_by_handle_at... yes 2024-09-12T01:59:10.627 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/fs.h usability... yes 2024-09-12T01:59:10.644 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/fs.h presence... yes 2024-09-12T01:59:10.645 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/fs.h... yes 2024-09-12T01:59:10.700 INFO:tasks.workunit.client.0.smithi039.stdout:checking btrfsutil.h usability... no 2024-09-12T01:59:10.731 INFO:tasks.workunit.client.0.smithi039.stdout:checking btrfsutil.h presence... no 2024-09-12T01:59:10.731 INFO:tasks.workunit.client.0.smithi039.stdout:checking for btrfsutil.h... no 2024-09-12T01:59:10.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:10 smithi172 ceph-mon[35073]: pgmap v405: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 457 op/s 2024-09-12T01:59:10.778 INFO:tasks.workunit.client.0.smithi039.stdout:checking for copy_file_range... yes 2024-09-12T01:59:10.823 INFO:tasks.workunit.client.0.smithi039.stdout:checking for SEEK_DATA... yes 2024-09-12T01:59:10.883 INFO:tasks.workunit.client.0.smithi039.stdout:checking for BMV_OF_SHARED... yes 2024-09-12T01:59:10.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:10 smithi039 ceph-mon[31204]: pgmap v405: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 457 op/s 2024-09-12T01:59:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:10 smithi044 ceph-mon[35259]: pgmap v405: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 457 op/s 2024-09-12T01:59:10.940 INFO:tasks.workunit.client.0.smithi039.stdout:checking for nftw... yes 2024-09-12T01:59:11.001 INFO:tasks.workunit.client.0.smithi039.stdout:checking for RLIMIT_NOFILE... yes 2024-09-12T01:59:11.044 INFO:tasks.workunit.client.0.smithi039.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-12T01:59:11.120 INFO:tasks.workunit.client.0.smithi039.stdout:checking for FICLONE... yes 2024-09-12T01:59:11.167 INFO:tasks.workunit.client.0.smithi039.stdout:checking for renameat2... yes 2024-09-12T01:59:11.210 INFO:tasks.workunit.client.0.smithi039.stdout:checking for reallocarray... yes 2024-09-12T01:59:11.272 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct mount_attr... yes 2024-09-12T01:59:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-12T01:59:11.390 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-12T01:59:11.445 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-12T01:59:11.501 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-12T01:59:11.556 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-12T01:59:11.611 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-12T01:59:11.667 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-12T01:59:11.707 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/btrfs.h usability... yes 2024-09-12T01:59:11.723 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/btrfs.h presence... yes 2024-09-12T01:59:11.723 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/btrfs.h... yes 2024-09-12T01:59:11.779 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-12T01:59:11.796 INFO:tasks.workunit.client.0.smithi039.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-12T01:59:11.796 INFO:tasks.workunit.client.0.smithi039.stdout:checking for linux/btrfs_tree.h... yes 2024-09-12T01:59:11.837 INFO:tasks.workunit.client.0.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-12T01:59:11.867 INFO:tasks.workunit.client.0.smithi039.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-12T01:59:11.888 INFO:tasks.workunit.client.0.smithi039.stdout:configure: creating ./config.status 2024-09-12T01:59:12.232 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating include/builddefs 2024-09-12T01:59:12.246 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: creating include/config.h 2024-09-12T01:59:12.258 INFO:tasks.workunit.client.0.smithi039.stdout:config.status: executing libtool commands 2024-09-12T01:59:12.336 INFO:tasks.workunit.client.0.smithi039.stdout:Building include 2024-09-12T01:59:12.336 INFO:tasks.workunit.client.0.smithi039.stdout:Building lib 2024-09-12T01:59:12.336 INFO:tasks.workunit.client.0.smithi039.stdout:Building tests 2024-09-12T01:59:12.340 INFO:tasks.workunit.client.0.smithi039.stdout: [LTDEP] 2024-09-12T01:59:12.343 INFO:tasks.workunit.client.0.smithi039.stdout:Building btrfs 2024-09-12T01:59:12.343 INFO:tasks.workunit.client.0.smithi039.stdout:Building ceph 2024-09-12T01:59:12.343 INFO:tasks.workunit.client.0.smithi039.stdout:Building cifs 2024-09-12T01:59:12.350 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-12T01:59:12.351 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-12T01:59:12.369 INFO:tasks.workunit.client.0.smithi039.stdout:Building ext4 2024-09-12T01:59:12.370 INFO:tasks.workunit.client.0.smithi039.stdout:Building f2fs 2024-09-12T01:59:12.378 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-12T01:59:12.378 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-12T01:59:12.384 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-12T01:59:12.400 INFO:tasks.workunit.client.0.smithi039.stdout:Building generic 2024-09-12T01:59:12.431 INFO:tasks.workunit.client.0.smithi039.stdout:Building nfs 2024-09-12T01:59:12.438 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-12T01:59:12.457 INFO:tasks.workunit.client.0.smithi039.stdout:Building ocfs2 2024-09-12T01:59:12.465 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-12T01:59:12.466 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-12T01:59:12.485 INFO:tasks.workunit.client.0.smithi039.stdout:Building overlay 2024-09-12T01:59:12.502 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-12T01:59:12.534 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dataascii.lo 2024-09-12T01:59:12.559 INFO:tasks.workunit.client.0.smithi039.stdout:Building perf 2024-09-12T01:59:12.566 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-12T01:59:12.582 INFO:tasks.workunit.client.0.smithi039.stdout:Building selftest 2024-09-12T01:59:12.589 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-12T01:59:12.606 INFO:tasks.workunit.client.0.smithi039.stdout:Building shared 2024-09-12T01:59:12.614 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-12T01:59:12.617 INFO:tasks.workunit.client.0.smithi039.stdout:Building tmpfs 2024-09-12T01:59:12.625 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-12T01:59:12.637 INFO:tasks.workunit.client.0.smithi039.stdout:Building udf 2024-09-12T01:59:12.641 INFO:tasks.workunit.client.0.smithi039.stdout:Building xfs 2024-09-12T01:59:12.644 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-12T01:59:12.661 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] databin.lo 2024-09-12T01:59:12.683 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] datapid.lo 2024-09-12T01:59:12.707 INFO:tasks.workunit.client.0.smithi039.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-12T01:59:12.719 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] file_lock.lo 2024-09-12T01:59:12.804 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] forker.lo 2024-09-12T01:59:12.833 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] pattern.lo 2024-09-12T01:59:12.861 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] open_flags.lo 2024-09-12T01:59:12.904 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] random_range.lo 2024-09-12T01:59:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:12 smithi039 ceph-mon[31204]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 345 op/s 2024-09-12T01:59:12.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:12 smithi044 ceph-mon[35259]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 345 op/s 2024-09-12T01:59:12.952 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] string_to_tokens.lo 2024-09-12T01:59:12.981 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] str_to_bytes.lo 2024-09-12T01:59:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:12 smithi172 ceph-mon[35073]: pgmap v406: 97 pgs: 97 active+clean; 37 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 345 op/s 2024-09-12T01:59:13.025 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] tlibio.lo 2024-09-12T01:59:13.069 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] write_log.lo 2024-09-12T01:59:13.155 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] random.lo 2024-09-12T01:59:13.345 INFO:tasks.workunit.client.0.smithi039.stdout: [LD] 2024-09-12T01:59:13.527 INFO:tasks.workunit.client.0.smithi039.stdout:Building ltp 2024-09-12T01:59:13.527 INFO:tasks.workunit.client.0.smithi039.stdout:Building src 2024-09-12T01:59:13.527 INFO:tasks.workunit.client.0.smithi039.stdout:Building m4 2024-09-12T01:59:13.527 INFO:tasks.workunit.client.0.smithi039.stdout:Building common 2024-09-12T01:59:13.536 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:13.553 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:13.893 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] doio 2024-09-12T01:59:13.893 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fsstress 2024-09-12T01:59:13.893 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fsx 2024-09-12T01:59:14.584 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] growfiles 2024-09-12T01:59:14.652 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] iogen 2024-09-12T01:59:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/1909552564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8102d50 msgr2=0x7f0cd81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/1909552564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8102d50 0x7f0cd81031d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009900 tx=0x7f0ccc02a410 comp rx=0 tx=0).stop 2024-09-12T01:59:14.770 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/1909552564 shutdown_connections 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/1909552564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8103710 0x7f0cd8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/1909552564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8102d50 0x7f0cd81031d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/1909552564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8101b60 0x7f0cd8101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/1909552564 >> 172.21.15.39:0/1909552564 conn(0x7f0cd80fd2e0 msgr2=0x7f0cd80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/1909552564 shutdown_connections 2024-09-12T01:59:14.771 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.769+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/1909552564 wait complete. 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.770+0000 7f0cdcc5e640 1 Processor -- start 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.770+0000 7f0cdcc5e640 1 -- start start 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.770+0000 7f0cdcc5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.770+0000 7f0cdcc5e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 0x7f0cd8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.770+0000 7f0cdcc5e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8103710 0x7f0cd819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cdcc5e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd810d810 con 0x7f0cd8101b60 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cdcc5e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd810d690 con 0x7f0cd8102d50 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cdcc5e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd810d990 con 0x7f0cd8103710 2024-09-12T01:59:14.773 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37748/0 (socket says 172.21.15.39:37748) 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 0x7f0cd8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd659c640 1 -- 172.21.15.39:0/481242280 learned_addr learned my addr 172.21.15.39:0/481242280 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8103710 0x7f0cd819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/481242280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8103710 msgr2=0x7f0cd819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8103710 0x7f0cd819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 msgr2=0x7f0cd8197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/481242280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd819f9f0 con 0x7f0cd8102d50 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd659c640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.771+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 0x7f0cd8198310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc02a930 tx=0x7f0ccc032da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.772+0000 7f0cc77fe640 1 -- 172.21.15.39:0/481242280 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc048070 con 0x7f0cd8102d50 2024-09-12T01:59:14.774 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.772+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd8074420 con 0x7f0cd8102d50 2024-09-12T01:59:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.772+0000 7f0cc77fe640 1 -- 172.21.15.39:0/481242280 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ccc03ad60 con 0x7f0cd8102d50 2024-09-12T01:59:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.772+0000 7f0cc77fe640 1 -- 172.21.15.39:0/481242280 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc035050 con 0x7f0cd8102d50 2024-09-12T01:59:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.772+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd8074930 con 0x7f0cd8102d50 2024-09-12T01:59:14.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.774+0000 7f0cc77fe640 1 -- 172.21.15.39:0/481242280 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0ccc04b070 con 0x7f0cd8102d50 2024-09-12T01:59:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.775+0000 7f0cc77fe640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 0x7f0cc00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.775+0000 7f0cc77fe640 1 -- 172.21.15.39:0/481242280 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ccc0f2e00 con 0x7f0cd8102d50 2024-09-12T01:59:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.775+0000 7f0cd659c640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 0x7f0cc00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 Processor -- start 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 -- start start 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 0x564511fcdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 0x564511fd2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564511f312f0 con 0x564511fcd9a0 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564511ed9270 con 0x564511fd3370 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564511f2d2b0 con 0x564511fce2e0 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cd659c640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 0x7f0cc00a5170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800afc0 tx=0x7f0cc800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cd659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 0x564511fcdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40938/0 (socket says 172.21.15.39:40938) 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.776+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/3679463252 learned_addr learned my addr 172.21.15.39:0/3679463252 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 0x564511fd2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/3679463252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 msgr2=0x564511fd2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 0x564511fd2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/3679463252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 msgr2=0x564511fcdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 0x564511fcdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/3679463252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564511ed8340 con 0x564511fd3370 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd659c640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 0x564511fcdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 0x564511fd2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:14.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00039f0 tx=0x7f0cd0003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b39aa2960c0d743 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.780 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cc4ff9640 1 -- 172.21.15.39:0/3679463252 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd001a470 con 0x564511fd3370 2024-09-12T01:59:14.780 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cc4ff9640 1 -- 172.21.15.39:0/3679463252 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd0015070 con 0x564511fd3370 2024-09-12T01:59:14.780 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.777+0000 7f0cc4ff9640 1 -- 172.21.15.39:0/3679463252 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0010900 con 0x564511fd3370 2024-09-12T01:59:14.780 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/3679463252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 msgr2=0x564511fd5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00039f0 tx=0x7f0cd0003eb0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/3679463252 shutdown_connections 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fd3370 0x564511fd5830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fce2e0 0x564511fd2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/3679463252 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fcd9a0 0x564511fcdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/3679463252 >> 172.21.15.39:0/3679463252 conn(0x564511fc9010 msgr2=0x564511fc9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/3679463252 shutdown_connections 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/3679463252 wait complete. 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.779+0000 7f0cdf9f6740 1 -- start start 2024-09-12T01:59:14.781 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 Processor -- start 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fd7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fdf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564511fd6340 con 0x564511fce2e0 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564511eba290 con 0x564511fcd9a0 2024-09-12T01:59:14.784 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564511fd64c0 con 0x564511fd3370 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cdf9f6740 10 client.0 _ll_register_callbacks cb 0x564511eeb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fd7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fdf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fdf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:45284/0 (socket says 172.21.15.39:45284) 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/2120430000 learned_addr learned my addr 172.21.15.39:0/2120430000 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fd7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40944/0 (socket says 172.21.15.39:40944) 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.780+0000 7f0cd5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37762/0 (socket says 172.21.15.39:37762) 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2120430000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 msgr2=0x564511fdf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fdf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 msgr2=0x564511fd7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.785 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fd7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2120430000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564511c44210 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564511fced10 tx=0x7f0ccc003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c1841c5e8d25c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0bf6c0 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.781+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ccc003680 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.782+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd0015070 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.782+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc0c39c0 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.782+0000 7f0cdf9f6740 10 client.15933 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.782+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564511d10620 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.782+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd0015070 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0ccc0d3b30 con 0x564511fce2e0 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 10 client.15933 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:14.786 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 20 client.15933 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x564511fe5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 4 client.15933 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564511f3ea20 con 0x564511fe37d0 2024-09-12T01:59:14.787 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.783+0000 7f0cd659c640 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x564511fe5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.784+0000 7f0cbdffb640 10 client.15933 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.784+0000 7f0cd659c640 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x564511fe5c50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2ee6ae459c761a server_cookie=3ea2c7f8e762fc86 in_seq=0 out_seq=0 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2120430000 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564511f3ea20 con 0x564511fe37d0 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cbdffb640 10 client.15933 handle_command_reply: tid=0 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 client.15933 shutdown 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 msgr2=0x564511fd8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.788 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x564511fced10 tx=0x7f0ccc003a20 comp rx=0 tx=0).stop 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 shutdown_connections 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x564511fe5c50 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fdf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cbdffb640 0 client.15933 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fd8160 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2120430000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fd7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 >> 172.21.15.39:0/2120430000 conn(0x564511fc9010 msgr2=0x564511fca820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 shutdown_connections 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.785+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2120430000 wait complete. 2024-09-12T01:59:14.789 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.786+0000 7f0cdf9f6740 20 client.15933 trim_cache size 0 max 16384 2024-09-12T01:59:14.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.815+0000 7f0cdf9f6740 1 Processor -- start 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.815+0000 7f0cdf9f6740 1 -- start start 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 0x564511fc93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fce2e0 0x564511fdf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a9580 con 0x564511fd3370 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a6e50 con 0x564511fce2e0 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a4ca0 con 0x564511fcd9a0 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37766/0 (socket says 172.21.15.39:37766) 2024-09-12T01:59:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/65188512 learned_addr learned my addr 172.21.15.39:0/65188512 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fce2e0 0x564511fdf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd659c640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 0x564511fc93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/65188512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 msgr2=0x564511fc93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 0x564511fc93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/65188512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fce2e0 msgr2=0x564511fdf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fce2e0 0x564511fdf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd6d9d640 1 -- 172.21.15.39:0/65188512 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564511fc8e30 con 0x564511fd3370 2024-09-12T01:59:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.816+0000 7f0cd659c640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 0x564511fc93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.817+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009de0 tx=0x7f0cd0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e73e715dcfe16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.817+0000 7f0cbffff640 1 -- 172.21.15.39:0/65188512 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0010550 con 0x564511fd3370 2024-09-12T01:59:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.817+0000 7f0cbffff640 1 -- 172.21.15.39:0/65188512 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd0015040 con 0x564511fd3370 2024-09-12T01:59:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.817+0000 7f0cbffff640 1 -- 172.21.15.39:0/65188512 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011a70 con 0x564511fd3370 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/65188512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 msgr2=0x564511fc80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009de0 tx=0x7f0cd0005bd0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/65188512 shutdown_connections 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fd3370 0x564511fc80b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fce2e0 0x564511fdf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/65188512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fcd9a0 0x564511fc93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/65188512 >> 172.21.15.39:0/65188512 conn(0x564511fc9010 msgr2=0x564511fc79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/65188512 shutdown_connections 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.818+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/65188512 wait complete. 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 -- start start 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 Processor -- start 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fdcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fde2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a5310 con 0x564511fce2e0 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a6780 con 0x564511fcd9a0 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81a59e0 con 0x564511fd3370 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cdf9f6740 10 client.0 _ll_register_callbacks cb 0x7f0ccc005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cd5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cd5d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37770/0 (socket says 172.21.15.39:37770) 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2270151287 learned_addr learned my addr 172.21.15.39:0/2270151287 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cd659c640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fdcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.819+0000 7f0cd6d9d640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fde2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2270151287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 msgr2=0x564511fde2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fde2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 msgr2=0x564511fdcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fdcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 -- 172.21.15.39:0/2270151287 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564511fde8b0 con 0x564511fce2e0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cd5d9b640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0bc090 tx=0x7f0ccc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c7df85db34ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0bf200 con 0x564511fce2e0 2024-09-12T01:59:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ccc0aa0b0 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.820+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd0015040 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ccc0bfb30 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 10 client.15939 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56451204ea90 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd0015040 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0ccc0bec20 con 0x564511fce2e0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 10 client.15939 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 20 client.15939 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x5645120512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 4 client.15939 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564511f38d70 con 0x564511fe37d0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.821+0000 7f0cd659c640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x5645120512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.822+0000 7f0cd659c640 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x5645120512d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af74a05165cf5e0 server_cookie=d961722db39bfac4 in_seq=0 out_seq=0 2024-09-12T01:59:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.822+0000 7f0cbdffb640 10 client.15939 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:14.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:14 smithi039 ceph-mon[31204]: pgmap v407: 97 pgs: 97 active+clean; 37 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 794 KiB/s wr, 249 op/s 2024-09-12T01:59:14.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:14 smithi044 ceph-mon[35259]: pgmap v407: 97 pgs: 97 active+clean; 37 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 794 KiB/s wr, 249 op/s 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.933+0000 7f0cbdffb640 1 -- 172.21.15.39:0/2270151287 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564511f38d70 con 0x564511fe37d0 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.933+0000 7f0cbdffb640 10 client.15939 handle_command_reply: tid=0 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 client.15939 shutdown 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 msgr2=0x564511fdd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0bc090 tx=0x7f0ccc0045e0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 shutdown_connections 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564511fe37d0 0x5645120512d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564511fd3370 0x564511fde2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564511fce2e0 0x564511fdd2e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 --2- 172.21.15.39:0/2270151287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564511fcd9a0 0x564511fdcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 >> 172.21.15.39:0/2270151287 conn(0x564511fc9010 msgr2=0x564511fc81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cbdffb640 0 client.15939 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 shutdown_connections 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 1 -- 172.21.15.39:0/2270151287 wait complete. 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.934+0000 7f0cdf9f6740 20 client.15939 trim_cache size 0 max 16384 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:59:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:59:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 msgr2=0x7f0cc00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 0x7f0cc00a5170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800afc0 tx=0x7f0cc800a380 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 msgr2=0x7f0cd8198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 0x7f0cd8198310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc02a930 tx=0x7f0ccc032da0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 shutdown_connections 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0cc00a2cb0 0x7f0cc00a5170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.935+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd8103710 0x7f0cd819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.936+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cd8102d50 0x7f0cd8198310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.936+0000 7f0cdcc5e640 1 --2- 172.21.15.39:0/481242280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cd8101b60 0x7f0cd8197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.936+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 >> 172.21.15.39:0/481242280 conn(0x7f0cd80fd2e0 msgr2=0x7f0cd81060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.936+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 shutdown_connections 2024-09-12T01:59:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:14.936+0000 7f0cdcc5e640 1 -- 172.21.15.39:0/481242280 wait complete. 2024-09-12T01:59:15.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:14 smithi172 ceph-mon[35073]: pgmap v407: 97 pgs: 97 active+clean; 37 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 794 KiB/s wr, 249 op/s 2024-09-12T01:59:15.109 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-stress 2024-09-12T01:59:15.627 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:15.628 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:15.628 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:15.628 INFO:tasks.workunit.client.0.smithi039.stdout: [DEP] 2024-09-12T01:59:15.862 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dirstress 2024-09-12T01:59:15.862 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fill 2024-09-12T01:59:15.863 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fill2 2024-09-12T01:59:15.863 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] getpagesize 2024-09-12T01:59:16.003 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] holes 2024-09-12T01:59:16.016 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] lstat64 2024-09-12T01:59:16.099 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] nametest 2024-09-12T01:59:16.121 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] permname 2024-09-12T01:59:16.208 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] randholes 2024-09-12T01:59:16.215 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] runas 2024-09-12T01:59:16.339 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] truncfile 2024-09-12T01:59:16.367 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] usemem 2024-09-12T01:59:16.416 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] mmapcat 2024-09-12T01:59:16.482 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] append_reader 2024-09-12T01:59:16.522 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] append_writer 2024-09-12T01:59:16.540 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dirperf 2024-09-12T01:59:16.563 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] metaperf 2024-09-12T01:59:16.648 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] devzero 2024-09-12T01:59:16.689 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] feature 2024-09-12T01:59:16.794 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] alloc 2024-09-12T01:59:16.826 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fault 2024-09-12T01:59:16.863 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fstest 2024-09-12T01:59:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:16 smithi039 ceph-mon[31204]: pgmap v408: 97 pgs: 97 active+clean; 39 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 103 op/s 2024-09-12T01:59:16.913 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_access_root 2024-09-12T01:59:16.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:16 smithi044 ceph-mon[35259]: pgmap v408: 97 pgs: 97 active+clean; 39 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 103 op/s 2024-09-12T01:59:16.997 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] godown 2024-09-12T01:59:17.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:16 smithi172 ceph-mon[35073]: pgmap v408: 97 pgs: 97 active+clean; 39 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 103 op/s 2024-09-12T01:59:17.022 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] resvtest 2024-09-12T01:59:17.077 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] writemod 2024-09-12T01:59:17.128 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] writev_on_pagefault 2024-09-12T01:59:17.170 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] makeextents 2024-09-12T01:59:17.238 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] itrash 2024-09-12T01:59:17.238 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] rename 2024-09-12T01:59:17.291 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] multi_open_unlink 2024-09-12T01:59:17.372 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] unwritten_sync 2024-09-12T01:59:17.379 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] genhashnames 2024-09-12T01:59:17.406 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_holes 2024-09-12T01:59:17.467 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_writev 2024-09-12T01:59:17.564 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_truncate_cmtime 2024-09-12T01:59:17.565 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dirhash_collide 2024-09-12T01:59:17.585 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_rename_overwrite 2024-09-12T01:59:17.628 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] holetest 2024-09-12T01:59:17.732 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_truncate_self 2024-09-12T01:59:17.740 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] af_unix 2024-09-12T01:59:17.786 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_stale_pmd 2024-09-12T01:59:17.886 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_cow_race 2024-09-12T01:59:17.888 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_fallocate 2024-09-12T01:59:17.905 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fsync-err 2024-09-12T01:59:17.945 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_write_ro 2024-09-12T01:59:18.044 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-12T01:59:18.053 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-12T01:59:18.103 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_ofd_locks 2024-09-12T01:59:18.108 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_collision 2024-09-12T01:59:18.207 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] mmap-write-concurrent 2024-09-12T01:59:18.223 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_get_file_time 2024-09-12T01:59:18.306 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_create_short_dirs 2024-09-12T01:59:18.329 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_create_long_dirs 2024-09-12T01:59:18.375 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_enospc 2024-09-12T01:59:18.386 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_writev_overlap 2024-09-12T01:59:18.493 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] checkpoint_journal 2024-09-12T01:59:18.493 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] mmap-rw-fault 2024-09-12T01:59:18.556 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] allocstale 2024-09-12T01:59:18.580 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_cow_memory_failure 2024-09-12T01:59:18.651 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fake-dump-rootino 2024-09-12T01:59:18.695 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dio-buf-fault 2024-09-12T01:59:18.735 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] rewinddir-test 2024-09-12T01:59:18.768 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] readdir-while-renames 2024-09-12T01:59:18.817 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] xfsctl 2024-09-12T01:59:18.865 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] bstat 2024-09-12T01:59:18.915 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:18 smithi039 ceph-mon[31204]: pgmap v409: 97 pgs: 97 active+clean; 39 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 214 KiB/s wr, 90 op/s 2024-09-12T01:59:18.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:18 smithi044 ceph-mon[35259]: pgmap v409: 97 pgs: 97 active+clean; 39 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 214 KiB/s wr, 90 op/s 2024-09-12T01:59:18.939 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mtab 2024-09-12T01:59:18.954 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] getdevicesize 2024-09-12T01:59:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:18 smithi172 ceph-mon[35073]: pgmap v409: 97 pgs: 97 active+clean; 39 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 214 KiB/s wr, 90 op/s 2024-09-12T01:59:19.249 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] preallo_rw_pattern_reader 2024-09-12T01:59:19.257 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] preallo_rw_pattern_writer 2024-09-12T01:59:19.279 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] ftrunc 2024-09-12T01:59:19.342 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] trunc 2024-09-12T01:59:19.436 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fs_perms 2024-09-12T01:59:19.442 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] testx 2024-09-12T01:59:19.456 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] looptest 2024-09-12T01:59:19.542 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] locktest 2024-09-12T01:59:19.600 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] unwritten_mmap 2024-09-12T01:59:19.641 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] bulkstat_unlink_test 2024-09-12T01:59:19.685 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] deduperace 2024-09-12T01:59:19.786 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] bulkstat_unlink_test_modified 2024-09-12T01:59:19.849 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_dir_offset 2024-09-12T01:59:19.884 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_futimens 2024-09-12T01:59:19.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:19.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:19 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:19 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:19.939 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_immutable 2024-09-12T01:59:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:59:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:19 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.008 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] stale_handle 2024-09-12T01:59:20.011 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] pwrite_mmap_blocked 2024-09-12T01:59:20.046 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_dir_offset2 2024-09-12T01:59:20.166 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] seek_sanity_test 2024-09-12T01:59:20.183 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] seek_copy_test 2024-09-12T01:59:20.257 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_readdir_1 2024-09-12T01:59:20.379 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_readdir_2 2024-09-12T01:59:20.434 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fsync-tester 2024-09-12T01:59:20.558 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] nsexec 2024-09-12T01:59:20.641 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] cloner 2024-09-12T01:59:20.693 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] renameat2 2024-09-12T01:59:20.702 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_getcwd 2024-09-12T01:59:20.751 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] e4compact 2024-09-12T01:59:20.839 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] test-nextquota 2024-09-12T01:59:20.861 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] punch-alternating 2024-09-12T01:59:20.862 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-12T01:59:20.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:20 smithi039 ceph-mon[31204]: pgmap v410: 97 pgs: 97 active+clean; 36 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 127 op/s 2024-09-12T01:59:20.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:20.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:20.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:20 smithi044 ceph-mon[35259]: pgmap v410: 97 pgs: 97 active+clean; 36 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 127 op/s 2024-09-12T01:59:20.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:20.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:20.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:20.991 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] listxattr 2024-09-12T01:59:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:20 smithi172 ceph-mon[35073]: pgmap v410: 97 pgs: 97 active+clean; 36 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 320 KiB/s wr, 127 op/s 2024-09-12T01:59:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:59:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:59:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T01:59:21.015 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dio-interleaved 2024-09-12T01:59:21.030 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_dir_type 2024-09-12T01:59:21.054 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] dio-invalidate-cache 2024-09-12T01:59:21.141 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] stat_test 2024-09-12T01:59:21.187 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_encrypted_d_revalidate 2024-09-12T01:59:21.192 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] attr_replace_test 2024-09-12T01:59:21.285 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] swapon 2024-09-12T01:59:21.359 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] mkswap 2024-09-12T01:59:21.361 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_attr_corruption 2024-09-12T01:59:21.463 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_open_tmpfiles 2024-09-12T01:59:21.481 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fscrypt-crypt-util 2024-09-12T01:59:21.525 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] bulkstat_null_ocount 2024-09-12T01:59:21.528 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] splice-test 2024-09-12T01:59:21.658 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] chprojid_fail 2024-09-12T01:59:21.688 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] detached_mounts_propagation 2024-09-12T01:59:21.719 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] ext4_resize 2024-09-12T01:59:21.849 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_readdir_3 2024-09-12T01:59:21.892 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] splice2pipe 2024-09-12T01:59:21.908 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] uuid_ioctl 2024-09-12T01:59:22.081 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-12T01:59:22.090 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fiemap-fault 2024-09-12T01:59:22.091 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fiemap-tester 2024-09-12T01:59:22.250 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_stripealign 2024-09-12T01:59:22.258 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] open_by_handle 2024-09-12T01:59:22.262 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_mmap_dio 2024-09-12T01:59:22.395 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] xfsfind 2024-09-12T01:59:22.398 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] t_reflink_read_race 2024-09-12T01:59:22.438 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] fssum 2024-09-12T01:59:22.520 INFO:tasks.workunit.client.0.smithi039.stdout:Building log-writes 2024-09-12T01:59:22.526 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] replay-log 2024-09-12T01:59:22.593 INFO:tasks.workunit.client.0.smithi039.stdout:Building perf 2024-09-12T01:59:22.593 INFO:tasks.workunit.client.0.smithi039.stdout:Building aio-dio-regress 2024-09-12T01:59:22.596 INFO:tasks.workunit.client.0.smithi039.stdout:Building vfs 2024-09-12T01:59:22.601 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aiocp 2024-09-12T01:59:22.602 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] vfstest 2024-09-12T01:59:22.868 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-12T01:59:22.868 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-append-write-read-race 2024-09-12T01:59:22.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:22 smithi039 ceph-mon[31204]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 411 KiB/s wr, 137 op/s 2024-09-12T01:59:22.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:22 smithi044 ceph-mon[35259]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 411 KiB/s wr, 137 op/s 2024-09-12T01:59:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:22 smithi172 ceph-mon[35073]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 411 KiB/s wr, 137 op/s 2024-09-12T01:59:23.079 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-cow-race 2024-09-12T01:59:23.082 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-cycle-write 2024-09-12T01:59:23.082 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] mount-idmapped 2024-09-12T01:59:23.231 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-eof-race 2024-09-12T01:59:23.275 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-extend-stat 2024-09-12T01:59:23.411 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-fcntl-race 2024-09-12T01:59:23.435 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-hole-filling-race 2024-09-12T01:59:23.533 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-invalidate-failure 2024-09-12T01:59:23.588 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-invalidate-readahead 2024-09-12T01:59:23.591 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aiodio_sparse2 2024-09-12T01:59:23.708 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-subblock-eof-read 2024-09-12T01:59:23.782 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-dio-write-verify 2024-09-12T01:59:23.821 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-12T01:59:23.855 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-12T01:59:23.961 INFO:tasks.workunit.client.0.smithi039.stdout: [CC] aio-last-ref-held-by-io 2024-09-12T01:59:24.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:59:24.350 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:24.757 INFO:tasks.workunit.client.0.smithi039.stderr:+ cd .. 2024-09-12T01:59:24.757 INFO:tasks.workunit.client.0.smithi039.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-12T01:59:24.759 INFO:tasks.workunit.client.0.smithi039.stderr:+ OPTIONS=-z 2024-09-12T01:59:24.759 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-12T01:59:24.759 INFO:tasks.workunit.client.0.smithi039.stdout:Seed set to 1 2024-09-12T01:59:24.790 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T01:59:24.790 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T01:59:24.792 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T01:59:24.792 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T01:59:24.792 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T01:59:24.795 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T01:59:24.798 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T01:59:24.798 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero size read 2024-09-12T01:59:24.798 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero size read 2024-09-12T01:59:24.798 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x81d54 2024-09-12T01:59:24.803 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xb86d7 2024-09-12T01:59:24.810 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xe627e 2024-09-12T01:59:24.847 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0xf3194 2024-09-12T01:59:24.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:24 smithi039 ceph-mon[31204]: pgmap v412: 97 pgs: 97 active+clean; 40 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 685 KiB/s wr, 172 op/s 2024-09-12T01:59:24.868 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xf3ceb 2024-09-12T01:59:24.874 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0xf47e4 2024-09-12T01:59:24.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:24 smithi044 ceph-mon[35259]: pgmap v412: 97 pgs: 97 active+clean; 40 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 685 KiB/s wr, 172 op/s 2024-09-12T01:59:24.964 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xfaccc 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 -- 172.21.15.39:0/3784090255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd0010e430 msgr2=0x7fbd00110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 --2- 172.21.15.39:0/3784090255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd0010e430 0x7fbd00110820 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009ca0 tx=0x7fbcf802a950 comp rx=0 tx=0).stop 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 -- 172.21.15.39:0/3784090255 shutdown_connections 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 --2- 172.21.15.39:0/3784090255 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd0010e430 0x7fbd00110820 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 --2- 172.21.15.39:0/3784090255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 0x7fbd0010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 --2- 172.21.15.39:0/3784090255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd00074510 0x7fbd000748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 -- 172.21.15.39:0/3784090255 >> 172.21.15.39:0/3784090255 conn(0x7fbd000fd8b0 msgr2=0x7fbd000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 -- 172.21.15.39:0/3784090255 shutdown_connections 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.946+0000 7fbd04998640 1 -- 172.21.15.39:0/3784090255 wait complete. 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.947+0000 7fbd04998640 1 Processor -- start 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.947+0000 7fbd04998640 1 -- start start 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.947+0000 7fbd04998640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.947+0000 7fbd04998640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 0x7fbd0019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbd04998640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0010e430 0x7fbd0019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbd04998640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00114140 con 0x7fbd00074510 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbd04998640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00113fc0 con 0x7fbd0010e430 2024-09-12T01:59:24.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbd04998640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001142c0 con 0x7fbd00074e30 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41100/0 (socket says 172.21.15.39:41100) 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 -- 172.21.15.39:0/643209730 learned_addr learned my addr 172.21.15.39:0/643209730 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 0x7fbd0019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0010e430 0x7fbd0019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 -- 172.21.15.39:0/643209730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 msgr2=0x7fbd0019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 0x7fbd0019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 -- 172.21.15.39:0/643209730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0010e430 msgr2=0x7fbd0019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0010e430 0x7fbd0019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 -- 172.21.15.39:0/643209730 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0019f600 con 0x7fbd00074510 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9f0 tx=0x7fbcf000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcef7fe640 1 -- 172.21.15.39:0/643209730 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000cd80 con 0x7fbd00074510 2024-09-12T01:59:24.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0019f8f0 con 0x7fbd00074510 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcef7fe640 1 -- 172.21.15.39:0/643209730 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf0010910 con 0x7fbd00074510 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.948+0000 7fbcef7fe640 1 -- 172.21.15.39:0/643209730 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00188f0 con 0x7fbd00074510 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.949+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd001a71d0 con 0x7fbd00074510 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.951+0000 7fbcef7fe640 1 -- 172.21.15.39:0/643209730 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbcf0010ac0 con 0x7fbd00074510 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.951+0000 7fbd06d71740 1 Processor -- start 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 -- start start 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c06140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c08a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2b612e0 con 0x55d8d2c06680 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2b08ce0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbd06d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2b5d2a0 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c06140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34704/0 (socket says 172.21.15.39:34704) 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c08a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.952+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3368805966 learned_addr learned my addr 172.21.15.39:0/3368805966 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3368805966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 msgr2=0x55d8d2c06140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c06140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3368805966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 msgr2=0x55d8d2c08a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c08a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3368805966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8d2aed440 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c06140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcef7fe640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 0x7fbce80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd000754f0 tx=0x7fbcf80093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8af264b03576d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 0x7fbce80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcef7fe640 1 -- 172.21.15.39:0/643209730 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbcf00cf3f0 con 0x7fbd00074510 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcecff9640 1 -- 172.21.15.39:0/3368805966 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8048070 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcecff9640 1 -- 172.21.15.39:0/3368805966 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf802f940 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.953+0000 7fbcecff9640 1 -- 172.21.15.39:0/3368805966 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8034040 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 -- 172.21.15.39:0/3368805966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 msgr2=0x55d8d2bfb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd000754f0 tx=0x7fbcf80093e0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbcfe59c640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 0x7fbce80a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00cd270 tx=0x7fbcf00d2ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 -- 172.21.15.39:0/3368805966 shutdown_connections 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c08a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c06140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3368805966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2bfb880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.954+0000 7fbd06d71740 1 -- 172.21.15.39:0/3368805966 >> 172.21.15.39:0/3368805966 conn(0x55d8d2bf7a30 msgr2=0x55d8d2bf7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- 172.21.15.39:0/3368805966 shutdown_connections 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- 172.21.15.39:0/3368805966 wait complete. 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- start start 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 Processor -- start 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c06050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2c09250 con 0x55d8d2c06680 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2b1c050 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8d2c093d0 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.955+0000 7fbd06d71740 10 client.0 _ll_register_callbacks cb 0x55d8d2b5c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56774/0 (socket says 172.21.15.39:56774) 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/2185924303 learned_addr learned my addr 172.21.15.39:0/2185924303 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41124/0 (socket says 172.21.15.39:41124) 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c06050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/2185924303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 msgr2=0x55d8d2c06050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c06050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/2185924303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 msgr2=0x55d8d2c038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/2185924303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8d28d23c0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4012700 tx=0x7fbcf4012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dadd9850a929e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf400f8c0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.956+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbcf400fa60 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf802f940 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcf400fc60 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 10 client.25532 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d8d2c14d10 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf802f940 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbcf4010550 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 10 client.25532 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:24.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 20 client.25532 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c16270 0x55d8d2c18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 4 client.25532 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8d2b6e850 con 0x55d8d2c16270 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.957+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c16270 0x55d8d2c18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.958+0000 7fbce5ffb640 10 client.25532 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.958+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c16270 0x55d8d2c18680 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728108e220d9f506 server_cookie=e7b1a67e61909bdd in_seq=0 out_seq=0 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.958+0000 7fbce5ffb640 1 -- 172.21.15.39:0/2185924303 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8d2b6e850 con 0x55d8d2c16270 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.958+0000 7fbce5ffb640 10 client.25532 handle_command_reply: tid=0 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.958+0000 7fbd06d71740 1 client.25532 shutdown 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 msgr2=0x55d8d2c03300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4012700 tx=0x7fbcf4012bc0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 shutdown_connections 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c16270 0x55d8d2c18680 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c03300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 --2- 172.21.15.39:0/2185924303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c06050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbce5ffb640 0 client.25532 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 >> 172.21.15.39:0/2185924303 conn(0x55d8d2bf7a30 msgr2=0x55d8d2bf6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 shutdown_connections 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 1 -- 172.21.15.39:0/2185924303 wait complete. 2024-09-12T01:59:24.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.959+0000 7fbd06d71740 20 client.25532 trim_cache size 0 max 16384 2024-09-12T01:59:24.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.978+0000 7fbd06d71740 1 Processor -- start 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.978+0000 7fbd06d71740 1 -- start start 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.978+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.978+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c1e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbd06d71740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001b1fd0 con 0x55d8d2c06680 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbd06d71740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001af8a0 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbd06d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001ad6f0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34710/0 (socket says 172.21.15.39:34710) 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/4140753511 learned_addr learned my addr 172.21.15.39:0/4140753511 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c1e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/4140753511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 msgr2=0x55d8d2c124b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c124b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/4140753511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 msgr2=0x55d8d2c1e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c1e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 -- 172.21.15.39:0/4140753511 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8d2c063c0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009da0 tx=0x7fbcf400ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d63e7a73e8cf03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.979+0000 7fbce7fff640 1 -- 172.21.15.39:0/4140753511 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4010be0 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbce7fff640 1 -- 172.21.15.39:0/4140753511 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf4010d80 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbce7fff640 1 -- 172.21.15.39:0/4140753511 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4005650 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 -- 172.21.15.39:0/4140753511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 msgr2=0x55d8d2c1df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009da0 tx=0x7fbcf400ff90 comp rx=0 tx=0).stop 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 -- 172.21.15.39:0/4140753511 shutdown_connections 2024-09-12T01:59:24.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2c06680 0x55d8d2c1e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c1df50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 --2- 172.21.15.39:0/4140753511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 -- 172.21.15.39:0/4140753511 >> 172.21.15.39:0/4140753511 conn(0x55d8d2bf7a30 msgr2=0x55d8d2c023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.980+0000 7fbd06d71740 1 -- 172.21.15.39:0/4140753511 shutdown_connections 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 -- 172.21.15.39:0/4140753511 wait complete. 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 -- start start 2024-09-12T01:59:24.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 Processor -- start 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c09f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2c06680 0x55d8d2c0a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001add60 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001af1d0 con 0x55d8d2c06680 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001ae430 con 0x55d8d2bfbdc0 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbd06d71740 10 client.0 _ll_register_callbacks cb 0x7fbcf4009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbcfed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41144/0 (socket says 172.21.15.39:41144) 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3168161657 learned_addr learned my addr 172.21.15.39:0/3168161657 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.981+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2c06680 0x55d8d2c0a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3168161657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 msgr2=0x55d8d2c09f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c09f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2c06680 msgr2=0x55d8d2c0a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2c06680 0x55d8d2c0a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 -- 172.21.15.39:0/3168161657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8d2c0aab0 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c09f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbcfed9d640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8005cc0 tx=0x7fbcf8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea15047e6b63ca50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbce5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8048040 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbcf802fb50 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf4010d80 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcf8004040 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbd06d71740 10 client.15957 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.982+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d8d2c80da0 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf4010d80 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbcf8030740 con 0x55d8d2bfb4a0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 10 client.15957 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 20 client.15957 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c81090 0x55d8d2c83480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 4 client.15957 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8d2b68d60 con 0x55d8d2c81090 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.983+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c81090 0x55d8d2c83480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:24.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbce5ffb640 10 client.15957 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbcfdd9b640 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c81090 0x55d8d2c83480 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62e905c7d58dee5 server_cookie=f8e48b9c6585422d in_seq=0 out_seq=0 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbce5ffb640 1 -- 172.21.15.39:0/3168161657 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d8d2b68d60 con 0x55d8d2c81090 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbce5ffb640 10 client.15957 handle_command_reply: tid=0 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 client.15957 shutdown 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 msgr2=0x55d8d2c0ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8005cc0 tx=0x7fbcf8005c50 comp rx=0 tx=0).stop 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 shutdown_connections 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55d8d2c81090 0x55d8d2c83480 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8d2c06680 0x55d8d2c0a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8d2bfbdc0 0x55d8d2c09f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 --2- 172.21.15.39:0/3168161657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d8d2bfb4a0 0x55d8d2c0ebd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 >> 172.21.15.39:0/3168161657 conn(0x55d8d2bf7a30 msgr2=0x55d8d2bf6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbce5ffb640 0 client.15957 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.984+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 shutdown_connections 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd06d71740 1 -- 172.21.15.39:0/3168161657 wait complete. 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd06d71740 20 client.15957 trim_cache size 0 max 16384 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2024-09-12T01:59:24.991 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 msgr2=0x7fbce80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 0x7fbce80a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00cd270 tx=0x7fbcf00d2ed0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 msgr2=0x7fbd0019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9f0 tx=0x7fbcf000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 shutdown_connections 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0010e430 0x7fbd0019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.985+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fbce80a2b80 0x7fbce80a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.986+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00074e30 0x7fbd0019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.986+0000 7fbd04998640 1 --2- 172.21.15.39:0/643209730 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00074510 0x7fbd0019a650 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.986+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 >> 172.21.15.39:0/643209730 conn(0x7fbd000fd8b0 msgr2=0x7fbd000ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.986+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 shutdown_connections 2024-09-12T01:59:24.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:24.986+0000 7fbd04998640 1 -- 172.21.15.39:0/643209730 wait complete. 2024-09-12T01:59:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:24 smithi172 ceph-mon[35073]: pgmap v412: 97 pgs: 97 active+clean; 40 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 685 KiB/s wr, 172 op/s 2024-09-12T01:59:25.311 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xfe423 2024-09-12T01:59:25.835 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:59:25.836 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:59:26.144 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 -- 172.21.15.39:0/876115296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4628102d30 msgr2=0x7f4628103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 --2- 172.21.15.39:0/876115296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4628102d30 0x7f4628103110 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4624009930 tx=0x7f462402a420 comp rx=0 tx=0).stop 2024-09-12T01:59:26.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 -- 172.21.15.39:0/876115296 shutdown_connections 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 --2- 172.21.15.39:0/876115296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46281082a0 0x7f462810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 --2- 172.21.15.39:0/876115296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281036e0 0x7f4628107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 --2- 172.21.15.39:0/876115296 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4628102d30 0x7f4628103110 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 -- 172.21.15.39:0/876115296 >> 172.21.15.39:0/876115296 conn(0x7f46280fc7d0 msgr2=0x7f46280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 -- 172.21.15.39:0/876115296 shutdown_connections 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.664+0000 7f46301e0640 1 -- 172.21.15.39:0/876115296 wait complete. 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 Processor -- start 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 -- start start 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46281036e0 0x7f4628198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 0x7f462819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:26.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f46281120e0 con 0x7f46281036e0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111f60 con 0x7f4628102d30 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f46301e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4628112260 con 0x7f46281082a0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462df7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462df7c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56814/0 (socket says 172.21.15.39:56814) 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 0x7f462819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462df7c640 1 -- 172.21.15.39:0/4252973208 learned_addr learned my addr 172.21.15.39:0/4252973208 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462d77b640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46281036e0 0x7f4628198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 -- 172.21.15.39:0/4252973208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 msgr2=0x7f46281985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 -- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46281036e0 msgr2=0x7f4628198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46281036e0 0x7f4628198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462e77d640 1 -- 172.21.15.39:0/4252973208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462819d550 con 0x7f46281082a0 2024-09-12T01:59:26.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.665+0000 7f462df7c640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f462e77d640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 0x7f462819ce70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f462000ec50 tx=0x7f462000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620003b70 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462819d840 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4620003d10 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620010890 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.666+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281a5120 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.667+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462806a850 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.668+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4620003fc0 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.669+0000 7f461effd640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 0x7f46140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.669+0000 7f462df7c640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 0x7f46140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.669+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f46200cf570 con 0x7f46281082a0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.670+0000 7f462df7c640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 0x7f46140a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f4624031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:26.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.674+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f462009c4e0 con 0x7f46281082a0 2024-09-12T01:59:26.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:26 smithi039 ceph-mon[31204]: pgmap v413: 97 pgs: 97 active+clean; 42 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 908 KiB/s wr, 187 op/s 2024-09-12T01:59:26.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.917+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f462810a2b0 con 0x7f46281082a0 2024-09-12T01:59:26.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.918+0000 7f461effd640 1 -- 172.21.15.39:0/4252973208 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11911 (secure 0 0 0) 0x7f462009bde0 con 0x7f46281082a0 2024-09-12T01:59:26.919 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:59:26.919 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-12T01:58:43:389902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:58:42.815744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:59:26.919 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-12T01:59:26.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 msgr2=0x7f46140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 0x7f46140a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f4624031510 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 msgr2=0x7f462819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 0x7f462819ce70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f462000ec50 tx=0x7f462000c6a0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 shutdown_connections 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f46140a2b80 0x7f46140a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46281082a0 0x7f462819ce70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f46281036e0 0x7f4628198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 --2- 172.21.15.39:0/4252973208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628102d30 0x7f46281985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.920+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 >> 172.21.15.39:0/4252973208 conn(0x7f46280fc7d0 msgr2=0x7f4628106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.921+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 shutdown_connections 2024-09-12T01:59:26.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:26.921+0000 7f46301e0640 1 -- 172.21.15.39:0/4252973208 wait complete. 2024-09-12T01:59:26.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:26 smithi044 ceph-mon[35259]: pgmap v413: 97 pgs: 97 active+clean; 42 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 908 KiB/s wr, 187 op/s 2024-09-12T01:59:27.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:26 smithi172 ceph-mon[35073]: pgmap v413: 97 pgs: 97 active+clean; 42 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 908 KiB/s wr, 187 op/s 2024-09-12T01:59:27.359 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xfe492 2024-09-12T01:59:27.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:59:27.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:27 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/4252973208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:27.921 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:27.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:27 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/4252973208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:27 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/4252973208' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 -- 172.21.15.39:0/460062101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381001d0 msgr2=0x7fad381005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/460062101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381001d0 0x7fad381005d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fad28009860 tx=0x7fad2802a340 comp rx=0 tx=0).stop 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 -- 172.21.15.39:0/460062101 shutdown_connections 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/460062101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad38101d80 0x7fad38108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/460062101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad381013c0 0x7fad38101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/460062101 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381001d0 0x7fad381005d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.044 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 -- 172.21.15.39:0/460062101 >> 172.21.15.39:0/460062101 conn(0x7fad380fb930 msgr2=0x7fad380fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 -- 172.21.15.39:0/460062101 shutdown_connections 2024-09-12T01:59:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.043+0000 7fad3e8a5640 1 -- 172.21.15.39:0/460062101 wait complete. 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 Processor -- start 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 -- start start 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 0x7fad3819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810b600 con 0x7fad381013c0 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810b480 con 0x7fad38101d80 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3e8a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810b780 con 0x7fad381001d0 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41188/0 (socket says 172.21.15.39:41188) 2024-09-12T01:59:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3ce42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 0x7fad3819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34756/0 (socket says 172.21.15.39:34756) 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad2ffff640 1 -- 172.21.15.39:0/3268893136 learned_addr learned my addr 172.21.15.39:0/3268893136 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 -- 172.21.15.39:0/3268893136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 msgr2=0x7fad3819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 0x7fad3819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 -- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 msgr2=0x7fad38196120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad37fff640 1 -- 172.21.15.39:0/3268893136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3819d800 con 0x7fad381001d0 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad3ce42640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 0x7fad3819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.044+0000 7fad2ffff640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad37fff640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad28035040 tx=0x7fad28033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad35ffb640 1 -- 172.21.15.39:0/3268893136 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28037040 con 0x7fad381001d0 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3819da90 con 0x7fad381001d0 2024-09-12T01:59:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad35ffb640 1 -- 172.21.15.39:0/3268893136 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad28004040 con 0x7fad381001d0 2024-09-12T01:59:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad35ffb640 1 -- 172.21.15.39:0/3268893136 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad280055c0 con 0x7fad381001d0 2024-09-12T01:59:28.049 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.045+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3819df80 con 0x7fad381001d0 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad35ffb640 1 -- 172.21.15.39:0/3268893136 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fad28042020 con 0x7fad381001d0 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 Processor -- start 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 -- start start 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e74da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e77830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561249dd32f0 con 0x561249e702e0 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561249d7b270 con 0x561249e75370 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad41643740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561249dcf2b0 con 0x561249e6f9a0 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad3ce42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e77830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad3ce42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34768/0 (socket says 172.21.15.39:34768) 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad3ce42640 1 -- 172.21.15.39:0/2900346113 learned_addr learned my addr 172.21.15.39:0/2900346113 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.048+0000 7fad37fff640 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e74da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad35ffb640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 0x7fad240a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 -- 172.21.15.39:0/2900346113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 msgr2=0x561249e77830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e77830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 -- 172.21.15.39:0/2900346113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 msgr2=0x561249e74da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e74da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 -- 172.21.15.39:0/2900346113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561249d7a340 con 0x561249e6f9a0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad37fff640 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e74da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad35ffb640 1 -- 172.21.15.39:0/3268893136 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fad280ee900 con 0x7fad381001d0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad3000e8a0 tx=0x7fad3000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbd40f026f13cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad3ce42640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 0x7fad240a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad2e7fc640 1 -- 172.21.15.39:0/2900346113 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3001e070 con 0x561249e6f9a0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad2e7fc640 1 -- 172.21.15.39:0/2900346113 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad30003e50 con 0x561249e6f9a0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.049+0000 7fad2e7fc640 1 -- 172.21.15.39:0/2900346113 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30018430 con 0x561249e6f9a0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 -- 172.21.15.39:0/2900346113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 msgr2=0x561249e6fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad3000e8a0 tx=0x7fad3000ed60 comp rx=0 tx=0).stop 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad3ce42640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 0x7fad240a7300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad3000dfd0 tx=0x7fad30018aa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 -- 172.21.15.39:0/2900346113 shutdown_connections 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e77830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e74da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 --2- 172.21.15.39:0/2900346113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e6fda0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 -- 172.21.15.39:0/2900346113 >> 172.21.15.39:0/2900346113 conn(0x561249e6b010 msgr2=0x561249e6b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 -- 172.21.15.39:0/2900346113 shutdown_connections 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.050+0000 7fad41643740 1 -- 172.21.15.39:0/2900346113 wait complete. 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 -- start start 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 Processor -- start 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 0x561249e7a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e75370 0x561249e81050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x561249e78340 con 0x561249e6f9a0 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561249d5c290 con 0x561249e702e0 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561249e784c0 con 0x561249e75370 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad41643740 10 client.0 _ll_register_callbacks cb 0x561249d8d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41208/0 (socket says 172.21.15.39:41208) 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 0x561249e7a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad37fff640 1 -- 172.21.15.39:0/1983547500 learned_addr learned my addr 172.21.15.39:0/1983547500 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.051+0000 7fad3ce42640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e75370 0x561249e81050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 -- 172.21.15.39:0/1983547500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e75370 msgr2=0x561249e81050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e75370 0x561249e81050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 -- 172.21.15.39:0/1983547500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 msgr2=0x561249e79ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 -- 172.21.15.39:0/1983547500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561249ae6210 con 0x561249e702e0 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad37fff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 0x561249e7a010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad381970f0 tx=0x7fad2000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3283511dd0406 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20004050 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fad200041f0 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad30003e50 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad200043f0 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad41643740 10 client.25556 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.052+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561249bb2620 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad30003e50 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fad200105c0 con 0x561249e702e0 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 10 client.25556 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 10 client.25556 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 20 client.25556 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249e858c0 0x561249e87cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 4 client.25556 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561249de0a20 con 0x561249e858c0 2024-09-12T01:59:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad37fff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249e858c0 0x561249e87cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad177fe640 10 client.25556 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.053+0000 7fad37fff640 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249e858c0 0x561249e87cb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46b3359a243c9ba2 server_cookie=5469c3e305d125cd in_seq=0 out_seq=0 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad177fe640 1 -- 172.21.15.39:0/1983547500 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561249de0a20 con 0x561249e858c0 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad177fe640 10 client.25556 handle_command_reply: tid=0 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 client.25556 shutdown 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 msgr2=0x561249e7a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 0x561249e7a010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad381970f0 tx=0x7fad2000f790 comp rx=0 tx=0).stop 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 shutdown_connections 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249e858c0 0x561249e87cb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e75370 0x561249e81050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad177fe640 0 client.25556 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:28.061 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e702e0 0x561249e7a010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 --2- 172.21.15.39:0/1983547500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e79ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 >> 172.21.15.39:0/1983547500 conn(0x561249e6b010 msgr2=0x561249e6c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 shutdown_connections 2024-09-12T01:59:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.054+0000 7fad41643740 1 -- 172.21.15.39:0/1983547500 wait complete. 2024-09-12T01:59:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.055+0000 7fad41643740 20 client.25556 trim_cache size 0 max 16384 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 Processor -- start 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 -- start start 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 0x561249e81010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a95b0 con 0x561249e6f9a0 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a6e80 con 0x561249e75370 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad41643740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a4cd0 con 0x561249e702e0 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.073 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 0x561249e81010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41212/0 (socket says 172.21.15.39:41212) 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad37fff640 1 -- 172.21.15.39:0/677406594 learned_addr learned my addr 172.21.15.39:0/677406594 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad3ce42640 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 -- 172.21.15.39:0/677406594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 msgr2=0x561249e6c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e6c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 -- 172.21.15.39:0/677406594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 msgr2=0x561249e6a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad2ffff640 1 -- 172.21.15.39:0/677406594 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561249e79610 con 0x561249e702e0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.071+0000 7fad37fff640 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad2ffff640 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 0x561249e81010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad200058c0 tx=0x7fad20009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=613b0d23d2cca2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad2dffb640 1 -- 172.21.15.39:0/677406594 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20034070 con 0x561249e702e0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad2dffb640 1 -- 172.21.15.39:0/677406594 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20004000 con 0x561249e702e0 2024-09-12T01:59:28.074 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad2dffb640 1 -- 172.21.15.39:0/677406594 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2002c070 con 0x561249e702e0 2024-09-12T01:59:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad41643740 1 -- 172.21.15.39:0/677406594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 msgr2=0x561249e81010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.072+0000 7fad41643740 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 0x561249e81010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad200058c0 tx=0x7fad20009f80 comp rx=0 tx=0).stop 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- 172.21.15.39:0/677406594 shutdown_connections 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e6c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e702e0 0x561249e81010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- 172.21.15.39:0/677406594 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e6f9a0 0x561249e6a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- 172.21.15.39:0/677406594 >> 172.21.15.39:0/677406594 conn(0x561249e6b010 msgr2=0x561249e699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- 172.21.15.39:0/677406594 shutdown_connections 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- 172.21.15.39:0/677406594 wait complete. 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- start start 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 Processor -- start 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e7e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e7fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a5340 con 0x561249e702e0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a67b0 con 0x561249e75370 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a5a10 con 0x561249e6f9a0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.073+0000 7fad41643740 10 client.0 _ll_register_callbacks cb 0x7fad20012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41220/0 (socket says 172.21.15.39:41220) 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 -- 172.21.15.39:0/1341387985 learned_addr learned my addr 172.21.15.39:0/1341387985 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad37fff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e7e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad3ce42640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e7fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 -- 172.21.15.39:0/1341387985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 msgr2=0x561249e7e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e7e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 -- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 msgr2=0x561249e7fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e7fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 -- 172.21.15.39:0/1341387985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561249e80250 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad37fff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e7e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad2ffff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fad2000a010 tx=0x7fad20010a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb82c17f3cd34cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad177fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2002c040 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fad20003b40 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.074+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad20004000 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.075+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fad20003d40 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.075+0000 7fad41643740 10 client.15981 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.075+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561249ef0550 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.075+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20004000 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.075+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fad20004820 con 0x561249e702e0 2024-09-12T01:59:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 10 client.15981 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 20 client.15981 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249ef0e70 0x561249ef3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 4 client.15981 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561249ddad70 con 0x561249ef0e70 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad37fff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249ef0e70 0x561249ef3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad177fe640 10 client.15981 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.076+0000 7fad37fff640 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249ef0e70 0x561249ef3290 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4c18a3449ae9ddf server_cookie=5c05d3c1950eee5 in_seq=0 out_seq=0 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad177fe640 1 -- 172.21.15.39:0/1341387985 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561249ddad70 con 0x561249ef0e70 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad177fe640 10 client.15981 handle_command_reply: tid=0 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 client.15981 shutdown 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 msgr2=0x561249e7ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fad2000a010 tx=0x7fad20010a90 comp rx=0 tx=0).stop 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 shutdown_connections 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x561249ef0e70 0x561249ef3290 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad177fe640 0 client.15981 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561249e75370 0x561249e7fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x561249e702e0 0x561249e7ec30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.129+0000 7fad41643740 1 --2- 172.21.15.39:0/1341387985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561249e6f9a0 0x561249e7e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 >> 172.21.15.39:0/1341387985 conn(0x561249e6b010 msgr2=0x561249e6a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 shutdown_connections 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad41643740 1 -- 172.21.15.39:0/1341387985 wait complete. 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad41643740 20 client.15981 trim_cache size 0 max 16384 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:59:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:59:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 msgr2=0x7fad240a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 0x7fad240a7300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad3000dfd0 tx=0x7fad30018aa0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 msgr2=0x7fad38195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.130+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad28035040 tx=0x7fad28033d90 comp rx=0 tx=0).stop 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 shutdown_connections 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad38101d80 0x7fad3819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad381013c0 0x7fad38196120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fad240a4e40 0x7fad240a7300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 --2- 172.21.15.39:0/3268893136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad381001d0 0x7fad38195be0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 >> 172.21.15.39:0/3268893136 conn(0x7fad380fb930 msgr2=0x7fad381046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 shutdown_connections 2024-09-12T01:59:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:28.131+0000 7fad3e8a5640 1 -- 172.21.15.39:0/3268893136 wait complete. 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.461+0000 7f40f0396640 1 -- 172.21.15.39:0/1082861637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 msgr2=0x7f40e8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.461+0000 7f40f0396640 1 --2- 172.21.15.39:0/1082861637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e8103110 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009930 tx=0x7f40e402a420 comp rx=0 tx=0).stop 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 -- 172.21.15.39:0/1082861637 shutdown_connections 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 --2- 172.21.15.39:0/1082861637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81082a0 0x7f40e810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 --2- 172.21.15.39:0/1082861637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81036e0 0x7f40e8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 --2- 172.21.15.39:0/1082861637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e8103110 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 -- 172.21.15.39:0/1082861637 >> 172.21.15.39:0/1082861637 conn(0x7f40e80fc7d0 msgr2=0x7f40e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 -- 172.21.15.39:0/1082861637 shutdown_connections 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 -- 172.21.15.39:0/1082861637 wait complete. 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 Processor -- start 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.462+0000 7f40f0396640 1 -- start start 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 0x7f40e8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 0x7f40e819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81120a0 con 0x7f40e8102d30 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8111f20 con 0x7f40e81036e0 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40f0396640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8112220 con 0x7f40e81082a0 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41232/0 (socket says 172.21.15.39:41232) 2024-09-12T01:59:28.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 -- 172.21.15.39:0/3402460607 learned_addr learned my addr 172.21.15.39:0/3402460607 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ed931640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 0x7f40e8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee933640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 0x7f40e819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 -- 172.21.15.39:0/3402460607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 msgr2=0x7f40e819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 0x7f40e819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 -- 172.21.15.39:0/3402460607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 msgr2=0x7f40e8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 0x7f40e8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 -- 172.21.15.39:0/3402460607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e819d550 con 0x7f40e8102d30 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee933640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 0x7f40e819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ed931640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 0x7f40e8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40ee132640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009230 tx=0x7f40e4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.463+0000 7f40df7fe640 1 -- 172.21.15.39:0/3402460607 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e403f030 con 0x7f40e8102d30 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.464+0000 7f40df7fe640 1 -- 172.21.15.39:0/3402460607 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4004440 con 0x7f40e8102d30 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.464+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e819d7e0 con 0x7f40e8102d30 2024-09-12T01:59:28.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.464+0000 7f40df7fe640 1 -- 172.21.15.39:0/3402460607 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4035070 con 0x7f40e8102d30 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.464+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e81a5120 con 0x7f40e8102d30 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.466+0000 7f40df7fe640 1 -- 172.21.15.39:0/3402460607 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f40e4042030 con 0x7f40e8102d30 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.466+0000 7f40f276f740 1 Processor -- start 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.466+0000 7f40f276f740 1 -- start start 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f880a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f88d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f7e62f0 con 0x55cd5f88b370 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f78dcf0 con 0x55cd5f8805d0 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40f276f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f7e22b0 con 0x55cd5f881b40 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f880a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee933640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ed931640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f88d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee933640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34834/0 (socket says 172.21.15.39:34834) 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee933640 1 -- 172.21.15.39:0/2168218560 learned_addr learned my addr 172.21.15.39:0/2168218560 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40df7fe640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 0x7f40d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 -- 172.21.15.39:0/2168218560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 msgr2=0x55cd5f880090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 -- 172.21.15.39:0/2168218560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 msgr2=0x55cd5f88d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f88d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee132640 1 -- 172.21.15.39:0/2168218560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5f7723a0 con 0x55cd5f8805d0 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.467+0000 7f40ee933640 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40ee933640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 0x7f40d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40df7fe640 1 -- 172.21.15.39:0/3402460607 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f40e40ef400 con 0x7f40e8102d30 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40ee132640 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f880a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40e40ecee0 tx=0x7f40e408dc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b86a70a7c67587b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40dcdea640 1 -- 172.21.15.39:0/2168218560 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4049070 con 0x55cd5f8805d0 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40dcdea640 1 -- 172.21.15.39:0/2168218560 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e40bc370 con 0x55cd5f8805d0 2024-09-12T01:59:28.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.468+0000 7f40dcdea640 1 -- 172.21.15.39:0/2168218560 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e408f230 con 0x55cd5f8805d0 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- 172.21.15.39:0/2168218560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 msgr2=0x55cd5f880a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40ee933640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 0x7f40d40a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005c40 tx=0x7f40e0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f880a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40e40ecee0 tx=0x7f40e408dc80 comp rx=0 tx=0).stop 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- 172.21.15.39:0/2168218560 shutdown_connections 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f88d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f880a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 --2- 172.21.15.39:0/2168218560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f880090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- 172.21.15.39:0/2168218560 >> 172.21.15.39:0/2168218560 conn(0x55cd5f849310 msgr2=0x55cd5f87cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- 172.21.15.39:0/2168218560 shutdown_connections 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- 172.21.15.39:0/2168218560 wait complete. 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 -- start start 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.469+0000 7f40f276f740 1 Processor -- start 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f888530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f88de30 con 0x55cd5f8805d0 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f7a1060 con 0x55cd5f88b370 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f88dfb0 con 0x55cd5f881b40 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40f276f740 10 client.0 _ll_register_callbacks cb 0x55cd5f4f48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ed931640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41252/0 (socket says 172.21.15.39:41252) 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 -- 172.21.15.39:0/2280622840 learned_addr learned my addr 172.21.15.39:0/2280622840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ed931640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34836/0 (socket says 172.21.15.39:34836) 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee933640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f888530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 -- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 msgr2=0x55cd5f887fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 -- 172.21.15.39:0/2280622840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 msgr2=0x55cd5f888530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f888530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ee132640 1 -- 172.21.15.39:0/2280622840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5f5573c0 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.470+0000 7f40ed931640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40ee132640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f40e40bbc00 tx=0x7f40e403b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a961b779faf4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4049040 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f40e40b9f70 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40e40bc370 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40e40bb5d0 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40f276f740 10 client.15993 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd5f88de30 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.471+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e40bc370 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f40e40b82e0 con 0x55cd5f8805d0 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 10 client.15993 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:28.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 10 client.15993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 20 client.15993 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f89ee90 0x55cd5f8a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 4 client.15993 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd5f7f3860 con 0x55cd5f89ee90 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40ed931640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f89ee90 0x55cd5f8a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40ed931640 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f89ee90 0x55cd5f8a12b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c8d8e3db0b536dd server_cookie=95f0809369530a7b in_seq=0 out_seq=0 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.472+0000 7f40d1ffb640 10 client.15993 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.473+0000 7f40d1ffb640 1 -- 172.21.15.39:0/2280622840 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd5f7f3860 con 0x55cd5f89ee90 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40d1ffb640 10 client.15993 handle_command_reply: tid=0 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 client.15993 shutdown 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 msgr2=0x55cd5f88ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f40e40bbc00 tx=0x7f40e403b560 comp rx=0 tx=0).stop 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 shutdown_connections 2024-09-12T01:59:28.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f89ee90 0x55cd5f8a12b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f888530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f887fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 --2- 172.21.15.39:0/2280622840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f8805d0 0x55cd5f88ad00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40d1ffb640 0 client.15993 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 >> 172.21.15.39:0/2280622840 conn(0x55cd5f849310 msgr2=0x55cd5f882960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 shutdown_connections 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 1 -- 172.21.15.39:0/2280622840 wait complete. 2024-09-12T01:59:28.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.474+0000 7f40f276f740 20 client.15993 trim_cache size 0 max 16384 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.487+0000 7f40f276f740 1 Processor -- start 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.487+0000 7f40f276f740 1 -- start start 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f887f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f8a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f8a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81adcc0 con 0x55cd5f88b370 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81ab590 con 0x55cd5f8805d0 2024-09-12T01:59:28.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40f276f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81a93e0 con 0x55cd5f881b40 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ee933640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f8a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f8a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ee933640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f8a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41264/0 (socket says 172.21.15.39:41264) 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ee933640 1 -- 172.21.15.39:0/3290207274 learned_addr learned my addr 172.21.15.39:0/3290207274 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ee132640 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f887f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 -- 172.21.15.39:0/3290207274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 msgr2=0x55cd5f887f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f887f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 -- 172.21.15.39:0/3290207274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 msgr2=0x55cd5f8a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f8a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 -- 172.21.15.39:0/3290207274 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5f886f60 con 0x55cd5f881b40 2024-09-12T01:59:28.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.488+0000 7f40ed931640 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f8a6b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55cd5f887840 tx=0x7f40d8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6fd85f8a0ebe15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40d3fff640 1 -- 172.21.15.39:0/3290207274 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8012110 con 0x55cd5f881b40 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40d3fff640 1 -- 172.21.15.39:0/3290207274 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d8005020 con 0x55cd5f881b40 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40d3fff640 1 -- 172.21.15.39:0/3290207274 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80122b0 con 0x55cd5f881b40 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 -- 172.21.15.39:0/3290207274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 msgr2=0x55cd5f8a6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f8a6b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55cd5f887840 tx=0x7f40d8005f90 comp rx=0 tx=0).stop 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 -- 172.21.15.39:0/3290207274 shutdown_connections 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f88b370 0x55cd5f8a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f881b40 0x55cd5f8a6b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 --2- 172.21.15.39:0/3290207274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f8805d0 0x55cd5f887f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.489+0000 7f40f276f740 1 -- 172.21.15.39:0/3290207274 >> 172.21.15.39:0/3290207274 conn(0x55cd5f849310 msgr2=0x55cd5f887870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- 172.21.15.39:0/3290207274 shutdown_connections 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- 172.21.15.39:0/3290207274 wait complete. 2024-09-12T01:59:28.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- start start 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 Processor -- start 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f881b40 0x55cd5f88ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f88f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81a9a50 con 0x55cd5f881b40 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81aaec0 con 0x55cd5f88b370 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.490+0000 7f40f276f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81aa120 con 0x55cd5f8805d0 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40f276f740 10 client.0 _ll_register_callbacks cb 0x7f40d8009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ed931640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f881b40 0x55cd5f88ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee933640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f88f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34858/0 (socket says 172.21.15.39:34858) 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 -- 172.21.15.39:0/1821068988 learned_addr learned my addr 172.21.15.39:0/1821068988 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 -- 172.21.15.39:0/1821068988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 msgr2=0x55cd5f88f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f88f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 -- 172.21.15.39:0/1821068988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f881b40 msgr2=0x55cd5f88ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f881b40 0x55cd5f88ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 -- 172.21.15.39:0/1821068988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5f88fa10 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40ee132640 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40e40cffc0 tx=0x7f40e4005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de215d15c84a9eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4049040 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f40e40c4450 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.491+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d8005020 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40e40a1050 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 10 client.25441 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd5f88fa10 con 0x55cd5f8805d0 2024-09-12T01:59:28.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d8005020 con 0x55cd5f8805d0 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f40e40bbed0 con 0x55cd5f8805d0 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 10 client.25441 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 10 client.25441 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 20 client.25441 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f909e80 0x55cd5f90c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 4 client.25441 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:59:28.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd5f7edd70 con 0x55cd5f909e80 2024-09-12T01:59:28.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.492+0000 7f40ed931640 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f909e80 0x55cd5f90c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:28.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40ed931640 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f909e80 0x55cd5f90c270 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a77e404f8569fe7a server_cookie=ec7efcbad80c83c7 in_seq=0 out_seq=0 2024-09-12T01:59:28.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40d1ffb640 10 client.25441 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T01:59:28.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40d1ffb640 1 -- 172.21.15.39:0/1821068988 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd5f7edd70 con 0x55cd5f909e80 2024-09-12T01:59:28.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40d1ffb640 10 client.25441 handle_command_reply: tid=0 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 client.25441 shutdown 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 msgr2=0x55cd5f893950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f40e40cffc0 tx=0x7f40e4005bc0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 shutdown_connections 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55cd5f909e80 0x55cd5f90c270 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cd5f88b370 0x55cd5f88f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55cd5f881b40 0x55cd5f88ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 --2- 172.21.15.39:0/1821068988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd5f8805d0 0x55cd5f893950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40d1ffb640 0 client.25441 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 >> 172.21.15.39:0/1821068988 conn(0x55cd5f849310 msgr2=0x55cd5f87b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 shutdown_connections 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 1 -- 172.21.15.39:0/1821068988 wait complete. 2024-09-12T01:59:28.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.493+0000 7f40f276f740 20 client.25441 trim_cache size 0 max 16384 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 msgr2=0x7f40d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 0x7f40d40a5040 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005c40 tx=0x7f40e0004a40 comp rx=0 tx=0).stop 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 msgr2=0x7f40e81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009230 tx=0x7f40e4004040 comp rx=0 tx=0).stop 2024-09-12T01:59:28.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 shutdown_connections 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40d40a2b80 0x7f40d40a5040 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40e81082a0 0x7f40e819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e81036e0 0x7f40e8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 --2- 172.21.15.39:0/3402460607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40e8102d30 0x7f40e81985a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 >> 172.21.15.39:0/3402460607 conn(0x7f40e80fc7d0 msgr2=0x7f40e8105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 shutdown_connections 2024-09-12T01:59:28.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:28.494+0000 7f40f0396640 1 -- 172.21.15.39:0/3402460607 wait complete. 2024-09-12T01:59:28.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:28 smithi044 ceph-mon[35259]: pgmap v414: 97 pgs: 97 active+clean; 41 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 746 KiB/s wr, 173 op/s 2024-09-12T01:59:29.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:28 smithi172 ceph-mon[35073]: pgmap v414: 97 pgs: 97 active+clean; 41 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 746 KiB/s wr, 173 op/s 2024-09-12T01:59:29.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:28 smithi039 ceph-mon[31204]: pgmap v414: 97 pgs: 97 active+clean; 41 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 746 KiB/s wr, 173 op/s 2024-09-12T01:59:29.134 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xff038 2024-09-12T01:59:29.313 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:59:29.600 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:29.897 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0xffcac 2024-09-12T01:59:30.039 INFO:tasks.workunit.client.0.smithi039.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 -- 172.21.15.39:0/2430891470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028108290 msgr2=0x7f402810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 --2- 172.21.15.39:0/2430891470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028108290 0x7f402810ec30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4020009cd0 tx=0x7f402002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 -- 172.21.15.39:0/2430891470 shutdown_connections 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 --2- 172.21.15.39:0/2430891470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028108290 0x7f402810ec30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 --2- 172.21.15.39:0/2430891470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028103740 0x7f4028107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 --2- 172.21.15.39:0/2430891470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028102d90 0x7f4028103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 -- 172.21.15.39:0/2430891470 >> 172.21.15.39:0/2430891470 conn(0x7f40280fc7d0 msgr2=0x7f40280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.153+0000 7f4030092640 1 -- 172.21.15.39:0/2430891470 shutdown_connections 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.154+0000 7f4030092640 1 -- 172.21.15.39:0/2430891470 wait complete. 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.154+0000 7f4030092640 1 Processor -- start 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.154+0000 7f4030092640 1 -- start start 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 0x7f40281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028103740 0x7f40281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40281120a0 con 0x7f4028102d90 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4028111f20 con 0x7f4028103740 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f4030092640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4028112220 con 0x7f4028108290 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402de2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 0x7f40281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402d62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028103740 0x7f40281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34878/0 (socket says 172.21.15.39:34878) 2024-09-12T01:59:30.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 -- 172.21.15.39:0/737111056 learned_addr learned my addr 172.21.15.39:0/737111056 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 -- 172.21.15.39:0/737111056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028103740 msgr2=0x7f40281989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028103740 0x7f40281989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 -- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 msgr2=0x7f40281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 0x7f40281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402e62f640 1 -- 172.21.15.39:0/737111056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402819d450 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.155+0000 7f402de2e640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 0x7f40281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f402e62f640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4020033040 tx=0x7f4020031e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f401effd640 1 -- 172.21.15.39:0/737111056 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402004c070 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402819d6e0 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f401effd640 1 -- 172.21.15.39:0/737111056 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f402003c720 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4028100920 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.156+0000 7f401effd640 1 -- 172.21.15.39:0/737111056 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020004380 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.159+0000 7f401effd640 1 -- 172.21.15.39:0/737111056 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f402003c8d0 con 0x7f4028108290 2024-09-12T01:59:30.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.159+0000 7f403246b740 1 Processor -- start 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.159+0000 7f403246b740 1 -- start start 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b662a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b66d370 0x55ab5b66f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b5c82f0 con 0x55ab5b6625d0 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b56fcf0 con 0x55ab5b663b40 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f403246b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b5c42b0 con 0x55ab5b66d370 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56952/0 (socket says 172.21.15.39:56952) 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 -- 172.21.15.39:0/1860995076 learned_addr learned my addr 172.21.15.39:0/1860995076 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:30.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402de2e640 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b662a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b66d370 0x55ab5b66f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f401effd640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 0x7f40140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402e62f640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 0x7f40140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 -- 172.21.15.39:0/1860995076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b66d370 msgr2=0x55ab5b66f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b66d370 0x55ab5b66f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 -- 172.21.15.39:0/1860995076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 msgr2=0x55ab5b662a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b662a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f402d62d640 1 -- 172.21.15.39:0/1860995076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab5b5543a0 con 0x55ab5b663b40 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.160+0000 7f401effd640 1 -- 172.21.15.39:0/737111056 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f402002e020 con 0x7f4028108290 2024-09-12T01:59:30.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.161+0000 7f402d62d640 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4018011700 tx=0x7f401800a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799172f611e0e20d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.161+0000 7f4013fff640 1 -- 172.21.15.39:0/1860995076 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018005020 con 0x55ab5b663b40 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.161+0000 7f402e62f640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 0x7f40140a50c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40200c83f0 tx=0x7f402002d740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.161+0000 7f4013fff640 1 -- 172.21.15.39:0/1860995076 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40180047a0 con 0x55ab5b663b40 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.161+0000 7f4013fff640 1 -- 172.21.15.39:0/1860995076 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800fa20 con 0x55ab5b663b40 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- 172.21.15.39:0/1860995076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 msgr2=0x55ab5b662090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4018011700 tx=0x7f401800a6a0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- 172.21.15.39:0/1860995076 shutdown_connections 2024-09-12T01:59:30.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b66d370 0x55ab5b66f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b662a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 --2- 172.21.15.39:0/1860995076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b662090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- 172.21.15.39:0/1860995076 >> 172.21.15.39:0/1860995076 conn(0x55ab5b62b310 msgr2=0x55ab5b65ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- 172.21.15.39:0/1860995076 shutdown_connections 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- 172.21.15.39:0/1860995076 wait complete. 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 -- start start 2024-09-12T01:59:30.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.162+0000 7f403246b740 1 Processor -- start 2024-09-12T01:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b66a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b66d370 0x55ab5b66a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b670070 con 0x55ab5b6625d0 2024-09-12T01:59:30.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b583060 con 0x55ab5b66d370 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ab5b6701f0 con 0x55ab5b663b40 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f403246b740 10 client.0 _ll_register_callbacks cb 0x55ab5b2d68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f402d62d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f402d62d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41322/0 (socket says 172.21.15.39:41322) 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f402d62d640 1 -- 172.21.15.39:0/2681659535 learned_addr learned my addr 172.21.15.39:0/2681659535 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f402d62d640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b66d370 0x55ab5b66a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.163+0000 7f402de2e640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b66a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 -- 172.21.15.39:0/2681659535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 msgr2=0x55ab5b66a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b66a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 -- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b66d370 msgr2=0x55ab5b66a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b66d370 0x55ab5b66a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 -- 172.21.15.39:0/2681659535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab5b3393c0 con 0x55ab5b6625d0 2024-09-12T01:59:30.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f402d62d640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4018005940 tx=0x7f401801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb19f3753d19021c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f40117fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401802aad0 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f401802ac70 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40180047a0 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f401803d050 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f403246b740 10 client.16011 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.164+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab5b67bb40 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40180047a0 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f401802c3e0 con 0x55ab5b6625d0 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 10 client.16011 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 10 client.16011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 20 client.16011 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b67d3a0 0x55ab5b67f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 4 client.16011 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab5b5d5860 con 0x55ab5b67d3a0 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f402de2e640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b67d3a0 0x55ab5b67f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f40117fa640 10 client.16011 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.165+0000 7f402de2e640 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b67d3a0 0x55ab5b67f7c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69a20f13f6914c61 server_cookie=c7a97253ec7f6593 in_seq=0 out_seq=0 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.166+0000 7f40117fa640 1 -- 172.21.15.39:0/2681659535 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab5b5d5860 con 0x55ab5b67d3a0 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.166+0000 7f40117fa640 10 client.16011 handle_command_reply: tid=0 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.166+0000 7f403246b740 1 client.16011 shutdown 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.166+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 msgr2=0x55ab5b66cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.166+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4018005940 tx=0x7f401801a040 comp rx=0 tx=0).stop 2024-09-12T01:59:30.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 shutdown_connections 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b67d3a0 0x55ab5b67f7c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b66d370 0x55ab5b66a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b66a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f40117fa640 0 client.16011 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 --2- 172.21.15.39:0/2681659535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b6625d0 0x55ab5b66cd70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 >> 172.21.15.39:0/2681659535 conn(0x55ab5b62b310 msgr2=0x55ab5b664930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 shutdown_connections 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 1 -- 172.21.15.39:0/2681659535 wait complete. 2024-09-12T01:59:30.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.167+0000 7f403246b740 20 client.16011 trim_cache size 0 max 16384 2024-09-12T01:59:30.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 Processor -- start 2024-09-12T01:59:30.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 -- start start 2024-09-12T01:59:30.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b679340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b6698e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40281adb40 con 0x55ab5b66d370 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40281ab410 con 0x55ab5b663b40 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f403246b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40281a9280 con 0x55ab5b6625d0 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f402d62d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f402de2e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b679340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f402d62d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:34912/0 (socket says 172.21.15.39:34912) 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f402d62d640 1 -- 172.21.15.39:0/2969075408 learned_addr learned my addr 172.21.15.39:0/2969075408 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.183+0000 7f402d62d640 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b6698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 -- 172.21.15.39:0/2969075408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 msgr2=0x55ab5b679340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b679340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 -- 172.21.15.39:0/2969075408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 msgr2=0x55ab5b6698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b6698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 -- 172.21.15.39:0/2969075408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab5b67fe40 con 0x55ab5b6625d0 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402de2e640 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b679340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f402d62d640 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4018034de0 tx=0x7f4018000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f79d0388ec3cdd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f40137fe640 1 -- 172.21.15.39:0/2969075408 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800a9d0 con 0x55ab5b6625d0 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f40137fe640 1 -- 172.21.15.39:0/2969075408 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f401800a2d0 con 0x55ab5b6625d0 2024-09-12T01:59:30.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.184+0000 7f40137fe640 1 -- 172.21.15.39:0/2969075408 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800de30 con 0x55ab5b6625d0 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 -- 172.21.15.39:0/2969075408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 msgr2=0x55ab5b65edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4018034de0 tx=0x7f4018000bc0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 -- 172.21.15.39:0/2969075408 shutdown_connections 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b6698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b663b40 0x55ab5b679340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 --2- 172.21.15.39:0/2969075408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b6625d0 0x55ab5b65edf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 -- 172.21.15.39:0/2969075408 >> 172.21.15.39:0/2969075408 conn(0x55ab5b62b310 msgr2=0x55ab5b65e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 -- 172.21.15.39:0/2969075408 shutdown_connections 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.185+0000 7f403246b740 1 -- 172.21.15.39:0/2969075408 wait complete. 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 -- start start 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 Processor -- start 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b675db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b670df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40281a98d0 con 0x55ab5b66d370 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40281aad40 con 0x55ab5b6625d0 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40281a9fa0 con 0x55ab5b663b40 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f403246b740 10 client.0 _ll_register_callbacks cb 0x7f4024009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f402d62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f402d62d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56972/0 (socket says 172.21.15.39:56972) 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f402d62d640 1 -- 172.21.15.39:0/1311645755 learned_addr learned my addr 172.21.15.39:0/1311645755 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.186+0000 7f402d62d640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b670df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402de2e640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b675db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 -- 172.21.15.39:0/1311645755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 msgr2=0x55ab5b675db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b675db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 -- 172.21.15.39:0/1311645755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 msgr2=0x55ab5b670df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b670df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 -- 172.21.15.39:0/1311645755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab5b6715f0 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402de2e640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b675db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f402d62d640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f401802f010 tx=0x7f40180114d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6298d04132bf232b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f40117fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401800ddd0 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4018004660 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f401800a2d0 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.187+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4018050050 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 10 client.25598 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab5b6e7d20 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f401800a2d0 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f401802c3e0 con 0x55ab5b6625d0 2024-09-12T01:59:30.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 10 client.25598 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 10 client.25598 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 20 client.25598 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b6e8000 0x55ab5b6ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 4 client.25598 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab5b5cfd70 con 0x55ab5b6e8000 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.188+0000 7f402de2e640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b6e8000 0x55ab5b6ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f402de2e640 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b6e8000 0x55ab5b6ea3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9729291fc1f3a9d9 server_cookie=8bf2510ff388f9b8 in_seq=0 out_seq=0 2024-09-12T01:59:30.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f40117fa640 10 client.25598 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f40117fa640 1 -- 172.21.15.39:0/1311645755 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab5b5cfd70 con 0x55ab5b6e8000 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f40117fa640 10 client.25598 handle_command_reply: tid=0 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 client.25598 shutdown 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 msgr2=0x55ab5b675870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f401802f010 tx=0x7f40180114d0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 shutdown_connections 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55ab5b6e8000 0x55ab5b6ea3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ab5b66d370 0x55ab5b670df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab5b663b40 0x55ab5b675db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 --2- 172.21.15.39:0/1311645755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab5b6625d0 0x55ab5b675870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f40117fa640 0 client.25598 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 >> 172.21.15.39:0/1311645755 conn(0x55ab5b62b310 msgr2=0x55ab5b664080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 shutdown_connections 2024-09-12T01:59:30.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 1 -- 172.21.15.39:0/1311645755 wait complete. 2024-09-12T01:59:30.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.189+0000 7f403246b740 20 client.25598 trim_cache size 0 max 16384 2024-09-12T01:59:30.196 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 msgr2=0x7f40140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 0x7f40140a50c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40200c83f0 tx=0x7f402002d740 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 msgr2=0x7f402819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4020033040 tx=0x7f4020031e60 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 shutdown_connections 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f40140a2c00 0x7f40140a50c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4028108290 0x7f402819cd70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4028103740 0x7f40281989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 --2- 172.21.15.39:0/737111056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4028102d90 0x7f40281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:30.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 >> 172.21.15.39:0/737111056 conn(0x7f40280fc7d0 msgr2=0x7f40280fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:30.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 shutdown_connections 2024-09-12T01:59:30.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:30.190+0000 7f4030092640 1 -- 172.21.15.39:0/737111056 wait complete. 2024-09-12T01:59:30.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:30 smithi039 ceph-mon[31204]: pgmap v415: 97 pgs: 97 active+clean; 41 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2024-09-12T01:59:30.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:30 smithi044 ceph-mon[35259]: pgmap v415: 97 pgs: 97 active+clean; 41 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2024-09-12T01:59:31.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:30 smithi172 ceph-mon[35073]: pgmap v415: 97 pgs: 97 active+clean; 41 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2024-09-12T01:59:31.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:59:31.302 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 -- 172.21.15.39:0/171011328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1648101e10 msgr2=0x7f16481021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 --2- 172.21.15.39:0/171011328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1648101e10 0x7f16481021f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1638009900 tx=0x7f163802a410 comp rx=0 tx=0).stop 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 -- 172.21.15.39:0/171011328 shutdown_connections 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 --2- 172.21.15.39:0/171011328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648106f40 0x7f164810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 --2- 172.21.15.39:0/171011328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16481027c0 0x7f1648106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 --2- 172.21.15.39:0/171011328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1648101e10 0x7f16481021f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 -- 172.21.15.39:0/171011328 >> 172.21.15.39:0/171011328 conn(0x7f16480fd8d0 msgr2=0x7f16480ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 -- 172.21.15.39:0/171011328 shutdown_connections 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 -- 172.21.15.39:0/171011328 wait complete. 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.838+0000 7f164e088640 1 Processor -- start 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 -- start start 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648101e10 0x7f16480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16481027c0 0x7f1648074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1648111ff0 con 0x7f16481027c0 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f1647fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f1647fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56984/0 (socket says 172.21.15.39:56984) 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f1647fff640 1 -- 172.21.15.39:0/29991762 learned_addr learned my addr 172.21.15.39:0/29991762 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16481027c0 0x7f1648074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f16477fe640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648101e10 0x7f16480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1648111e70 con 0x7f1648106f40 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.839+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1648112170 con 0x7f1648101e10 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 -- 172.21.15.39:0/29991762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648101e10 msgr2=0x7f16480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648101e10 0x7f16480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 -- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16481027c0 msgr2=0x7f1648074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16481027c0 0x7f1648074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 -- 172.21.15.39:0/29991762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16481a6930 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1647fff640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f164000eaa0 tx=0x7f164000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1644ff9640 1 -- 172.21.15.39:0/29991762 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164000cdb0 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1644ff9640 1 -- 172.21.15.39:0/29991762 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1640005020 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16481a6c20 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f1644ff9640 1 -- 172.21.15.39:0/29991762 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400116b0 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.840+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16481a71b0 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1644ff9640 1 -- 172.21.15.39:0/29991762 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1640005560 con 0x7f1648106f40 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 Processor -- start 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 -- start start 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02330090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed02330a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed0233d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ed022962f0 con 0x55ed0233b370 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ed0223dcf0 con 0x55ed023305d0 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.843+0000 7f1650461740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ed022922b0 con 0x55ed02331b40 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed0233d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1644ff9640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 0x7f16300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed02330a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed0233d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41378/0 (socket says 172.21.15.39:41378) 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1646ffd640 1 -- 172.21.15.39:0/1244361206 learned_addr learned my addr 172.21.15.39:0/1244361206 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1646ffd640 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02330090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1647fff640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 0x7f16300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1644ff9640 1 -- 172.21.15.39:0/29991762 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f16400cf0c0 con 0x7f1648106f40 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 -- 172.21.15.39:0/1244361206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 msgr2=0x55ed02330090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02330090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 -- 172.21.15.39:0/1244361206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 msgr2=0x55ed0233d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed0233d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 -- 172.21.15.39:0/1244361206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed022223a0 con 0x55ed023305d0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f16477fe640 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed02330a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f163802aa00 tx=0x7f1638004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26a343f536f8aec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f1647fff640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 0x7f16300a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f164009b970 tx=0x7f1640066660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.844+0000 7f162dffb640 1 -- 172.21.15.39:0/1244361206 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638035040 con 0x55ed023305d0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f162dffb640 1 -- 172.21.15.39:0/1244361206 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1638005520 con 0x55ed023305d0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f162dffb640 1 -- 172.21.15.39:0/1244361206 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380035f0 con 0x55ed023305d0 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 -- 172.21.15.39:0/1244361206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 msgr2=0x55ed02330a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed02330a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f163802aa00 tx=0x7f1638004040 comp rx=0 tx=0).stop 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 -- 172.21.15.39:0/1244361206 shutdown_connections 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed0233d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed02330a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 --2- 172.21.15.39:0/1244361206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02330090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 -- 172.21.15.39:0/1244361206 >> 172.21.15.39:0/1244361206 conn(0x55ed022f9310 msgr2=0x55ed0232cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 -- 172.21.15.39:0/1244361206 shutdown_connections 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.845+0000 7f1650461740 1 -- 172.21.15.39:0/1244361206 wait complete. 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 -- start start 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 Processor -- start 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed023305d0 0x55ed0233ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 0x55ed02338600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ed0233e010 con 0x55ed02331b40 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.846+0000 7f1650461740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ed02251060 con 0x55ed0233b370 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41392/0 (socket says 172.21.15.39:41392) 2024-09-12T01:59:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 -- 172.21.15.39:0/399823262 learned_addr learned my addr 172.21.15.39:0/399823262 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ed0233e190 con 0x55ed023305d0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1646ffd640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 0x55ed02338600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1646ffd640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed023305d0 0x55ed0233ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1650461740 10 client.0 _ll_register_callbacks cb 0x55ed01fa48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 -- 172.21.15.39:0/399823262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed023305d0 msgr2=0x55ed0233ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed023305d0 0x55ed0233ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 -- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 msgr2=0x55ed02338600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 0x55ed02338600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 -- 172.21.15.39:0/399823262 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed020073c0 con 0x55ed02331b40 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1646ffd640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 0x55ed02338600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f16477fe640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1638004520 tx=0x7f1638004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa65cbd878ccd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638052060 con 0x55ed02331b40 2024-09-12T01:59:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f16380048d0 con 0x55ed02331b40 2024-09-12T01:59:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.847+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1638005520 con 0x55ed02331b40 2024-09-12T01:59:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1638035050 con 0x55ed02331b40 2024-09-12T01:59:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 10 client.16029 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ed02349a90 con 0x55ed02331b40 2024-09-12T01:59:31.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1638005520 con 0x55ed02331b40 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f16380316e0 con 0x55ed02331b40 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 10 client.16029 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 20 client.16029 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed0234d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 4 client.16029 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.848+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed022a3860 con 0x55ed0234ade0 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.849+0000 7f1646ffd640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed0234d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.849+0000 7f1626ffd640 10 client.16029 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.849+0000 7f1646ffd640 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed0234d1d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4fa60c30ff2647 server_cookie=5bfa85a0c8cd687c in_seq=0 out_seq=0 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1626ffd640 1 -- 172.21.15.39:0/399823262 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed022a3860 con 0x55ed0234ade0 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1626ffd640 10 client.16029 handle_command_reply: tid=0 2024-09-12T01:59:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 client.16029 shutdown 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 msgr2=0x55ed02338010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1638004520 tx=0x7f1638004550 comp rx=0 tx=0).stop 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 shutdown_connections 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed0234d1d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1626ffd640 0 client.16029 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed0233b370 0x55ed02338600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed02331b40 0x55ed02338010 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 --2- 172.21.15.39:0/399823262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed023305d0 0x55ed0233ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 >> 172.21.15.39:0/399823262 conn(0x55ed022f9310 msgr2=0x55ed02332960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 shutdown_connections 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 1 -- 172.21.15.39:0/399823262 wait complete. 2024-09-12T01:59:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.850+0000 7f1650461740 20 client.16029 trim_cache size 0 max 16384 2024-09-12T01:59:31.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 Processor -- start 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 -- start start 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02333120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed02333660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f16481b2010 con 0x55ed0233b370 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16481af8e0 con 0x55ed023305d0 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1650461740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16481ad730 con 0x55ed02331b40 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:57004/0 (socket says 172.21.15.39:57004) 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1646ffd640 1 -- 172.21.15.39:0/2562739436 learned_addr learned my addr 172.21.15.39:0/2562739436 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f1646ffd640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed02333660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.866+0000 7f16477fe640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02333120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 -- 172.21.15.39:0/2562739436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 msgr2=0x55ed02333120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02333120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 -- 172.21.15.39:0/2562739436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 msgr2=0x55ed02333660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed02333660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 -- 172.21.15.39:0/2562739436 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed0233a980 con 0x55ed023305d0 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f16477fe640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02333120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f1646ffd640 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f163c009fd0 tx=0x7f163c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91d890e1faed4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f162d7fa640 1 -- 172.21.15.39:0/2562739436 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0043d0 con 0x55ed023305d0 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f162d7fa640 1 -- 172.21.15.39:0/2562739436 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c004c80 con 0x55ed023305d0 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.867+0000 7f162d7fa640 1 -- 172.21.15.39:0/2562739436 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c021460 con 0x55ed023305d0 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 -- 172.21.15.39:0/2562739436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 msgr2=0x55ed023378d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f163c009fd0 tx=0x7f163c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 -- 172.21.15.39:0/2562739436 shutdown_connections 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed02333660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed02333120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 --2- 172.21.15.39:0/2562739436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed023378d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 -- 172.21.15.39:0/2562739436 >> 172.21.15.39:0/2562739436 conn(0x55ed022f9310 msgr2=0x55ed02337100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 -- 172.21.15.39:0/2562739436 shutdown_connections 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.868+0000 7f1650461740 1 -- 172.21.15.39:0/2562739436 wait complete. 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 -- start start 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 Processor -- start 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed0234d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed0234dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f16481adda0 con 0x55ed0233b370 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16481af210 con 0x55ed023305d0 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16481ae470 con 0x55ed02331b40 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1650461740 10 client.0 _ll_register_callbacks cb 0x7f163c009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41408/0 (socket says 172.21.15.39:41408) 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1646ffd640 1 -- 172.21.15.39:0/3617746554 learned_addr learned my addr 172.21.15.39:0/3617746554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f1646ffd640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed0234d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.869+0000 7f16477fe640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed0234dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 -- 172.21.15.39:0/3617746554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 msgr2=0x55ed0234dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed0234dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 -- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 msgr2=0x55ed0234d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed0234d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 -- 172.21.15.39:0/3617746554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed023b3cd0 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1646ffd640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f163c009cc0 tx=0x7f163c026040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30344fdbb3fd1cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c005000 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c004c80 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f163c005450 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f163c005650 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1650461740 10 client.16035 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.870+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ed023b4f90 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c004c80 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f163c035070 con 0x55ed0233b370 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 10 client.16035 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 20 client.16035 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed023b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 4 client.16035 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:59:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed0229dd70 con 0x55ed0234ade0 2024-09-12T01:59:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.871+0000 7f16477fe640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed023b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1626ffd640 10 client.16035 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f16477fe640 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed023b7640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121b0aa192420b68 server_cookie=3629abc3faf1ad83 in_seq=0 out_seq=0 2024-09-12T01:59:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1626ffd640 1 -- 172.21.15.39:0/3617746554 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed0229dd70 con 0x55ed0234ade0 2024-09-12T01:59:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1626ffd640 10 client.16035 handle_command_reply: tid=0 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 client.16035 shutdown 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 msgr2=0x55ed023b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f163c009cc0 tx=0x7f163c026040 comp rx=0 tx=0).stop 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 shutdown_connections 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55ed0234ade0 0x55ed023b7640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ed0233b370 0x55ed023b3710 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed02331b40 0x55ed0234dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1626ffd640 0 client.16035 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 --2- 172.21.15.39:0/3617746554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ed023305d0 0x55ed0234d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 >> 172.21.15.39:0/3617746554 conn(0x55ed022f9310 msgr2=0x55ed02339870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 shutdown_connections 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.872+0000 7f1650461740 1 -- 172.21.15.39:0/3617746554 wait complete. 2024-09-12T01:59:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f1650461740 20 client.16035 trim_cache size 0 max 16384 2024-09-12T01:59:31.878 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 msgr2=0x7f16300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 0x7f16300a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f164009b970 tx=0x7f1640066660 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 msgr2=0x7f1648074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f164000eaa0 tx=0x7f164000ef60 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 shutdown_connections 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648106f40 0x7f1648074f70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16481027c0 0x7f1648074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f16300a2c00 0x7f16300a50c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 --2- 172.21.15.39:0/29991762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1648101e10 0x7f16480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.873+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 >> 172.21.15.39:0/29991762 conn(0x7f16480fd8d0 msgr2=0x7f16480fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:31.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.874+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 shutdown_connections 2024-09-12T01:59:31.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:31.874+0000 7f164e088640 1 -- 172.21.15.39:0/29991762 wait complete. 2024-09-12T01:59:32.812 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:32 smithi039 ceph-mon[31204]: pgmap v416: 97 pgs: 97 active+clean; 41 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-12T01:59:32.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:32 smithi044 ceph-mon[35259]: pgmap v416: 97 pgs: 97 active+clean; 41 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-12T01:59:33.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:32 smithi172 ceph-mon[35073]: pgmap v416: 97 pgs: 97 active+clean; 41 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 404 op/s 2024-09-12T01:59:33.846 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:59:33.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:59:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:34.397 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T01:59:34.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:59:34.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:34 smithi039 ceph-mon[31204]: pgmap v417: 97 pgs: 97 active+clean; 42 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 622 op/s 2024-09-12T01:59:34.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-mon[35259]: pgmap v417: 97 pgs: 97 active+clean; 42 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 622 op/s 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 -- 172.21.15.39:0/1993724271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4100e20 msgr2=0x7f9ca4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 --2- 172.21.15.39:0/1993724271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4100e20 0x7f9ca4101200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009900 tx=0x7f9c9402a480 comp rx=0 tx=0).stop 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 -- 172.21.15.39:0/1993724271 shutdown_connections 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 --2- 172.21.15.39:0/1993724271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 0x7f9ca410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 --2- 172.21.15.39:0/1993724271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4102570 0x7f9ca41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 --2- 172.21.15.39:0/1993724271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4100e20 0x7f9ca4101200 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 -- 172.21.15.39:0/1993724271 >> 172.21.15.39:0/1993724271 conn(0x7f9ca40fc7d0 msgr2=0x7f9ca40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 -- 172.21.15.39:0/1993724271 shutdown_connections 2024-09-12T01:59:34.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.926+0000 7f9caa148640 1 -- 172.21.15.39:0/1993724271 wait complete. 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 Processor -- start 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 -- start start 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 0x7f9ca410fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4112090 con 0x7f9ca4102570 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9caa148640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4111f10 con 0x7f9ca4100e20 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.927+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9caa148640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4112210 con 0x7f9ca4102ef0 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55184/0 (socket says 172.21.15.39:55184) 2024-09-12T01:59:34.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51786/0 (socket says 172.21.15.39:51786) 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1863533666 learned_addr learned my addr 172.21.15.39:0/1863533666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 0x7f9ca410fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1863533666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 msgr2=0x7f9ca410fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 0x7f9ca410fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1863533666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 msgr2=0x7f9ca410f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1863533666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca41a6980 con 0x7f9ca4102570 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800e9f0 tx=0x7f9c9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca0ff9640 1 -- 172.21.15.39:0/1863533666 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800cd80 con 0x7f9ca4102570 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41a6c70 con 0x7f9ca4102570 2024-09-12T01:59:34.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca0ff9640 1 -- 172.21.15.39:0/1863533666 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c98010910 con 0x7f9ca4102570 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9ca0ff9640 1 -- 172.21.15.39:0/1863533666 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c980188f0 con 0x7f9ca4102570 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.928+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41a71b0 con 0x7f9ca4102570 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.931+0000 7f9ca0ff9640 1 -- 172.21.15.39:0/1863533666 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9c98010ac0 con 0x7f9ca4102570 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.931+0000 7f9cac521740 1 Processor -- start 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.931+0000 7f9cac521740 1 -- start start 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 0x55619e188800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e18b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55619e0e3280 con 0x55619e17e480 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55619e08ab10 con 0x55619e188d40 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9cac521740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55619e0df240 con 0x55619e17db60 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 0x55619e188800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 0x55619e188800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55196/0 (socket says 172.21.15.39:55196) 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca37fe640 1 -- 172.21.15.39:0/1463258261 learned_addr learned my addr 172.21.15.39:0/1463258261 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50144/0 (socket says 172.21.15.39:50144) 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e18b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 -- 172.21.15.39:0/1463258261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 msgr2=0x55619e18b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e18b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 -- 172.21.15.39:0/1463258261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 msgr2=0x55619e188800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 0x55619e188800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca0ff9640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 0x7f9c8c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 -- 172.21.15.39:0/1463258261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619e0971f0 con 0x55619e17db60 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca0ff9640 1 -- 172.21.15.39:0/1863533666 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9c980cf410 con 0x7f9ca4102570 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.932+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 0x7f9c8c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.933+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009f00 tx=0x7f9c9c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986c67fc888eac61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.933+0000 7f9c89ffb640 1 -- 172.21.15.39:0/1463258261 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c004250 con 0x55619e17db60 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.933+0000 7f9c89ffb640 1 -- 172.21.15.39:0/1463258261 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c01be30 con 0x55619e17db60 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.933+0000 7f9c89ffb640 1 -- 172.21.15.39:0/1463258261 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c019b40 con 0x55619e17db60 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- 172.21.15.39:0/1463258261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 msgr2=0x55619e17df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 0x7f9c8c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c020000 tx=0x7f9c9c021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009f00 tx=0x7f9c9c011810 comp rx=0 tx=0).stop 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- 172.21.15.39:0/1463258261 shutdown_connections 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e18b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17e480 0x55619e188800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 --2- 172.21.15.39:0/1463258261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17db60 0x55619e17df40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- 172.21.15.39:0/1463258261 >> 172.21.15.39:0/1463258261 conn(0x55619e17a0f0 msgr2=0x55619e17a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- 172.21.15.39:0/1463258261 shutdown_connections 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- 172.21.15.39:0/1463258261 wait complete. 2024-09-12T01:59:34.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.934+0000 7f9cac521740 1 -- start start 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 Processor -- start 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e185b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 0x55619e1860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e1865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55619e18b910 con 0x55619e17db60 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55619e09df10 con 0x55619e188d40 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e1865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 0x55619e1860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e185b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e1865f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51810/0 (socket says 172.21.15.39:51810) 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55619e18ba90 con 0x55619e17e480 2024-09-12T01:59:34.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9ca3fff640 1 -- 172.21.15.39:0/528792901 learned_addr learned my addr 172.21.15.39:0/528792901 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.935+0000 7f9cac521740 10 client.0 _ll_register_callbacks cb 0x55619e066a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 msgr2=0x55619e1865f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e1865f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/528792901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 msgr2=0x55619e185b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e185b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/528792901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619de546a0 con 0x55619e17e480 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 0x55619e1860b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c980ccf70 tx=0x7f9c98009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83cea7ead9e3402 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9809b690 con 0x55619e17e480 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9c9809b180 con 0x55619e17e480 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c9c01be30 con 0x55619e17e480 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c9809bd30 con 0x55619e17e480 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9cac521740 10 client.25486 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55619e1974c0 con 0x55619e17e480 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.936+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c9c01be30 con 0x55619e17e480 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9c98097c80 con 0x55619e17e480 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 10 client.25486 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 10 client.25486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 20 client.25486 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e198980 0x55619e19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 4 client.25486 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619e0f07f0 con 0x55619e198980 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e198980 0x55619e19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e198980 0x55619e19ad70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e49f55d51efe8b37 server_cookie=bb7aef829a1c125e in_seq=0 out_seq=0 2024-09-12T01:59:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.937+0000 7f9c82ffd640 10 client.25486 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.938+0000 7f9c82ffd640 1 -- 172.21.15.39:0/528792901 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55619e0f07f0 con 0x55619e198980 2024-09-12T01:59:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.938+0000 7f9c82ffd640 10 client.25486 handle_command_reply: tid=0 2024-09-12T01:59:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.938+0000 7f9cac521740 1 client.25486 shutdown 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 msgr2=0x55619e1860b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 0x55619e1860b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c980ccf70 tx=0x7f9c98009310 comp rx=0 tx=0).stop 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 shutdown_connections 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e198980 0x55619e19ad70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e188d40 0x55619e1865f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e17e480 0x55619e1860b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 --2- 172.21.15.39:0/528792901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e185b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9c82ffd640 0 client.25486 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 >> 172.21.15.39:0/528792901 conn(0x55619e17a0f0 msgr2=0x55619e179270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 shutdown_connections 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 1 -- 172.21.15.39:0/528792901 wait complete. 2024-09-12T01:59:34.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.939+0000 7f9cac521740 20 client.25486 trim_cache size 0 max 16384 2024-09-12T01:59:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 Processor -- start 2024-09-12T01:59:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 -- start start 2024-09-12T01:59:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e182dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41addb0 con 0x55619e17db60 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41ab680 con 0x55619e17e480 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9cac521740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a9510 con 0x55619e188d40 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.959+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51818/0 (socket says 172.21.15.39:51818) 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55216/0 (socket says 172.21.15.39:55216) 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1671811924 learned_addr learned my addr 172.21.15.39:0/1671811924 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e182dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1671811924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 msgr2=0x55619e182dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e182dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1671811924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 msgr2=0x55619e1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 -- 172.21.15.39:0/1671811924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619e19b3d0 con 0x55619e17e480 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c98098700 tx=0x7f9c9800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dbc86e0b184909b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9c897fa640 1 -- 172.21.15.39:0/1671811924 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9809bb00 con 0x55619e17e480 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9c897fa640 1 -- 172.21.15.39:0/1671811924 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c980a0030 con 0x55619e17e480 2024-09-12T01:59:34.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.960+0000 7f9c897fa640 1 -- 172.21.15.39:0/1671811924 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98097ce0 con 0x55619e17e480 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 -- 172.21.15.39:0/1671811924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 msgr2=0x55619e1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c98098700 tx=0x7f9c9800cf20 comp rx=0 tx=0).stop 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 -- 172.21.15.39:0/1671811924 shutdown_connections 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e182dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e1a0b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 --2- 172.21.15.39:0/1671811924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 -- 172.21.15.39:0/1671811924 >> 172.21.15.39:0/1671811924 conn(0x55619e17a0f0 msgr2=0x55619e187ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 -- 172.21.15.39:0/1671811924 shutdown_connections 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.961+0000 7f9cac521740 1 -- 172.21.15.39:0/1671811924 wait complete. 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.962+0000 7f9cac521740 1 -- start start 2024-09-12T01:59:34.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.962+0000 7f9cac521740 1 Processor -- start 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e18d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e18d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41a9b60 con 0x55619e17db60 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41aafb0 con 0x55619e17e480 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.963+0000 7f9cac521740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41aa210 con 0x55619e188d40 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9cac521740 10 client.0 _ll_register_callbacks cb 0x7f9c980d2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50170/0 (socket says 172.21.15.39:50170) 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 -- 172.21.15.39:0/320916898 learned_addr learned my addr 172.21.15.39:0/320916898 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e18d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e18d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 -- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 msgr2=0x55619e18d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e18d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 -- 172.21.15.39:0/320916898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 msgr2=0x55619e18d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e18d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 -- 172.21.15.39:0/320916898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619e202b30 con 0x55619e188d40 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca2ffd640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e18d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9ca3fff640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0099b0 tx=0x7f9c9c019b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa12d037ea00aad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.964+0000 7f9c82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c009b30 con 0x55619e188d40 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c980a0030 con 0x55619e188d40 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9c9c030b90 con 0x55619e188d40 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c9c030d90 con 0x55619e188d40 2024-09-12T01:59:34.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9cac521740 10 client.25492 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55619e203e90 con 0x55619e188d40 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.965+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c980a0030 con 0x55619e188d40 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f9c9c0040d0 con 0x55619e188d40 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 10 client.25492 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 20 client.25492 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e204500 0x55619e206920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 4 client.25492 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55619e0ead00 con 0x55619e204500 2024-09-12T01:59:34.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e204500 0x55619e206920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.966+0000 7f9c82ffd640 10 client.25492 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9ca37fe640 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e204500 0x55619e206920 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4891082b31549c7 server_cookie=ab4df7fd6a7324af in_seq=0 out_seq=0 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9c82ffd640 1 -- 172.21.15.39:0/320916898 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55619e0ead00 con 0x55619e204500 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9c82ffd640 10 client.25492 handle_command_reply: tid=0 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9cac521740 1 client.25492 shutdown 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 msgr2=0x55619e2025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.967+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0099b0 tx=0x7f9c9c019b00 comp rx=0 tx=0).stop 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 shutdown_connections 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55619e204500 0x55619e206920 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55619e188d40 0x55619e2025f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55619e17e480 0x55619e18d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 --2- 172.21.15.39:0/320916898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55619e17db60 0x55619e18d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 >> 172.21.15.39:0/320916898 conn(0x55619e17a0f0 msgr2=0x55619e17f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9c82ffd640 0 client.25492 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 shutdown_connections 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.968+0000 7f9cac521740 1 -- 172.21.15.39:0/320916898 wait complete. 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9cac521740 20 client.25492 trim_cache size 0 max 16384 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stdout: "return_code": 0, 2024-09-12T01:59:34.972 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_tag": "d12cb9d1-9e29-4c88-ab5a-fba1913de942", 2024-09-12T01:59:34.973 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": "asynchronous" 2024-09-12T01:59:34.973 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:34.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 msgr2=0x7f9c8c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 0x7f9c8c0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c020000 tx=0x7f9c9c021000 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 msgr2=0x7f9ca410f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800e9f0 tx=0x7f9c9800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 shutdown_connections 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9c8c0a2b80 0x7f9c8c0a5040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ca4102ef0 0x7f9ca410fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ca4102570 0x7f9ca410f910 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 --2- 172.21.15.39:0/1863533666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca4100e20 0x7f9ca410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.969+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 >> 172.21.15.39:0/1863533666 conn(0x7f9ca40fc7d0 msgr2=0x7f9ca40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.970+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 shutdown_connections 2024-09-12T01:59:34.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:34.970+0000 7f9caa148640 1 -- 172.21.15.39:0/1863533666 wait complete. 2024-09-12T01:59:34.983 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:35.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:34 smithi172 ceph-mon[35073]: pgmap v417: 97 pgs: 97 active+clean; 42 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 622 op/s 2024-09-12T01:59:35.423 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T01:59:35.047+0000 7f4779494640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a7 [...2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/btrfs/ auth{1=1} fragtree_t(*^3) v24587 ap=2 f(v2 m2024-09-12T01:59:12.703773+0000 640=640+0) n(v3 rc2024-09-12T01:59:12.705773+0000 b1244944 641=640+1) (inest sync->mix g=1) caps={24836=pAsLsXsFs/pAsLsXsFsx@1430} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55c0c2b86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000003a7:[<0x100000003a5/btrfs v1300>,<0x10000000007/tests v868>,<0x10000000006/xfstests-dev v104>,<0x10000000005/tmp v30>,<0x100000001fb/client.0 v29>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v43>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v46>,<0x1/volumes v46>]//[]","memoryvalue":"(2)0x100000003a7:[<0x100000003a5/btrfs v24587>,<0x10000000007/tests v5820>,<0x10000000006/xfstests-dev v5576>,<0x10000000005/tmp v6189>,<0x100000001fb/client.0 v157>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v165>,<0x10000000001/sv_1 v175>,<0x10000000000/qa v165>,<0x1/volumes v158>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-12T01:58:41.682373+0000 639=639+0)","ondisk_value.rstat":"n(v0 rc2024-09-12T01:59:12.705773+0000 b1244944 641=640+1)","memory_value.dirstat":"f(v2 m2024-09-12T01:59:12.703773+0000 640=640+0)","memory_value.rstat":"n(v3 rc2024-09-12T01:59:12.705773+0000 b1244944 641=640+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-12T01:59:35.426 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.979+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aac [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo auth v235 ap=1 s=270 n(v0 rc2024-09-12T01:59:13.269762+0000 b270 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f4a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aac:[<0x100000002ab/tlibio.lo v180>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aac:[<0x100000002ab/tlibio.lo v235>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.426 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.980+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a88 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o auth v275 ap=1 s=8616 n(v0 rc2024-09-12T01:59:12.677773+0000 b8616 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f6479fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a88:[<0x100000002ab/dataascii.o v64>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a88:[<0x100000002ab/dataascii.o v275>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.426 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.980+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9b [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o auth v227 ap=1 s=9952 n(v0 rc2024-09-12T01:59:13.018766+0000 b9952 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f6479f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9b:[<0x100000002ab/open_flags.o v124>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9b:[<0x100000002ab/open_flags.o v227>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.426 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.980+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa0 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo auth v259 ap=1 s=300 n(v0 rc2024-09-12T01:59:13.065766+0000 b300 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f6479e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa0:[<0x100000002ab/string_to_tokens.lo v140>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa0:[<0x100000002ab/string_to_tokens.lo v259>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.426 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.980+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9a [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo auth v263 ap=1 s=273 n(v0 rc2024-09-12T01:59:12.977767+0000 b273 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f651fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9a:[<0x100000002ab/pattern.lo v120>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9a:[<0x100000002ab/pattern.lo v263>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.981+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa9 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o auth v233 ap=1 s=8088 n(v0 rc2024-09-12T01:59:13.256762+0000 b8088 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64d03080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa9:[<0x100000002ab/random.o v168>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa9:[<0x100000002ab/random.o v233>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.981+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a92 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o auth v245 ap=1 s=11120 n(v0 rc2024-09-12T01:59:12.896769+0000 b11120 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64d03600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a92:[<0x100000002ab/file_lock.o v94>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a92:[<0x100000002ab/file_lock.o v245>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.981+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a78 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep auth v273 ap=1 s=593 n(v0 rc2024-09-12T01:59:12.524776+0000 b593 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64d04680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a78:[<0x100000002ab/.ltdep v58>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a78:[<0x100000002ab/.ltdep v273>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.981+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ab2 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la auth v241 ap=1 s=846 n(v0 rc2024-09-12T01:59:13.520757+0000 b846 1=1+0) (ifile excl) cr={24836=0-4194304@1} caps={24836=pAsLsXsFsxcrwb/pFscr@2},l=24836 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64d05180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ab2:[<0x100000002ab/libtest.la v218>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001ab2:[<0x100000002ab/libtest.la v241>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.982+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aaa [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo auth v301 ap=1 s=270 n(v0 rc2024-09-12T01:59:13.260762+0000 b270 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c31700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aaa:[<0x100000002ab/random.lo v174>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aaa:[<0x100000002ab/random.lo v301>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.982+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9f [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o auth v281 ap=1 s=5112 n(v0 rc2024-09-12T01:59:13.062766+0000 b5112 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64bb1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9f:[<0x100000002ab/string_to_tokens.o v136>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9f:[<0x100000002ab/string_to_tokens.o v281>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa4 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo auth v291 ap=1 s=288 n(v0 rc2024-09-12T01:59:13.151764+0000 b288 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64bb3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa4:[<0x100000002ab/str_to_bytes.lo v152>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa4:[<0x100000002ab/str_to_bytes.lo v291>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a94 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo auth v265 ap=1 s=279 n(v0 rc2024-09-12T01:59:12.900769+0000 b279 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64bb3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a94:[<0x100000002ab/file_lock.lo v100>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a94:[<0x100000002ab/file_lock.lo v265>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8e [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o auth v261 ap=1 s=9616 n(v0 rc2024-09-12T01:59:12.826770+0000 b9616 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64bb1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8e:[<0x100000002ab/databin.o v84>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8e:[<0x100000002ab/databin.o v261>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a97 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo auth v293 ap=1 s=270 n(v0 rc2024-09-12T01:59:12.949768+0000 b270 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f4d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a97:[<0x100000002ab/forker.lo v110>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a97:[<0x100000002ab/forker.lo v293>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa2 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o auth v267 ap=1 s=12536 n(v0 rc2024-09-12T01:59:13.146764+0000 b12536 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f4cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa2:[<0x100000002ab/str_to_bytes.o v146>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa2:[<0x100000002ab/str_to_bytes.o v267>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.427 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8c [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o auth v279 ap=1 s=4760 n(v0 rc2024-09-12T01:59:12.797771+0000 b4760 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f4c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8c:[<0x100000002ab/datapid.o v76>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8c:[<0x100000002ab/datapid.o v279>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.983+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8d [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo auth v253 ap=1 s=273 n(v0 rc2024-09-12T01:59:12.800771+0000 b273 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f4d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8d:[<0x100000002ab/datapid.lo v80>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8d:[<0x100000002ab/datapid.lo v253>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.984+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa3 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o auth v255 ap=1 s=23880 n(v0 rc2024-09-12T01:59:13.154764+0000 b23880 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa3:[<0x100000002ab/random_range.o v148>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa3:[<0x100000002ab/random_range.o v255>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.984+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aab [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o auth v287 ap=1 s=31144 n(v0 rc2024-09-12T01:59:13.265762+0000 b31144 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aab:[<0x100000002ab/tlibio.o v172>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aab:[<0x100000002ab/tlibio.o v287>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.984+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aae [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo auth v283 ap=1 s=279 n(v0 rc2024-09-12T01:59:13.341760+0000 b279 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aae:[<0x100000002ab/write_log.lo v188>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aae:[<0x100000002ab/write_log.lo v283>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.984+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a81 [...2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/ auth v305 ap=1 f(v0 m2024-09-12T01:59:13.523757+0000 15=15+0) n(v0 rc2024-09-12T01:59:13.523757+0000 b330547 16=15+1) (inest lock) (ifile excl) caps={24836=pAsLsXsFsx/pAsLsXsFsx@2},l=24836 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001a81:[<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(2)0x10000001a81:[<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-12T01:59:13.523757+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2024-09-12T01:59:13.523757+0000 b330547 16=15+1)","memory_value.dirstat":"f(v0 m2024-09-12T01:59:13.523757+0000 15=15+0)","memory_value.rstat":"n(v0 rc2024-09-12T01:59:13.523757+0000 b330547 16=15+1)","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9c [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo auth v297 ap=1 s=282 n(v0 rc2024-09-12T01:59:13.022766+0000 b282 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f40000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9c:[<0x100000002ab/open_flags.lo v128>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9c:[<0x100000002ab/open_flags.lo v297>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8f [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo auth v225 ap=1 s=273 n(v0 rc2024-09-12T01:59:12.830770+0000 b273 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64b8c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8f:[<0x100000002ab/databin.lo v90>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8f:[<0x100000002ab/databin.lo v225>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a99 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o auth v257 ap=1 s=8648 n(v0 rc2024-09-12T01:59:12.973767+0000 b8648 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64b8d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a99:[<0x100000002ab/pattern.o v116>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a99:[<0x100000002ab/pattern.o v257>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a89 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo auth v277 ap=1 s=279 n(v0 rc2024-09-12T01:59:12.680773+0000 b279 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f65245080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a89:[<0x100000002ab/dataascii.lo v68>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a89:[<0x100000002ab/dataascii.lo v277>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa5 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo auth v247 ap=1 s=288 n(v0 rc2024-09-12T01:59:13.158764+0000 b288 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f65244580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa5:[<0x100000002ab/random_range.lo v158>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa5:[<0x100000002ab/random_range.lo v247>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.428 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.985+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a96 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o auth v229 ap=1 s=11448 n(v0 rc2024-09-12T01:59:12.945768+0000 b11448 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f65247180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a96:[<0x100000002ab/forker.o v106>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a96:[<0x100000002ab/forker.o v229>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aad [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o auth v271 ap=1 s=20920 n(v0 rc2024-09-12T01:59:13.337760+0000 b20920 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f65244000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aad:[<0x100000002ab/write_log.o v184>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aad:[<0x100000002ab/write_log.o v271>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a85 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o auth v70 ap=1 s=8744 n(v0 rc2024-09-12T01:59:12.637774+0000 b8744 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64ec0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a85:[<0x10000001a81/dataascii.o v2>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a85:[<0x10000001a81/dataascii.o v70>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a98 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o auth v66 ap=1 s=9696 n(v0 rc2024-09-12T01:59:12.963768+0000 b9696 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64ec3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a98:[<0x10000001a81/open_flags.o v14>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a98:[<0x10000001a81/open_flags.o v66>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa8 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o auth v82 ap=1 s=7152 n(v0 rc2024-09-12T01:59:13.224762+0000 b7152 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64ec1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa8:[<0x10000001a81/random.o v26>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa8:[<0x10000001a81/random.o v82>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a90 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o auth v72 ap=1 s=11160 n(v0 rc2024-09-12T01:59:12.833770+0000 b11160 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64f3b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a90:[<0x10000001a81/file_lock.o v8>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a90:[<0x10000001a81/file_lock.o v72>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.986+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ab3 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la auth symlink='../libtest.la' v54 ap=1 s=13 n(v0 b13 1=1+0) caps={24836=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x559f64f39b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ab3:[<0x10000001a81/libtest.la v54>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001ab3:[<0x10000001a81/libtest.la v54>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9d [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o auth v68 ap=1 s=5168 n(v0 rc2024-09-12T01:59:13.032766+0000 b5168 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64a49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9d:[<0x10000001a81/string_to_tokens.o v16>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9d:[<0x10000001a81/string_to_tokens.o v68>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8b [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o auth v62 ap=1 s=9792 n(v0 rc2024-09-12T01:59:12.769771+0000 b9792 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c6b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8b:[<0x10000001a81/databin.o v6>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8b:[<0x10000001a81/databin.o v62>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa1 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o auth v78 ap=1 s=12208 n(v0 rc2024-09-12T01:59:13.091765+0000 b12208 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c68580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa1:[<0x10000001a81/str_to_bytes.o v20>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa1:[<0x10000001a81/str_to_bytes.o v78>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a8a [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o auth v76 ap=1 s=4768 n(v0 rc2024-09-12T01:59:12.765771+0000 b4768 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c6a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a8a:[<0x10000001a81/datapid.o v4>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a8a:[<0x10000001a81/datapid.o v76>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.429 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa6 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o auth v60 ap=1 s=30608 n(v0 rc2024-09-12T01:59:13.168764+0000 b30608 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c69600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa6:[<0x10000001a81/tlibio.o v22>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa6:[<0x10000001a81/tlibio.o v60>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.430 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a9e [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o auth v64 ap=1 s=23928 n(v0 rc2024-09-12T01:59:13.055766+0000 b23928 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c68000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a9e:[<0x10000001a81/random_range.o v18>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a9e:[<0x10000001a81/random_range.o v64>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.430 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aaf [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a auth v56 ap=1 s=166166 n(v0 rc2024-09-12T01:59:13.511757+0000 b166166 1=1+0) (ifile excl) cr={24836=0-4194304@1} caps={24836=pAsLsXsFsxcrwb/pFscr@1},l=24836 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64c68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aaf:[<0x10000001a81/libtest.a v52>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aaf:[<0x10000001a81/libtest.a v56>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.430 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a95 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o auth v80 ap=1 s=8704 n(v0 rc2024-09-12T01:59:12.929768+0000 b8704 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f64360680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a95:[<0x10000001a81/pattern.o v12>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a95:[<0x10000001a81/pattern.o v80>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.430 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.987+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a93 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o auth v74 ap=1 s=11416 n(v0 rc2024-09-12T01:59:12.898769+0000 b11416 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f6435e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a93:[<0x10000001a81/forker.o v10>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a93:[<0x10000001a81/forker.o v74>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.430 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 01:59:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T01:59:34.988+0000 7f5c96001640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa7 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o auth v58 ap=1 s=21024 n(v0 rc2024-09-12T01:59:13.218763+0000 b21024 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x559f6435eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa7:[<0x10000001a81/write_log.o v24>,<0x100000002ab/.libs v220>,<0x10000000007/lib v5311>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001aa7:[<0x10000001a81/write_log.o v58>,<0x100000002ab/.libs v305>,<0x10000000007/lib v5818>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T01:59:35.165+0000 7f43487bb640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a83 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list auth{0=1} v693 ap=1 s=18956 n(v0 rc2024-09-12T01:59:12.609774+0000 b18956 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e14aff6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a83:[<0x100000006d6/group.list v691>,<0x100000003a5/generic v24546>,<0x10000000007/tests v5213>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a83:[<0x100000006d6/group.list v693>,<0x100000003a5/generic v24563>,<0x10000000007/tests v5820>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T01:59:35.302+0000 7f43487bb640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a91 [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list auth{0=1} v697 ap=1 s=22763 n(v0 rc2024-09-12T01:59:12.852770+0000 b22763 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e14b1bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a91:[<0x10000000da7/group.list v695>,<0x100000003a5/xfs v24556>,<0x10000000007/tests v5213>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a91:[<0x10000000da7/group.list v697>,<0x100000003a5/xfs v24575>,<0x10000000007/tests v5820>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T01:59:35.325+0000 7f43487bb640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a7c [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list auth v394 ap=1 s=1557 n(v0 rc2024-09-12T01:59:12.428778+0000 b1557 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55e14c32b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a7c:[<0x1000000063f/group.list v392>,<0x100000003a5/ext4 v24534>,<0x10000000007/tests v5213>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a7c:[<0x1000000063f/group.list v394>,<0x100000003a5/ext4 v24571>,<0x10000000007/tests v5820>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.504 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T01:59:35.335+0000 7f43487bb640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a7f [2,head] /volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list auth{0=1} v429 ap=1 s=3144 n(v0 rc2024-09-12T01:59:12.553775+0000 b3144 1=1+0) caps={24836=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55e14b022000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a7f:[<0x10000000cbb/group.list v427>,<0x100000003a5/overlay v24540>,<0x10000000007/tests v5213>,<0x10000000006/xfstests-dev v3363>,<0x10000000005/tmp v110>,<0x100000001fb/client.0 v110>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v119>,<0x10000000001/sv_1 v135>,<0x10000000000/qa v122>,<0x1/volumes v118>]//[]","memoryvalue":"(3)0x10000001a7f:[<0x10000000cbb/group.list v429>,<0x100000003a5/overlay v24567>,<0x10000000007/tests v5820>,<0x10000000006/xfstests-dev v5574>,<0x10000000005/tmp v2306>,<0x100000001fb/client.0 v153>,<0x100000001fa/ca2bc097-600f-4540-8f33-9058f9e265df v151>,<0x10000000001/sv_1 v165>,<0x10000000000/qa v96>,<0x1/volumes v148>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T01:59:35.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:59:35.943 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:59:35.943 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aac (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.943 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a88 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.943 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa0 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa9 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a92 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a78 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001ab2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a94 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.944 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.945 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a97 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.945 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.945 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.945 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.945 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aab (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aae (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a81 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a99 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a89 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa5 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a96 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aad (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a85 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.946 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a98 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa8 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a90 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001ab3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa1 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a8a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa6 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a9e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aaf (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a95 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.947 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a93 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.948 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001aa7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:35.948 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:35.948 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:35 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aac (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a88 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa0 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa9 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a92 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a78 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001ab2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a94 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a97 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aab (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aae (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a81 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a99 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a89 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa5 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a96 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aad (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a85 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a98 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa8 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a90 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001ab3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa1 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a8a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa6 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a9e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aaf (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a95 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a93 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001aa7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:35 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aac (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a88 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa0 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa9 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a92 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a78 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001ab2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a94 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a97 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa2 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aab (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aae (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a81 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a99 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a89 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa5 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a96 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aad (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.176 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a85 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a98 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa8 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a90 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001ab3 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9d (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8b (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa1 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a8a (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa6 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a9e (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.177 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aaf (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a95 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a93 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001aa7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o) see mds.h log and `damage ls` output for details 2024-09-12T01:59:36.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:35 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:59:36.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 -- 172.21.15.39:0/3866586907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 msgr2=0x7fa190103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:36.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 --2- 172.21.15.39:0/3866586907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190103110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa180009930 tx=0x7fa18002a420 comp rx=0 tx=0).stop 2024-09-12T01:59:36.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 -- 172.21.15.39:0/3866586907 shutdown_connections 2024-09-12T01:59:36.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 --2- 172.21.15.39:0/3866586907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901082a0 0x7fa19010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 --2- 172.21.15.39:0/3866586907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901036e0 0x7fa190107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 --2- 172.21.15.39:0/3866586907 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190103110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 -- 172.21.15.39:0/3866586907 >> 172.21.15.39:0/3866586907 conn(0x7fa1900fc7d0 msgr2=0x7fa1900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 -- 172.21.15.39:0/3866586907 shutdown_connections 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 -- 172.21.15.39:0/3866586907 wait complete. 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.328+0000 7fa19548c640 1 Processor -- start 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 -- start start 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 0x7fa190101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa1901120a0 con 0x7fa190102d30 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa190111f20 con 0x7fa1901036e0 2024-09-12T01:59:36.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa19548c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa190112220 con 0x7fa1901082a0 2024-09-12T01:59:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa187fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 0x7fa190101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa187fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51836/0 (socket says 172.21.15.39:51836) 2024-09-12T01:59:36.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa187fff640 1 -- 172.21.15.39:0/1366681551 learned_addr learned my addr 172.21.15.39:0/1366681551 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 -- 172.21.15.39:0/1366681551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 msgr2=0x7fa190100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 -- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 msgr2=0x7fa190100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.329+0000 7fa18f7fe640 1 -- 172.21.15.39:0/1366681551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1901a6a60 con 0x7fa1901082a0 2024-09-12T01:59:36.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa187fff640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa18effd640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa18f7fe640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 0x7fa190101410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa188009fd0 tx=0x7fa18800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800ce20 con 0x7fa1901082a0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1901a6d50 con 0x7fa1901082a0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa188005020 con 0x7fa1901082a0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188010720 con 0x7fa1901082a0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.330+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1901a7240 con 0x7fa1901082a0 2024-09-12T01:59:36.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.331+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19006a850 con 0x7fa1901082a0 2024-09-12T01:59:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.333+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa188005540 con 0x7fa1901082a0 2024-09-12T01:59:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.334+0000 7fa18cff9640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 0x7fa17c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.334+0000 7fa18effd640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 0x7fa17c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.334+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa1880cf750 con 0x7fa1901082a0 2024-09-12T01:59:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.335+0000 7fa18effd640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 0x7fa17c0a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa180009900 tx=0x7fa1800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:36.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.339+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa18809c6c0 con 0x7fa1901082a0 2024-09-12T01:59:36.371 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:36.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.586+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa19010a2b0 con 0x7fa1901082a0 2024-09-12T01:59:36.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.587+0000 7fa18cff9640 1 -- 172.21.15.39:0/1366681551 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11911 (secure 0 0 0) 0x7fa18809bfc0 con 0x7fa1901082a0 2024-09-12T01:59:36.587 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T01:59:36.587 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":27,"btime":"2024-09-12T01:58:43:389902+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:58:42.815744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T01:59:36.588 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 27 2024-09-12T01:59:36.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.589+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 msgr2=0x7fa17c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.589+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 0x7fa17c0a5040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa180009900 tx=0x7fa1800058d0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.589+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 msgr2=0x7fa190101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.589+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 0x7fa190101410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa188009fd0 tx=0x7fa18800ef10 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 shutdown_connections 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa17c0a2b80 0x7fa17c0a5040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1901082a0 0x7fa190101410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1901036e0 0x7fa190100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 --2- 172.21.15.39:0/1366681551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa190102d30 0x7fa190100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 >> 172.21.15.39:0/1366681551 conn(0x7fa1900fc7d0 msgr2=0x7fa190105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 shutdown_connections 2024-09-12T01:59:36.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:36.590+0000 7fa19548c640 1 -- 172.21.15.39:0/1366681551 wait complete. 2024-09-12T01:59:36.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub queued for path: / 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: active paths [/] 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/btrfs) see mds.b log and `damage ls` output for details 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a83 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a91 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: pgmap v418: 97 pgs: 97 active+clean; 45 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 708 op/s 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a7c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:36.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: Scrub error on inode 0x10000001a7f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:36.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:36.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:36 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1366681551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub queued for path: / 2024-09-12T01:59:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:59:37.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: active paths [/] 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/btrfs) see mds.b log and `damage ls` output for details 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a83 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a91 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: pgmap v418: 97 pgs: 97 active+clean; 45 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 708 op/s 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a7c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: Scrub error on inode 0x10000001a7f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:36 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1366681551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub queued for path: / 2024-09-12T01:59:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:59:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: active paths [/] 2024-09-12T01:59:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/btrfs) see mds.b log and `damage ls` output for details 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a83 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a91 (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: pgmap v418: 97 pgs: 97 active+clean; 45 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 708 op/s 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a7c (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: Scrub error on inode 0x10000001a7f (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list) see mds.i log and `damage ls` output for details 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: scrub summary: idle+waiting paths [/] 2024-09-12T01:59:37.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:36 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1366681551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:59:37.439 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T01:59:37.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T01:59:37.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 -- 172.21.15.39:0/138739895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 msgr2=0x7f056810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 --2- 172.21.15.39:0/138739895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f056810eaa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0560009ca0 tx=0x7f056002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 -- 172.21.15.39:0/138739895 shutdown_connections 2024-09-12T01:59:37.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 --2- 172.21.15.39:0/138739895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f056810eaa0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 --2- 172.21.15.39:0/138739895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 0x7f05681067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 --2- 172.21.15.39:0/138739895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 -- 172.21.15.39:0/138739895 >> 172.21.15.39:0/138739895 conn(0x7f05680fd8f0 msgr2=0x7f05680ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 -- 172.21.15.39:0/138739895 shutdown_connections 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.754+0000 7f056ec0f640 1 -- 172.21.15.39:0/138739895 wait complete. 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 Processor -- start 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 -- start start 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 0x7f0568074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0568111f80 con 0x7f0568106f20 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0568111e00 con 0x7f0568101df0 2024-09-12T01:59:37.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056ec0f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0568112100 con 0x7f05681027a0 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056d1ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056d1ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55260/0 (socket says 172.21.15.39:55260) 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f056d1ac640 1 -- 172.21.15.39:0/1088187655 learned_addr learned my addr 172.21.15.39:0/1088187655 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.755+0000 7f0567fff640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 0x7f0568074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 -- 172.21.15.39:0/1088187655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 msgr2=0x7f0568074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 0x7f0568074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 -- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 msgr2=0x7f0568074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 -- 172.21.15.39:0/1088187655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05681a6900 con 0x7f0568101df0 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056d1ac640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05680744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9f0 tx=0x7f055c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f0565ffb640 1 -- 172.21.15.39:0/1088187655 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c00cd80 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f0565ffb640 1 -- 172.21.15.39:0/1088187655 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c0035f0 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05681a6bf0 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f0565ffb640 1 -- 172.21.15.39:0/1088187655 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c010690 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.756+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05681a7130 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.758+0000 7f0565ffb640 1 -- 172.21.15.39:0/1088187655 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f055c003b30 con 0x7f0568101df0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 Processor -- start 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0565ffb640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 0x7f05580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 -- start start 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f056d1ac640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 0x7f05580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0565ffb640 1 -- 172.21.15.39:0/1088187655 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f055c0cf2e0 con 0x7f0568101df0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc3921a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559fc387a2e0 con 0x559fc391f680 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559fc3821ce0 con 0x559fc3914dc0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.759+0000 7f0570fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559fc38762a0 con 0x559fc39144a0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0567fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50214/0 (socket says 172.21.15.39:50214) 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 -- 172.21.15.39:0/2531229470 learned_addr learned my addr 172.21.15.39:0/2531229470 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0567fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51868/0 (socket says 172.21.15.39:51868) 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056d1ac640 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc3921a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 -- 172.21.15.39:0/2531229470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 msgr2=0x559fc391f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 -- 172.21.15.39:0/2531229470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 msgr2=0x559fc3921a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc3921a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 -- 172.21.15.39:0/2531229470 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc3806440 con 0x559fc39144a0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0567fff640 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056c9ab640 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f055c09ba80 tx=0x7f055c009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe9787ef228a3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f056d1ac640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 0x7f05580a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0560031f80 tx=0x7f0560009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0552ffd640 1 -- 172.21.15.39:0/2531229470 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c09baf0 con 0x559fc39144a0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0552ffd640 1 -- 172.21.15.39:0/2531229470 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c09fea0 con 0x559fc39144a0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.760+0000 7f0552ffd640 1 -- 172.21.15.39:0/2531229470 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c09b180 con 0x559fc39144a0 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- 172.21.15.39:0/2531229470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 msgr2=0x559fc3914880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f055c09ba80 tx=0x7f055c009450 comp rx=0 tx=0).stop 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- 172.21.15.39:0/2531229470 shutdown_connections 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc3921a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 --2- 172.21.15.39:0/2531229470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc39144a0 0x559fc3914880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- 172.21.15.39:0/2531229470 >> 172.21.15.39:0/2531229470 conn(0x559fc3910a30 msgr2=0x559fc3910e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- 172.21.15.39:0/2531229470 shutdown_connections 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- 172.21.15.39:0/2531229470 wait complete. 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.761+0000 7f0570fe8740 1 -- start start 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 Processor -- start 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc391f680 0x559fc391c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x559fc39221f0 con 0x559fc39144a0 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559fc3835050 con 0x559fc3914dc0 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559fc3922370 con 0x559fc391f680 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0570fe8740 10 client.0 _ll_register_callbacks cb 0x559fc3875160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:37.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0567fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55282/0 (socket says 172.21.15.39:55282) 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f056c9ab640 1 -- 172.21.15.39:0/4165422367 learned_addr learned my addr 172.21.15.39:0/4165422367 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f0567fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51870/0 (socket says 172.21.15.39:51870) 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.762+0000 7f056d1ac640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc391f680 0x559fc391c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 -- 172.21.15.39:0/4165422367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc391f680 msgr2=0x559fc391c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc391f680 0x559fc391c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 -- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 msgr2=0x559fc391c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 -- 172.21.15.39:0/4165422367 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc35eb3c0 con 0x559fc39144a0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0567fff640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f056c9ab640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9c0 tx=0x7f055c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d0da786650849 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0547fff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c07e020 con 0x559fc39144a0 2024-09-12T01:59:37.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f055c0ba2e0 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f055c09fea0 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f055c0a4760 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0570fe8740 10 client.16071 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559fc392dc10 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.763+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f055c09fea0 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f055c09a9b0 con 0x559fc39144a0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 10 client.16071 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 20 client.16071 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc392ef60 0x559fc3931350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 4 client.16071 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fc3887850 con 0x559fc392ef60 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0567fff640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc392ef60 0x559fc3931350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0567fff640 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc392ef60 0x559fc3931350 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9b7e53b6978d38 server_cookie=f23b060bb92bae13 in_seq=0 out_seq=0 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.764+0000 7f0547fff640 10 client.16071 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0547fff640 1 -- 172.21.15.39:0/4165422367 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fc3887850 con 0x559fc392ef60 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0547fff640 10 client.16071 handle_command_reply: tid=0 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 client.16071 shutdown 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 msgr2=0x559fc391f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9c0 tx=0x7f055c005770 comp rx=0 tx=0).stop 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 shutdown_connections 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc392ef60 0x559fc3931350 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc391f680 0x559fc391c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc3914dc0 0x559fc391c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 --2- 172.21.15.39:0/4165422367 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc391f010 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 >> 172.21.15.39:0/4165422367 conn(0x559fc3910a30 msgr2=0x559fc3916710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.765+0000 7f0547fff640 0 client.16071 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:37.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.766+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 shutdown_connections 2024-09-12T01:59:37.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.766+0000 7f0570fe8740 1 -- 172.21.15.39:0/4165422367 wait complete. 2024-09-12T01:59:37.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.766+0000 7f0570fe8740 20 client.16071 trim_cache size 0 max 16384 2024-09-12T01:59:37.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.784+0000 7f0570fe8740 1 Processor -- start 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.784+0000 7f0570fe8740 1 -- start start 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.784+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3936f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 0x559fc3919520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0570fe8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05681b20b0 con 0x559fc39144a0 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0570fe8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05681af980 con 0x559fc391f680 2024-09-12T01:59:37.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0570fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05681ad7d0 con 0x559fc3914dc0 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3936f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55298/0 (socket says 172.21.15.39:55298) 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056c9ab640 1 -- 172.21.15.39:0/3711371481 learned_addr learned my addr 172.21.15.39:0/3711371481 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056d1ac640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 0x559fc3919520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 -- 172.21.15.39:0/3711371481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 msgr2=0x559fc3919520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 0x559fc3919520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 -- 172.21.15.39:0/3711371481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 msgr2=0x559fc39369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 -- 172.21.15.39:0/3711371481 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc3914bf0 con 0x559fc3914dc0 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056c9ab640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f056d1ac640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 0x559fc3919520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.785+0000 7f0567fff640 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3936f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x559fc391d870 tx=0x7f0554005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e57065a8d692a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.786+0000 7f05527fc640 1 -- 172.21.15.39:0/3711371481 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554012110 con 0x559fc3914dc0 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.786+0000 7f05527fc640 1 -- 172.21.15.39:0/3711371481 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0554005020 con 0x559fc3914dc0 2024-09-12T01:59:37.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.786+0000 7f05527fc640 1 -- 172.21.15.39:0/3711371481 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055400fa50 con 0x559fc3914dc0 2024-09-12T01:59:37.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- 172.21.15.39:0/3711371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 msgr2=0x559fc3936f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3936f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x559fc391d870 tx=0x7f0554005f90 comp rx=0 tx=0).stop 2024-09-12T01:59:37.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- 172.21.15.39:0/3711371481 shutdown_connections 2024-09-12T01:59:37.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc391f680 0x559fc3919520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3936f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 --2- 172.21.15.39:0/3711371481 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc39144a0 0x559fc39369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- 172.21.15.39:0/3711371481 >> 172.21.15.39:0/3711371481 conn(0x559fc3910a30 msgr2=0x559fc390fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- 172.21.15.39:0/3711371481 shutdown_connections 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- 172.21.15.39:0/3711371481 wait complete. 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 -- start start 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.787+0000 7f0570fe8740 1 Processor -- start 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 0x559fc3927ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3925210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05681ade40 con 0x559fc391f680 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05681af2b0 con 0x559fc39144a0 2024-09-12T01:59:37.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05681ae510 con 0x559fc3914dc0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0570fe8740 10 client.0 _ll_register_callbacks cb 0x7f0554005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056d1ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 0x559fc3927ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056d1ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55312/0 (socket says 172.21.15.39:55312) 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056d1ac640 1 -- 172.21.15.39:0/1426017947 learned_addr learned my addr 172.21.15.39:0/1426017947 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f0567fff640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3925210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 -- 172.21.15.39:0/1426017947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 msgr2=0x559fc3925210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3925210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 -- 172.21.15.39:0/1426017947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 msgr2=0x559fc39259a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056c9ab640 1 -- 172.21.15.39:0/1426017947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc39989c0 con 0x559fc39144a0 2024-09-12T01:59:37.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.788+0000 7f056d1ac640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f056c9ab640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 0x559fc3927ec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f055c0984c0 tx=0x7f055c009430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a534a4bbb19c138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c07e070 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0554005020 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f055c0a1080 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f055c097d90 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 10 client.25658 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559fc39989c0 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0554005020 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f055c0ba370 con 0x559fc39144a0 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 10 client.25658 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:37.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 20 client.25658 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc3999e30 0x559fc399c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 4 client.25658 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.789+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fc3881d60 con 0x559fc3999e30 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.790+0000 7f0567fff640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc3999e30 0x559fc399c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.790+0000 7f0547fff640 10 client.25658 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.790+0000 7f0567fff640 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc3999e30 0x559fc399c250 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d335afdf86879e3e server_cookie=c3b688757a9aebb5 in_seq=0 out_seq=0 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0547fff640 1 -- 172.21.15.39:0/1426017947 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559fc3881d60 con 0x559fc3999e30 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0547fff640 10 client.25658 handle_command_reply: tid=0 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 client.25658 shutdown 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 msgr2=0x559fc3927ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 0x559fc3927ec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f055c0984c0 tx=0x7f055c009430 comp rx=0 tx=0).stop 2024-09-12T01:59:37.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 shutdown_connections 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559fc3999e30 0x559fc399c250 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0547fff640 0 client.25658 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559fc391f680 0x559fc39259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559fc3914dc0 0x559fc3925210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 --2- 172.21.15.39:0/1426017947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fc39144a0 0x559fc3927ec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 >> 172.21.15.39:0/1426017947 conn(0x559fc3910a30 msgr2=0x559fc391db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 shutdown_connections 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 1 -- 172.21.15.39:0/1426017947 wait complete. 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.791+0000 7f0570fe8740 20 client.25658 trim_cache size 0 max 16384 2024-09-12T01:59:37.796 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": { 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "d12cb9d1-9e29-4c88-ab5a-fba1913de942": { 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/", 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "tag": "d12cb9d1-9e29-4c88-ab5a-fba1913de942", 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: "options": "recursive,force" 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:37.797 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 msgr2=0x7f05580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 0x7f05580a50c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0560031f80 tx=0x7f0560009800 comp rx=0 tx=0).stop 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 msgr2=0x7f05680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05680744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e9f0 tx=0x7f055c00eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 shutdown_connections 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0568106f20 0x7f0568074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f05580a2c00 0x7f05580a50c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05681027a0 0x7f0568074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 --2- 172.21.15.39:0/1088187655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568101df0 0x7f05680744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:37.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 >> 172.21.15.39:0/1088187655 conn(0x7f05680fd8f0 msgr2=0x7f05680fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:37.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 shutdown_connections 2024-09-12T01:59:37.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:37.792+0000 7f056ec0f640 1 -- 172.21.15.39:0/1088187655 wait complete. 2024-09-12T01:59:38.872 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:38 smithi039 ceph-mon[31204]: pgmap v419: 97 pgs: 97 active+clean; 45 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 767 op/s 2024-09-12T01:59:38.879 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:38.910 INFO:tasks.cephfs.filesystem:scrub status for tag:d12cb9d1-9e29-4c88-ab5a-fba1913de942 - {'path': '/', 'tag': 'd12cb9d1-9e29-4c88-ab5a-fba1913de942', 'options': 'recursive,force'} 2024-09-12T01:59:39.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:38 smithi172 ceph-mon[35073]: pgmap v419: 97 pgs: 97 active+clean; 45 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 767 op/s 2024-09-12T01:59:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:38 smithi044 ceph-mon[35259]: pgmap v419: 97 pgs: 97 active+clean; 45 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 767 op/s 2024-09-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 -- 172.21.15.39:0/2375156766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc100a70 msgr2=0x7fdbfc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 --2- 172.21.15.39:0/2375156766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc100a70 0x7fdbfc100ed0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009930 tx=0x7fdbe802a420 comp rx=0 tx=0).stop 2024-09-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 -- 172.21.15.39:0/2375156766 shutdown_connections 2024-09-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 --2- 172.21.15.39:0/2375156766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc101410 0x7fdbfc10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 --2- 172.21.15.39:0/2375156766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc100a70 0x7fdbfc100ed0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 --2- 172.21.15.39:0/2375156766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc106a70 0x7fdbfc106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 -- 172.21.15.39:0/2375156766 >> 172.21.15.39:0/2375156766 conn(0x7fdbfc0fc790 msgr2=0x7fdbfc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:39.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 -- 172.21.15.39:0/2375156766 shutdown_connections 2024-09-12T01:59:39.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.381+0000 7fdc02d65640 1 -- 172.21.15.39:0/2375156766 wait complete. 2024-09-12T01:59:39.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 Processor -- start 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 -- start start 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 0x7fdbfc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc110e70 con 0x7fdbfc101410 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc110cf0 con 0x7fdbfc100a70 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc02d65640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc110ff0 con 0x7fdbfc106a70 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51896/0 (socket says 172.21.15.39:51896) 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55334/0 (socket says 172.21.15.39:55334) 2024-09-12T01:59:39.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc00b01640 1 -- 172.21.15.39:0/1988424909 learned_addr learned my addr 172.21.15.39:0/1988424909 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.382+0000 7fdc01302640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 0x7fdbfc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 -- 172.21.15.39:0/1988424909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 msgr2=0x7fdbfc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 0x7fdbfc19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 -- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 msgr2=0x7fdbfc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 -- 172.21.15.39:0/1988424909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbfc19d3a0 con 0x7fdbfc100a70 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc01302640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 0x7fdbfc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc00b01640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000e9f0 tx=0x7fdbf000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdbf9ffb640 1 -- 172.21.15.39:0/1988424909 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000cd80 con 0x7fdbfc100a70 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbfc19d690 con 0x7fdbfc100a70 2024-09-12T01:59:39.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdbf9ffb640 1 -- 172.21.15.39:0/1988424909 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf0010910 con 0x7fdbfc100a70 2024-09-12T01:59:39.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdbf9ffb640 1 -- 172.21.15.39:0/1988424909 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00188f0 con 0x7fdbfc100a70 2024-09-12T01:59:39.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.383+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbfc1a4f70 con 0x7fdbfc100a70 2024-09-12T01:59:39.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.386+0000 7fdbf9ffb640 1 -- 172.21.15.39:0/1988424909 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdbf0010ac0 con 0x7fdbfc100a70 2024-09-12T01:59:39.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.386+0000 7fdbf9ffb640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 0x7fdbec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 Processor -- start 2024-09-12T01:59:39.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 -- start start 2024-09-12T01:59:39.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdbf9ffb640 1 -- 172.21.15.39:0/1988424909 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdbf00cf3a0 con 0x7fdbfc100a70 2024-09-12T01:59:39.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 0x7fdbec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ee080 0x5590176f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5590176532a0 con 0x5590176ed760 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590175fab10 con 0x5590176f8940 2024-09-12T01:59:39.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc0513e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55901764f260 con 0x5590176ee080 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc01302640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ee080 0x5590176f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55338/0 (socket says 172.21.15.39:55338) 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc01302640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51908/0 (socket says 172.21.15.39:51908) 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.387+0000 7fdc00b01640 1 -- 172.21.15.39:0/3911704608 learned_addr learned my addr 172.21.15.39:0/3911704608 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 -- 172.21.15.39:0/3911704608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ee080 msgr2=0x5590176f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ee080 0x5590176f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 -- 172.21.15.39:0/3911704608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 msgr2=0x5590176fad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 -- 172.21.15.39:0/3911704608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590173c4b90 con 0x5590176ed760 2024-09-12T01:59:39.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc01302640 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 0x7fdbec0a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009900 tx=0x7fdbe80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdbf009bbf0 tx=0x7fdbf009bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f46869fa149392c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdbe6ffd640 1 -- 172.21.15.39:0/3911704608 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00b2020 con 0x5590176ed760 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdbe6ffd640 1 -- 172.21.15.39:0/3911704608 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf00a4820 con 0x5590176ed760 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.388+0000 7fdbe6ffd640 1 -- 172.21.15.39:0/3911704608 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00979b0 con 0x5590176ed760 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 -- 172.21.15.39:0/3911704608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 msgr2=0x5590176edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdbf009bbf0 tx=0x7fdbf009bb60 comp rx=0 tx=0).stop 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 -- 172.21.15.39:0/3911704608 shutdown_connections 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176f8940 0x5590176fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ee080 0x5590176f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3911704608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x5590176edb40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 -- 172.21.15.39:0/3911704608 >> 172.21.15.39:0/3911704608 conn(0x5590176e9cf0 msgr2=0x5590176ea0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 -- 172.21.15.39:0/3911704608 shutdown_connections 2024-09-12T01:59:39.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.389+0000 7fdc0513e740 1 -- 172.21.15.39:0/3911704608 wait complete. 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 -- start start 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 Processor -- start 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ee080 0x5590176f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5590176fb510 con 0x5590176ee080 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590175db6e0 con 0x5590176ed760 2024-09-12T01:59:39.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5590176fb690 con 0x5590176f8940 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51922/0 (socket says 172.21.15.39:51922) 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc00b01640 1 -- 172.21.15.39:0/2942909230 learned_addr learned my addr 172.21.15.39:0/2942909230 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ee080 0x5590176f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.390+0000 7fdc0513e740 10 client.0 _ll_register_callbacks cb 0x5590175ffa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc01302640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 -- 172.21.15.39:0/2942909230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 msgr2=0x5590176f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 -- 172.21.15.39:0/2942909230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ee080 msgr2=0x5590176f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ee080 0x5590176f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 -- 172.21.15.39:0/2942909230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559017708dc0 con 0x5590176ed760 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00a42f0 tx=0x7fdbf009b0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a755fb855ea88a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdbdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:39.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00b8070 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdbf00ba2c0 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf00a4820 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdbf00b2070 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc0513e740 10 client.25670 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.391+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55901770b710 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf00aa030 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdbf0018a90 con 0x5590176ed760 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 10 client.25670 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 10 client.25670 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 20 client.25670 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017705b00 0x559017707f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 4 client.25670 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdbf00a4820 con 0x559017705b00 2024-09-12T01:59:39.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017705b00 0x559017707f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017705b00 0x559017707f80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6beb8943b954eef4 server_cookie=dcdf3b6c93f3678f in_seq=0 out_seq=0 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.392+0000 7fdbdbfff640 10 client.25670 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2942909230 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdbf00a4820 con 0x559017705b00 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdbdbfff640 10 client.25670 handle_command_reply: tid=0 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 client.25670 shutdown 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 msgr2=0x5590176f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00a42f0 tx=0x7fdbf009b0b0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 shutdown_connections 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017705b00 0x559017707f80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ee080 0x5590176f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2942909230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ed760 0x5590176f57d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdbdbfff640 0 client.25670 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.393+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 >> 172.21.15.39:0/2942909230 conn(0x5590176e9cf0 msgr2=0x5590176ef9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:39.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.394+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 shutdown_connections 2024-09-12T01:59:39.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.394+0000 7fdc0513e740 1 -- 172.21.15.39:0/2942909230 wait complete. 2024-09-12T01:59:39.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.394+0000 7fdc0513e740 20 client.25670 trim_cache size 0 max 16384 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.412+0000 7fdc0513e740 1 Processor -- start 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.412+0000 7fdc0513e740 1 -- start start 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x559017710910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176f8940 0x559017710e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc1adca0 con 0x5590176f8940 2024-09-12T01:59:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc072030 con 0x5590176ee080 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc0513e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc06fe80 con 0x5590176ed760 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc01302640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176f8940 0x559017710e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:50284/0 (socket says 172.21.15.39:50284) 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x559017710910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 -- 172.21.15.39:0/3416232699 learned_addr learned my addr 172.21.15.39:0/3416232699 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 -- 172.21.15.39:0/3416232699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 msgr2=0x559017710910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x559017710910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 -- 172.21.15.39:0/3416232699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176f8940 msgr2=0x559017710e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176f8940 0x559017710e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdc00b01640 1 -- 172.21.15.39:0/3416232699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590176e5260 con 0x5590176ed760 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.413+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x559017710910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdc00b01640 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0098630 tx=0x7fdbf00a15a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ae5fb1af5f9c40c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdbe67fc640 1 -- 172.21.15.39:0/3416232699 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf008a030 con 0x5590176ed760 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdbe67fc640 1 -- 172.21.15.39:0/3416232699 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf00a4820 con 0x5590176ed760 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdbe67fc640 1 -- 172.21.15.39:0/3416232699 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00b8050 con 0x5590176ed760 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdc0513e740 1 -- 172.21.15.39:0/3416232699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 msgr2=0x5590176e8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.414+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0098630 tx=0x7fdbf00a15a0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 -- 172.21.15.39:0/3416232699 shutdown_connections 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176f8940 0x559017710e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x559017710910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 --2- 172.21.15.39:0/3416232699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176ed760 0x5590176e8d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 -- 172.21.15.39:0/3416232699 >> 172.21.15.39:0/3416232699 conn(0x5590176e9cf0 msgr2=0x5590176e8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 -- 172.21.15.39:0/3416232699 shutdown_connections 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 -- 172.21.15.39:0/3416232699 wait complete. 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 -- start start 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.415+0000 7fdc0513e740 1 Processor -- start 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x559017700d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176fc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc0704f0 con 0x5590176ed760 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc071960 con 0x5590176ee080 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbfc070bc0 con 0x5590176f8940 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc0513e740 10 client.0 _ll_register_callbacks cb 0x7fdbf0010810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:39.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc00b01640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x559017700d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:51934/0 (socket says 172.21.15.39:51934) 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 -- 172.21.15.39:0/2477850613 learned_addr learned my addr 172.21.15.39:0/2477850613 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc01302640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 -- 172.21.15.39:0/2477850613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 msgr2=0x5590176fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176fc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 -- 172.21.15.39:0/2477850613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 msgr2=0x559017700d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x559017700d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdbfbfff640 1 -- 172.21.15.39:0/2477850613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590176f05d0 con 0x5590176ee080 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x559017700d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.416+0000 7fdc01302640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbfbfff640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe802a940 tx=0x7fdbe8040040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c2493ff3a53723 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T01:59:39.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8035040 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdbe80038b0 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf00a4820 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdbe8003ab0 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdc0513e740 10 client.25676 fetch_fsmap learned FSMap version 27 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559017773490 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf00a4820 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.417+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fdbe803d450 con 0x5590176ee080 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 10 client.25676 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 10 client.25676 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 20 client.25676 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017773d60 0x559017776180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 4 client.25676 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T01:59:39.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x5590176609d0 con 0x559017773d60 2024-09-12T01:59:39.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017773d60 0x559017776180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:39.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdbdbfff640 10 client.25676 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:39.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:39.418+0000 7fdc00b01640 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017773d60 0x559017776180 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74df430907d8bbba server_cookie=da8c599b7e6fea1d in_seq=0 out_seq=0 2024-09-12T01:59:40.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:39 smithi172 ceph-mon[35073]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:40.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:39 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:59:40.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:39 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:40.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:39.679+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:40.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:39 smithi039 ceph-mon[31204]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:40.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:39 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:59:40.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:39 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:40.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:39 smithi044 ceph-mon[35259]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:40.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:39 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] up:active 2024-09-12T01:59:40.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:39 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:40.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdbdbfff640 1 -- 172.21.15.39:0/2477850613 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5590176609d0 con 0x559017773d60 2024-09-12T01:59:40.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdbdbfff640 10 client.25676 handle_command_reply: tid=0 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 client.25676 shutdown 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 msgr2=0x5590176fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe802a940 tx=0x7fdbe8040040 comp rx=0 tx=0).stop 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 shutdown_connections 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x559017773d60 0x559017776180 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590176f8940 0x5590176fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590176ee080 0x5590176fc0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdbdbfff640 0 client.25676 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 --2- 172.21.15.39:0/2477850613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590176ed760 0x559017700d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 >> 172.21.15.39:0/2477850613 conn(0x5590176e9cf0 msgr2=0x5590176e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 shutdown_connections 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 1 -- 172.21.15.39:0/2477850613 wait complete. 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.621+0000 7fdc0513e740 20 client.25676 trim_cache size 0 max 16384 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 28, 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 10, 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "1156ee8c": { 2024-09-12T01:59:40.623 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 10, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 144.7, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T01:59:40.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T01:59:40.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 msgr2=0x7fdbec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 0x7fdbec0a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009900 tx=0x7fdbe80315b0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 msgr2=0x7fdbfc1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000e9f0 tx=0x7fdbf000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 shutdown_connections 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdbec0a2b80 0x7fdbec0a5040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbfc106a70 0x7fdbfc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbfc101410 0x7fdbfc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 --2- 172.21.15.39:0/1988424909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbfc100a70 0x7fdbfc1983f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 >> 172.21.15.39:0/1988424909 conn(0x7fdbfc0fc790 msgr2=0x7fdbfc06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 shutdown_connections 2024-09-12T01:59:40.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:40.622+0000 7fdc02d65640 1 -- 172.21.15.39:0/1988424909 wait complete. 2024-09-12T01:59:40.912 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:40 smithi039 ceph-mon[31204]: pgmap v420: 97 pgs: 97 active+clean; 48 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.21k op/s 2024-09-12T01:59:41.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:40 smithi172 ceph-mon[35073]: pgmap v420: 97 pgs: 97 active+clean; 48 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.21k op/s 2024-09-12T01:59:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:40 smithi044 ceph-mon[35259]: pgmap v420: 97 pgs: 97 active+clean; 48 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 1.21k op/s 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.233+0000 7f2cc17b7640 1 -- 172.21.15.39:0/30159487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc102610 msgr2=0x7f2cbc108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.233+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/30159487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc102610 0x7f2cbc108ea0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb402a410 comp rx=0 tx=0).stop 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 -- 172.21.15.39:0/30159487 shutdown_connections 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/30159487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc102610 0x7f2cbc108ea0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/30159487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc101c50 0x7f2cbc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/30159487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc100a60 0x7f2cbc100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 -- 172.21.15.39:0/30159487 >> 172.21.15.39:0/30159487 conn(0x7f2cbc0fc1e0 msgr2=0x7f2cbc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 -- 172.21.15.39:0/30159487 shutdown_connections 2024-09-12T01:59:41.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 -- 172.21.15.39:0/30159487 wait complete. 2024-09-12T01:59:41.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.234+0000 7f2cc17b7640 1 Processor -- start 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 -- start start 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc100a60 0x7f2cbc197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc102610 0x7f2cbc19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc10c6e0 con 0x7f2cbc101c50 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc10c560 con 0x7f2cbc100a60 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cc17b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc10c860 con 0x7f2cbc102610 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55386/0 (socket says 172.21.15.39:55386) 2024-09-12T01:59:41.237 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 -- 172.21.15.39:0/2295665891 learned_addr learned my addr 172.21.15.39:0/2295665891 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc100a60 0x7f2cbc197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc102610 0x7f2cbc19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 -- 172.21.15.39:0/2295665891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc102610 msgr2=0x7f2cbc19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc102610 0x7f2cbc19f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 -- 172.21.15.39:0/2295665891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc100a60 msgr2=0x7f2cbc197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc100a60 0x7f2cbc197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 -- 172.21.15.39:0/2295665891 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc19f9d0 con 0x7f2cbc101c50 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.235+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000e9f0 tx=0x7f2cb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.236+0000 7f2ca3fff640 1 -- 172.21.15.39:0/2295665891 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000cd80 con 0x7f2cbc101c50 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.236+0000 7f2ca3fff640 1 -- 172.21.15.39:0/2295665891 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb0010910 con 0x7f2cbc101c50 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.236+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc19fcc0 con 0x7f2cbc101c50 2024-09-12T01:59:41.238 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.236+0000 7f2ca3fff640 1 -- 172.21.15.39:0/2295665891 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0018990 con 0x7f2cbc101c50 2024-09-12T01:59:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.236+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc1a01c0 con 0x7f2cbc101c50 2024-09-12T01:59:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 Processor -- start 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 -- start start 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2ca3fff640 1 -- 172.21.15.39:0/2295665891 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2cb0010ac0 con 0x7f2cbc101c50 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a868370 0x55976a86a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55976a7c62f0 con 0x55976a8632e0 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55976a76e270 con 0x55976a868370 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cc462b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55976a7c22b0 con 0x55976a8629a0 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55390/0 (socket says 172.21.15.39:55390) 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2155568423 learned_addr learned my addr 172.21.15.39:0/2155568423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.239+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a868370 0x55976a86a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2155568423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 msgr2=0x55976a862da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2155568423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a868370 msgr2=0x55976a86a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a868370 0x55976a86a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2155568423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976a76d340 con 0x55976a8632e0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2ca3fff640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009fd0 tx=0x7f2cac0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1ead0a4978fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2ca3fff640 1 -- 172.21.15.39:0/2295665891 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2cb00cf3f0 con 0x7f2cbc101c50 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2ca17fa640 1 -- 172.21.15.39:0/2155568423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac003970 con 0x55976a8632e0 2024-09-12T01:59:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2ca17fa640 1 -- 172.21.15.39:0/2155568423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac004020 con 0x55976a8632e0 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.240+0000 7f2ca17fa640 1 -- 172.21.15.39:0/2155568423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00f910 con 0x55976a8632e0 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 -- 172.21.15.39:0/2155568423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 msgr2=0x55976a867da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009fd0 tx=0x7f2cac0118d0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4006010 tx=0x7f2cb40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 -- 172.21.15.39:0/2155568423 shutdown_connections 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a868370 0x55976a86a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8632e0 0x55976a867da0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2155568423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 -- 172.21.15.39:0/2155568423 >> 172.21.15.39:0/2155568423 conn(0x55976a85e010 msgr2=0x55976a85e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 -- 172.21.15.39:0/2155568423 shutdown_connections 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.241+0000 7f2cc462b740 1 -- 172.21.15.39:0/2155568423 wait complete. 2024-09-12T01:59:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 -- start start 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 Processor -- start 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8629a0 0x55976a86cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 0x55976a86d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55976a86b340 con 0x55976a868370 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55976a74f290 con 0x55976a8629a0 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55976a86b4c0 con 0x55976a8632e0 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cc462b740 10 client.0 _ll_register_callbacks cb 0x55976a780140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55396/0 (socket says 172.21.15.39:55396) 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/3092966678 learned_addr learned my addr 172.21.15.39:0/3092966678 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 0x55976a86d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8629a0 0x55976a86cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/3092966678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 msgr2=0x55976a86d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 0x55976a86d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8629a0 msgr2=0x55976a86cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8629a0 0x55976a86cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/3092966678 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976a4d9210 con 0x55976a868370 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.242+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 0x55976a86d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3966593df9cd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb404e070 con 0x55976a868370 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2cb4003a00 con 0x55976a868370 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cac004020 con 0x55976a868370 2024-09-12T01:59:41.248 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cb405a050 con 0x55976a868370 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cc462b740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55976a5a5620 con 0x55976a868370 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac004020 con 0x55976a868370 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2cb404aca0 con 0x55976a868370 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cc462b740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.243+0000 7f2cc462b740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cc462b740 20 client.16107 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8787d0 0x55976a87ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cc462b740 4 client.16107 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55976a7d3a20 con 0x55976a8787d0 2024-09-12T01:59:41.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8787d0 0x55976a87ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2c9eff5640 10 client.16107 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.244+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8787d0 0x55976a87ac50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c87facc54d88ba server_cookie=b40e2e07cdaa2c32 in_seq=0 out_seq=0 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2c9eff5640 1 -- 172.21.15.39:0/3092966678 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55976a7d3a20 con 0x55976a8787d0 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2c9eff5640 10 client.16107 handle_command_reply: tid=0 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 client.16107 shutdown 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 msgr2=0x55976a8740c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb4009260 comp rx=0 tx=0).stop 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 shutdown_connections 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8787d0 0x55976a87ac50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a8740c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8632e0 0x55976a86d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 --2- 172.21.15.39:0/3092966678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8629a0 0x55976a86cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2c9eff5640 0 client.16107 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 >> 172.21.15.39:0/3092966678 conn(0x55976a85e010 msgr2=0x55976a85f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 shutdown_connections 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 1 -- 172.21.15.39:0/3092966678 wait complete. 2024-09-12T01:59:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.245+0000 7f2cc462b740 20 client.16107 trim_cache size 0 max 16384 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 Processor -- start 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 -- start start 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a874080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1ab880 con 0x55976a868370 2024-09-12T01:59:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1a9150 con 0x55976a8632e0 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cc462b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1a6fa0 con 0x55976a8629a0 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cbb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55398/0 (socket says 172.21.15.39:55398) 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.260+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/1482229901 learned_addr learned my addr 172.21.15.39:0/1482229901 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a874080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/1482229901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 msgr2=0x55976a862d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/1482229901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 msgr2=0x55976a874080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a874080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 -- 172.21.15.39:0/1482229901 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976a863f70 con 0x55976a868370 2024-09-12T01:59:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2cbb7fe640 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4031440 tx=0x7f2cb4031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e26dc769a115d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2ca0ff9640 1 -- 172.21.15.39:0/1482229901 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb404e040 con 0x55976a868370 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2ca0ff9640 1 -- 172.21.15.39:0/1482229901 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb403d8c0 con 0x55976a868370 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.261+0000 7f2ca0ff9640 1 -- 172.21.15.39:0/1482229901 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4035040 con 0x55976a868370 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- 172.21.15.39:0/1482229901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 msgr2=0x55976a85eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4031440 tx=0x7f2cb4031b50 comp rx=0 tx=0).stop 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- 172.21.15.39:0/1482229901 shutdown_connections 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a868370 0x55976a85eec0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a874080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- 172.21.15.39:0/1482229901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a8629a0 0x55976a862d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- 172.21.15.39:0/1482229901 >> 172.21.15.39:0/1482229901 conn(0x55976a85e010 msgr2=0x55976a86cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- 172.21.15.39:0/1482229901 shutdown_connections 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- 172.21.15.39:0/1482229901 wait complete. 2024-09-12T01:59:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- start start 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 Processor -- start 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a871b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a868370 0x55976a872ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1a7610 con 0x55976a8629a0 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1a8a80 con 0x55976a8632e0 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc1a7ce0 con 0x55976a868370 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cc462b740 10 client.0 _ll_register_callbacks cb 0x7f2cb4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.262+0000 7f2cbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55404/0 (socket says 172.21.15.39:55404) 2024-09-12T01:59:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2339357054 learned_addr learned my addr 172.21.15.39:0/2339357054 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a871b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2339357054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a868370 msgr2=0x55976a872ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a868370 0x55976a872ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 msgr2=0x55976a871b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a871b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 -- 172.21.15.39:0/2339357054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976a8731b0 con 0x55976a8629a0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cbaffd640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01b040 tx=0x7f2cac004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d85d0ebe29ea5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2c9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac033060 con 0x55976a8629a0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2cac016040 con 0x55976a8629a0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cb403d8c0 con 0x55976a8629a0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cac004a00 con 0x55976a8629a0 2024-09-12T01:59:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cc462b740 10 client.16113 fetch_fsmap learned FSMap version 29 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55976a8e3530 con 0x55976a8629a0 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.263+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb403d8c0 con 0x55976a8629a0 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2cac00f5a0 con 0x55976a8629a0 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 10 client.16113 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 20 client.16113 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8e3dd0 0x55976a8e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 4 client.16113 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55976a868130 con 0x55976a8e3dd0 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8e3dd0 0x55976a8e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2c9eff5640 10 client.16113 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.264+0000 7f2cba7fc640 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8e3dd0 0x55976a8e61f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b16f46a33b69abb server_cookie=59961a1d34c20785 in_seq=0 out_seq=0 2024-09-12T01:59:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2c9eff5640 1 -- 172.21.15.39:0/2339357054 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55976a868130 con 0x55976a8e3dd0 2024-09-12T01:59:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2c9eff5640 10 client.16113 handle_command_reply: tid=0 2024-09-12T01:59:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 client.16113 shutdown 2024-09-12T01:59:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 msgr2=0x55976a871650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01b040 tx=0x7f2cac004890 comp rx=0 tx=0).stop 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 shutdown_connections 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55976a8e3dd0 0x55976a8e61f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55976a868370 0x55976a872ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55976a8632e0 0x55976a871b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 --2- 172.21.15.39:0/2339357054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55976a8629a0 0x55976a871650 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2c9eff5640 0 client.16113 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 >> 172.21.15.39:0/2339357054 conn(0x55976a85e010 msgr2=0x55976a85c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 shutdown_connections 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 1 -- 172.21.15.39:0/2339357054 wait complete. 2024-09-12T01:59:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.278+0000 7f2cc462b740 20 client.16113 trim_cache size 0 max 16384 2024-09-12T01:59:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:59:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:59:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:59:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 msgr2=0x7f2ca40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4006010 tx=0x7f2cb40315b0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 msgr2=0x7f2cbc198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000e9f0 tx=0x7f2cb000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 shutdown_connections 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f2ca40a2c30 0x7f2ca40a50f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cbc102610 0x7f2cbc19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2cbc101c50 0x7f2cbc198300 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 --2- 172.21.15.39:0/2295665891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cbc100a60 0x7f2cbc197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 >> 172.21.15.39:0/2295665891 conn(0x7f2cbc0fc1e0 msgr2=0x7f2cbc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 shutdown_connections 2024-09-12T01:59:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:41.279+0000 7f2cc17b7640 1 -- 172.21.15.39:0/2295665891 wait complete. 2024-09-12T01:59:42.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:41 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:59:42.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:41 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:41 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:59:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:41 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:42.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:41 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] up:active 2024-09-12T01:59:42.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:41 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T01:59:42.534 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1156ee8c', quiesce took 8.1 seconds. Will release after: 16.6 2024-09-12T01:59:43.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:42 smithi039 ceph-mon[31204]: pgmap v421: 97 pgs: 97 active+clean; 48 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 922 op/s 2024-09-12T01:59:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:42 smithi044 ceph-mon[35259]: pgmap v421: 97 pgs: 97 active+clean; 48 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 922 op/s 2024-09-12T01:59:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:42 smithi172 ceph-mon[35073]: pgmap v421: 97 pgs: 97 active+clean; 48 MiB data, 669 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 922 op/s 2024-09-12T01:59:44.074 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:43 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:59:44.075 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:43 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:59:44.075 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:43 smithi044 ceph-mon[35259]: scrub summary: idle 2024-09-12T01:59:44.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:43 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:59:44.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:43 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:59:44.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:43 smithi039 ceph-mon[31204]: scrub summary: idle 2024-09-12T01:59:44.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:43 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:59:44.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:43 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:59:44.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:43 smithi172 ceph-mon[35073]: scrub summary: idle 2024-09-12T01:59:45.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:44 smithi039 ceph-mon[31204]: pgmap v422: 97 pgs: 97 active+clean; 50 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 995 op/s 2024-09-12T01:59:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:44 smithi044 ceph-mon[35259]: pgmap v422: 97 pgs: 97 active+clean; 50 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 995 op/s 2024-09-12T01:59:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:44 smithi172 ceph-mon[35073]: pgmap v422: 97 pgs: 97 active+clean; 50 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 995 op/s 2024-09-12T01:59:46.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:46.623+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:46 smithi039 ceph-mon[31204]: pgmap v423: 97 pgs: 97 active+clean; 48 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 805 op/s 2024-09-12T01:59:46.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:46 smithi039 ceph-mon[31204]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:46 smithi044 ceph-mon[35259]: pgmap v423: 97 pgs: 97 active+clean; 48 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 805 op/s 2024-09-12T01:59:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:46 smithi044 ceph-mon[35259]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:47.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:46 smithi172 ceph-mon[35073]: pgmap v423: 97 pgs: 97 active+clean; 48 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 805 op/s 2024-09-12T01:59:47.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:46 smithi172 ceph-mon[35073]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T01:59:49.055 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:48 smithi172 ceph-mon[35073]: pgmap v424: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 685 op/s 2024-09-12T01:59:49.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:48 smithi039 ceph-mon[31204]: pgmap v424: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 685 op/s 2024-09-12T01:59:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:48 smithi044 ceph-mon[35259]: pgmap v424: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 685 op/s 2024-09-12T01:59:51.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:50 smithi039 ceph-mon[31204]: pgmap v425: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-12T01:59:51.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:50 smithi044 ceph-mon[35259]: pgmap v425: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-12T01:59:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:50 smithi172 ceph-mon[35073]: pgmap v425: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 601 op/s 2024-09-12T01:59:53.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:52 smithi039 ceph-mon[31204]: pgmap v426: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-12T01:59:53.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:52 smithi044 ceph-mon[35259]: pgmap v426: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-12T01:59:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:52 smithi172 ceph-mon[35073]: pgmap v426: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-12T01:59:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 -- 172.21.15.39:0/2899176153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 msgr2=0x7f296c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 --2- 172.21.15.39:0/2899176153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c108e80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f295c009900 tx=0x7f295c02a410 comp rx=0 tx=0).stop 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 -- 172.21.15.39:0/2899176153 shutdown_connections 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 --2- 172.21.15.39:0/2899176153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c108e80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 --2- 172.21.15.39:0/2899176153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c101c30 0x7f296c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 --2- 172.21.15.39:0/2899176153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c100a40 0x7f296c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 -- 172.21.15.39:0/2899176153 >> 172.21.15.39:0/2899176153 conn(0x7f296c0fc1e0 msgr2=0x7f296c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 -- 172.21.15.39:0/2899176153 shutdown_connections 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.378+0000 7f29733c4640 1 -- 172.21.15.39:0/2899176153 wait complete. 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 Processor -- start 2024-09-12T01:59:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 -- start start 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 0x7f296c197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c101c30 0x7f296c198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f296c10d810 con 0x7f296c1025f0 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f296c10d690 con 0x7f296c101c30 2024-09-12T01:59:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f29733c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f296c10d990 con 0x7f296c100a40 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971961640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971961640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35326/0 (socket says 172.21.15.39:35326) 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971961640 1 -- 172.21.15.39:0/3980666135 learned_addr learned my addr 172.21.15.39:0/3980666135 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f297095f640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c101c30 0x7f296c198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971961640 1 -- 172.21.15.39:0/3980666135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 msgr2=0x7f296c197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971160640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 0x7f296c197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.379+0000 7f2971961640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 0x7f296c197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f2971961640 1 -- 172.21.15.39:0/3980666135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c101c30 msgr2=0x7f296c198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f2971961640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c101c30 0x7f296c198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f2971961640 1 -- 172.21.15.39:0/3980666135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c19f900 con 0x7f296c1025f0 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f2971160640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 0x7f296c197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f2971961640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f295c0314e0 tx=0x7f295c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f296a7fc640 1 -- 172.21.15.39:0/3980666135 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c03f030 con 0x7f296c1025f0 2024-09-12T01:59:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f296a7fc640 1 -- 172.21.15.39:0/3980666135 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f295c003ad0 con 0x7f296c1025f0 2024-09-12T01:59:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f296a7fc640 1 -- 172.21.15.39:0/3980666135 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c035070 con 0x7f296c1025f0 2024-09-12T01:59:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c19fb90 con 0x7f296c1025f0 2024-09-12T01:59:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.380+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c1a00d0 con 0x7f296c1025f0 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.383+0000 7f297623f740 1 Processor -- start 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.383+0000 7f296a7fc640 1 -- 172.21.15.39:0/3980666135 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f295c042030 con 0x7f296c1025f0 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 -- start start 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7f2e0 0x564b9ee83da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee84370 0x564b9ee86830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b9ede22f0 con 0x564b9ee7e9a0 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b9ed8a270 con 0x564b9ee7f2e0 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297623f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b9edde2b0 con 0x564b9ee84370 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35336/0 (socket says 172.21.15.39:35336) 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 -- 172.21.15.39:0/2548305040 learned_addr learned my addr 172.21.15.39:0/2548305040 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee84370 0x564b9ee86830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f2971160640 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7f2e0 0x564b9ee83da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 -- 172.21.15.39:0/2548305040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee84370 msgr2=0x564b9ee86830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee84370 0x564b9ee86830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 -- 172.21.15.39:0/2548305040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7f2e0 msgr2=0x564b9ee83da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7f2e0 0x564b9ee83da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f296a7fc640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 0x7f29540a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.384+0000 7f297095f640 1 -- 172.21.15.39:0/2548305040 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9ed89340 con 0x564b9ee7e9a0 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f296a7fc640 1 -- 172.21.15.39:0/3980666135 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f295c0ef2b0 con 0x7f296c1025f0 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f297095f640 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f296000cfa0 tx=0x7f296000c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af4ed82005887a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f297095f640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 0x7f29540a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f29537fe640 1 -- 172.21.15.39:0/2548305040 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2960018030 con 0x564b9ee7e9a0 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f29537fe640 1 -- 172.21.15.39:0/2548305040 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f296001d460 con 0x564b9ee7e9a0 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.385+0000 7f29537fe640 1 -- 172.21.15.39:0/2548305040 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296000f640 con 0x564b9ee7e9a0 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- 172.21.15.39:0/2548305040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 msgr2=0x564b9ee7eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297095f640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 0x7f29540a5170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f296000c360 tx=0x7f296000f940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f296000cfa0 tx=0x7f296000c400 comp rx=0 tx=0).stop 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- 172.21.15.39:0/2548305040 shutdown_connections 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee84370 0x564b9ee86830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7f2e0 0x564b9ee83da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 --2- 172.21.15.39:0/2548305040 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee7eda0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- 172.21.15.39:0/2548305040 >> 172.21.15.39:0/2548305040 conn(0x564b9ee7a010 msgr2=0x564b9ee7a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- 172.21.15.39:0/2548305040 shutdown_connections 2024-09-12T01:59:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- 172.21.15.39:0/2548305040 wait complete. 2024-09-12T01:59:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 -- start start 2024-09-12T01:59:54.390 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.386+0000 7f297623f740 1 Processor -- start 2024-09-12T01:59:54.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.393 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee89100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee90140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b9ee87340 con 0x564b9ee7e9a0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b9ed6b290 con 0x564b9ee84370 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b9ee874c0 con 0x564b9ee7f2e0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297623f740 10 client.0 _ll_register_callbacks cb 0x564b9ed9c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35350/0 (socket says 172.21.15.39:35350) 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 -- 172.21.15.39:0/3293404699 learned_addr learned my addr 172.21.15.39:0/3293404699 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971961640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee90140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 -- 172.21.15.39:0/3293404699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 msgr2=0x564b9ee89100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297095f640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee89100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.394 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee89100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 -- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 msgr2=0x564b9ee90140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee90140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 -- 172.21.15.39:0/3293404699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9eaf5210 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971961640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee90140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f297095f640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2971160640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2964011660 tx=0x7f2964011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe44f204c7f52eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.387+0000 7f2950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964018070 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2964004d20 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f296001d460 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f296400f940 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 10 client.16125 fetch_fsmap learned FSMap version 29 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564b9ebc1620 con 0x564b9ee7e9a0 2024-09-12T01:59:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f296001d460 con 0x564b9ee7e9a0 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2964012cc0 con 0x564b9ee7e9a0 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 10 client.16125 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 20 client.16125 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ee94a10 0x564b9ee96e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 4 client.16125 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b9edefa20 con 0x564b9ee94a10 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.388+0000 7f297095f640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ee94a10 0x564b9ee96e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.389+0000 7f297095f640 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ee94a10 0x564b9ee96e90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca0a01df85e01b0 server_cookie=c9feefd7d8703c20 in_seq=0 out_seq=0 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.389+0000 7f2950ff9640 10 client.16125 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f2950ff9640 1 -- 172.21.15.39:0/3293404699 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b9edefa20 con 0x564b9ee94a10 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f2950ff9640 10 client.16125 handle_command_reply: tid=0 2024-09-12T01:59:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 client.16125 shutdown 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 msgr2=0x564b9ee88bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2964011660 tx=0x7f2964011b20 comp rx=0 tx=0).stop 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 shutdown_connections 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ee94a10 0x564b9ee96e90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee90140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 --2- 172.21.15.39:0/3293404699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee88bc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 >> 172.21.15.39:0/3293404699 conn(0x564b9ee7a010 msgr2=0x564b9ee7b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f2950ff9640 0 client.16125 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 shutdown_connections 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 1 -- 172.21.15.39:0/3293404699 wait complete. 2024-09-12T01:59:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.390+0000 7f297623f740 20 client.16125 trim_cache size 0 max 16384 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 Processor -- start 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 -- start start 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 0x564b9ee790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee90100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1ab770 con 0x564b9ee84370 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1a9040 con 0x564b9ee7e9a0 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297623f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1a6e90 con 0x564b9ee7f2e0 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35352/0 (socket says 172.21.15.39:35352) 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 -- 172.21.15.39:0/3043616059 learned_addr learned my addr 172.21.15.39:0/3043616059 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f297095f640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971160640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 0x564b9ee790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 -- 172.21.15.39:0/3043616059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 msgr2=0x564b9ee90100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee90100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 -- 172.21.15.39:0/3043616059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 msgr2=0x564b9ee790b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 0x564b9ee790b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971961640 1 -- 172.21.15.39:0/3043616059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9ee88700 con 0x564b9ee84370 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.405+0000 7f2971160640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 0x564b9ee790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f2971961640 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f295c0b7f80 tx=0x7f295c0bb480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8adb058e375e310 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f2952ffd640 1 -- 172.21.15.39:0/3043616059 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c049050 con 0x564b9ee84370 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f2952ffd640 1 -- 172.21.15.39:0/3043616059 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f295c0bce50 con 0x564b9ee84370 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f2952ffd640 1 -- 172.21.15.39:0/3043616059 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c03bc30 con 0x564b9ee84370 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 -- 172.21.15.39:0/3043616059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 msgr2=0x564b9ee7d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f295c0b7f80 tx=0x7f295c0bb480 comp rx=0 tx=0).stop 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 -- 172.21.15.39:0/3043616059 shutdown_connections 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee84370 0x564b9ee7d410 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee90100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.413 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 --2- 172.21.15.39:0/3043616059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee7e9a0 0x564b9ee790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 -- 172.21.15.39:0/3043616059 >> 172.21.15.39:0/3043616059 conn(0x564b9ee7a010 msgr2=0x564b9ee789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 -- 172.21.15.39:0/3043616059 shutdown_connections 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.406+0000 7f297623f740 1 -- 172.21.15.39:0/3043616059 wait complete. 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 -- start start 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 Processor -- start 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee8e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee8f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1a7500 con 0x564b9ee7e9a0 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1a8970 con 0x564b9ee84370 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f296c1a7bd0 con 0x564b9ee7f2e0 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297623f740 10 client.0 _ll_register_callbacks cb 0x7f29640099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:59:54.414 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f2971160640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f2971160640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35356/0 (socket says 172.21.15.39:35356) 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f2971160640 1 -- 172.21.15.39:0/1308751720 learned_addr learned my addr 172.21.15.39:0/1308751720 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f297095f640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee8e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.407+0000 7f2971961640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee8f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 -- 172.21.15.39:0/1308751720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 msgr2=0x564b9ee8e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee8e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 -- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 msgr2=0x564b9ee8f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee8f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 -- 172.21.15.39:0/1308751720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9ee8f750 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971961640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee8f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2971160640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2964000f80 tx=0x7f2964009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a221801604971b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964033060 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f29640049c0 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f295c0bce50 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2964018040 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f297623f740 10 client.16131 fetch_fsmap learned FSMap version 29 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564b9eeffaa0 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.408+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f295c0bce50 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2964005640 con 0x564b9ee7e9a0 2024-09-12T01:59:54.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 10 client.16131 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 20 client.16131 populate_metadata read hostname 'smithi039' 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ef004e0 0x564b9ef02900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 4 client.16131 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b9ede9d70 con 0x564b9ef004e0 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297095f640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ef004e0 0x564b9ef02900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f297095f640 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ef004e0 0x564b9ef02900 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d2bc4a2747a3b8 server_cookie=71dddd7872786b60 in_seq=0 out_seq=0 2024-09-12T01:59:54.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.409+0000 7f2950ff9640 10 client.16131 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f2950ff9640 1 -- 172.21.15.39:0/1308751720 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b9ede9d70 con 0x564b9ef004e0 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f2950ff9640 10 client.16131 handle_command_reply: tid=0 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 client.16131 shutdown 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 msgr2=0x564b9ee8dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2964000f80 tx=0x7f2964009d60 comp rx=0 tx=0).stop 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 shutdown_connections 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b9ef004e0 0x564b9ef02900 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b9ee84370 0x564b9ee8f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b9ee7f2e0 0x564b9ee8e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 --2- 172.21.15.39:0/1308751720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b9ee7e9a0 0x564b9ee8dbf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f2950ff9640 0 client.16131 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T01:59:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.422+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 >> 172.21.15.39:0/1308751720 conn(0x564b9ee7a010 msgr2=0x564b9ee789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 shutdown_connections 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f297623f740 1 -- 172.21.15.39:0/1308751720 wait complete. 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f297623f740 20 client.16131 trim_cache size 0 max 16384 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T01:59:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 msgr2=0x7f29540a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 0x7f29540a5170 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f296000c360 tx=0x7f296000f940 comp rx=0 tx=0).stop 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 msgr2=0x7f296c19f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f295c0314e0 tx=0x7f295c031b60 comp rx=0 tx=0).stop 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 shutdown_connections 2024-09-12T01:59:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f296c1025f0 0x7f296c19f260 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f296c101c30 0x7f296c198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f29540a2cb0 0x7f29540a5170 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 --2- 172.21.15.39:0/3980666135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f296c100a40 0x7f296c197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 >> 172.21.15.39:0/3980666135 conn(0x7f296c0fc1e0 msgr2=0x7f296c104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 shutdown_connections 2024-09-12T01:59:54.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T01:59:54.423+0000 7f29733c4640 1 -- 172.21.15.39:0/3980666135 wait complete. 2024-09-12T01:59:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:54 smithi039 ceph-mon[31204]: pgmap v427: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 993 KiB/s wr, 132 op/s 2024-09-12T01:59:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:54 smithi044 ceph-mon[35259]: pgmap v427: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 993 KiB/s wr, 132 op/s 2024-09-12T01:59:55.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:54 smithi172 ceph-mon[35073]: pgmap v427: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 993 KiB/s wr, 132 op/s 2024-09-12T01:59:57.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:56 smithi039 ceph-mon[31204]: pgmap v428: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 206 KiB/s wr, 49 op/s 2024-09-12T01:59:57.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:56 smithi044 ceph-mon[35259]: pgmap v428: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 206 KiB/s wr, 49 op/s 2024-09-12T01:59:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:56 smithi172 ceph-mon[35073]: pgmap v428: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 206 KiB/s wr, 49 op/s 2024-09-12T01:59:59.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:59:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 01:59:58 smithi039 ceph-mon[31204]: pgmap v429: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T01:59:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 01:59:58 smithi044 ceph-mon[35259]: pgmap v429: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T01:59:59.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 01:59:58 smithi172 ceph-mon[35073]: pgmap v429: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T01:59:59.406 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:59:59.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1621826886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 msgr2=0x7fdcc410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1621826886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc410e610 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009900 tx=0x7fdcb402a480 comp rx=0 tx=0).stop 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1621826886 shutdown_connections 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1621826886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc410e610 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1621826886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4103660 0x7fdcc410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1621826886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc4102d40 0x7fdcc4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1621826886 >> 172.21.15.39:0/1621826886 conn(0x7fdcc40fc7a0 msgr2=0x7fdcc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1621826886 shutdown_connections 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.895+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1621826886 wait complete. 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 Processor -- start 2024-09-12T01:59:59.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 -- start start 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4102d40 0x7fdcc41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc4103660 0x7fdcc4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4111f70 con 0x7fdcc410c170 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4111df0 con 0x7fdcc4102d40 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc8f0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41120f0 con 0x7fdcc4103660 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35386/0 (socket says 172.21.15.39:35386) 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 -- 172.21.15.39:0/1017437933 learned_addr learned my addr 172.21.15.39:0/1017437933 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc259c640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4102d40 0x7fdcc41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 -- 172.21.15.39:0/1017437933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc4103660 msgr2=0x7fdcc4100ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:59:59.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc4103660 0x7fdcc4100ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 -- 172.21.15.39:0/1017437933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4102d40 msgr2=0x7fdcc41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4102d40 0x7fdcc41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.896+0000 7fdcc2d9d640 1 -- 172.21.15.39:0/1017437933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41a6850 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcc2d9d640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4005ab0 tx=0x7fdcb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb403f030 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcb4003ce0 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41a6ae0 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4035070 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.897+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41a7010 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.898+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc4103120 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.899+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdcb4042030 con 0x7fdcc410c170 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.900+0000 7fdcbb7fe640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.900+0000 7fdcc259c640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:59:59.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.900+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcb40efa00 con 0x7fdcc410c170 2024-09-12T01:59:59.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.900+0000 7fdcc259c640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc005fd0 tx=0x7fdcbc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:59:59.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T01:59:59.903+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdcb40bc970 con 0x7fdcc410c170 2024-09-12T02:00:00.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.115+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcc4101ed0 con 0x7fdcc410c170 2024-09-12T02:00:00.117 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:59.998+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-12T02:00:00.117 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:59.998+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-12T02:00:00.117 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:59.998+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : mds.i(mds.2): Metadata damage detected 2024-09-12T02:00:00.117 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T01:59:59.998+0000 7fa958dfd640 -1 log_channel(cluster) log [ERR] : mds.h(mds.1): Metadata damage detected 2024-09-12T02:00:00.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.116+0000 7fdcbb7fe640 1 -- 172.21.15.39:0/1017437933 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11913 (secure 0 0 0) 0x7fdcc4101ed0 con 0x7fdcc410c170 2024-09-12T02:00:00.118 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:00:00.118 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"btime":"2024-09-12T01:59:40:731312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:59:40.692742+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:00:00.118 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 29 2024-09-12T02:00:00.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 msgr2=0x7fdcb00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:00.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc005fd0 tx=0x7fdcbc009680 comp rx=0 tx=0).stop 2024-09-12T02:00:00.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 msgr2=0x7fdcc4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4005ab0 tx=0x7fdcb40042f0 comp rx=0 tx=0).stop 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 shutdown_connections 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdcc410c170 0x7fdcc4101420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdcb00a2c00 0x7fdcb00a50c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc4103660 0x7fdcc4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 --2- 172.21.15.39:0/1017437933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc4102d40 0x7fdcc41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.118+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 >> 172.21.15.39:0/1017437933 conn(0x7fdcc40fc7a0 msgr2=0x7fdcc40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.119+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 shutdown_connections 2024-09-12T02:00:00.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:00.119+0000 7fdcc8f0e640 1 -- 172.21.15.39:0/1017437933 wait complete. 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: pgmap v430: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: mds.i(mds.2): Metadata damage detected 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: mds.h(mds.1): Metadata damage detected 2024-09-12T02:00:00.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:00 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1017437933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.024 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --set-id 1156ee8c --release --await' 2024-09-12T02:00:01.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --set-id 1156ee8c --release --await 2024-09-12T02:00:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: pgmap v430: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T02:00:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-12T02:00:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-12T02:00:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: mds.i(mds.2): Metadata damage detected 2024-09-12T02:00:01.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: mds.h(mds.1): Metadata damage detected 2024-09-12T02:00:01.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:00 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1017437933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: pgmap v430: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: mds.i(mds.2): Metadata damage detected 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: mds.h(mds.1): Metadata damage detected 2024-09-12T02:00:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:00 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1017437933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:01.326 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:01.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 -- 172.21.15.39:0/1790268075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c106a80 msgr2=0x7f605c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 --2- 172.21.15.39:0/1790268075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c106a80 0x7f605c106e60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6044009930 tx=0x7f604402a440 comp rx=0 tx=0).stop 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 -- 172.21.15.39:0/1790268075 shutdown_connections 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 --2- 172.21.15.39:0/1790268075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c101420 0x7f605c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 --2- 172.21.15.39:0/1790268075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 --2- 172.21.15.39:0/1790268075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c106a80 0x7f605c106e60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 -- 172.21.15.39:0/1790268075 >> 172.21.15.39:0/1790268075 conn(0x7f605c0fc7a0 msgr2=0x7f605c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 -- 172.21.15.39:0/1790268075 shutdown_connections 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.794+0000 7f6060b77640 1 -- 172.21.15.39:0/1790268075 wait complete. 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 Processor -- start 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 -- start start 2024-09-12T02:00:01.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 0x7f605c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f605c110ec0 con 0x7f605c101420 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f605c110d40 con 0x7f605c106a80 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6060b77640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f605c111040 con 0x7f605c100a80 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6059d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6059d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35400/0 (socket says 172.21.15.39:35400) 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f6059d9b640 1 -- 172.21.15.39:0/101752941 learned_addr learned my addr 172.21.15.39:0/101752941 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.795+0000 7f605ad9d640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 0x7f605c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f605a59c640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 -- 172.21.15.39:0/101752941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 msgr2=0x7f605c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 -- 172.21.15.39:0/101752941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 msgr2=0x7f605c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 0x7f605c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 -- 172.21.15.39:0/101752941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c19f6f0 con 0x7f605c101420 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f605ad9d640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 0x7f605c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f605a59c640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6059d9b640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b450 tx=0x7f604c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f60537fe640 1 -- 172.21.15.39:0/101752941 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c015020 con 0x7f605c101420 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f60537fe640 1 -- 172.21.15.39:0/101752941 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604c011d70 con 0x7f605c101420 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f60537fe640 1 -- 172.21.15.39:0/101752941 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c00f340 con 0x7f605c101420 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c19f9e0 con 0x7f605c101420 2024-09-12T02:00:01.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.796+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c1a72c0 con 0x7f605c101420 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 Processor -- start 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 -- start start 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f60537fe640 1 -- 172.21.15.39:0/101752941 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f604c018020 con 0x7f605c101420 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20bd1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555c20b29620 con 0x555c20bc4980 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c20ad0e50 con 0x555c20bc4060 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6062f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555c20b255e0 con 0x555c20bcf240 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35402/0 (socket says 172.21.15.39:35402) 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f605a59c640 1 -- 172.21.15.39:0/1975164150 learned_addr learned my addr 172.21.15.39:0/1975164150 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.799+0000 7f6059d9b640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20bd1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 -- 172.21.15.39:0/1975164150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 msgr2=0x555c20bd1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20bd1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 -- 172.21.15.39:0/1975164150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 msgr2=0x555c20bced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 -- 172.21.15.39:0/1975164150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c20ac1d40 con 0x555c20bc4060 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605a59c640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f60537fe640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 0x7f60480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc4440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6054009f80 tx=0x7f605400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316b39a7277fd543 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f605a59c640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 0x7f60480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f60537fe640 1 -- 172.21.15.39:0/101752941 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f604c0ceb40 con 0x7f605c101420 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f6050ff9640 1 -- 172.21.15.39:0/1975164150 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054015070 con 0x555c20bc4060 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f6050ff9640 1 -- 172.21.15.39:0/1975164150 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6054011be0 con 0x555c20bc4060 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.800+0000 7f6050ff9640 1 -- 172.21.15.39:0/1975164150 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605401acd0 con 0x555c20bc4060 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- 172.21.15.39:0/1975164150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 msgr2=0x555c20bc4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f605a59c640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 0x7f60480a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60440096c0 tx=0x7f6044005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc4440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6054009f80 tx=0x7f605400f7f0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- 172.21.15.39:0/1975164150 shutdown_connections 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20bd1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4980 0x555c20bced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 --2- 172.21.15.39:0/1975164150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc4440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- 172.21.15.39:0/1975164150 >> 172.21.15.39:0/1975164150 conn(0x555c20bc05f0 msgr2=0x555c20bc09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- 172.21.15.39:0/1975164150 shutdown_connections 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- 172.21.15.39:0/1975164150 wait complete. 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.801+0000 7f6062f50740 1 -- start start 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 Processor -- start 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bcc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bcf240 0x555c20bccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555c20bd1e10 con 0x555c20bc4060 2024-09-12T02:00:01.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c20ab1f10 con 0x555c20bcf240 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555c20bd1f90 con 0x555c20bc4980 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6062f50740 10 client.0 _ll_register_callbacks cb 0x555c20ad5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35410/0 (socket says 172.21.15.39:35410) 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 -- 172.21.15.39:0/1416462356 learned_addr learned my addr 172.21.15.39:0/1416462356 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f6059d9b640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bcc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bcf240 0x555c20bccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 -- 172.21.15.39:0/1416462356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 msgr2=0x555c20bcc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bcc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 -- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bcf240 msgr2=0x555c20bccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bcf240 0x555c20bccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.802+0000 7f605a59c640 1 -- 172.21.15.39:0/1416462356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c20838580 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f605a59c640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6044009900 tx=0x7f6044009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bde02a8098de9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604404c030 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6054011be0 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6044003cd0 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6044035040 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6062f50740 10 client.16149 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c20902960 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6054011be0 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.803+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f604403c4d0 con 0x555c20bc4060 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 10 client.16149 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 10 client.16149 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:00:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 20 client.16149 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20bded70 0x555c20be11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 4 client.16149 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c20b36b90 con 0x555c20bded70 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6059d9b640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20bded70 0x555c20be11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6059d9b640 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20bded70 0x555c20be11a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1edddfe875f20f3 server_cookie=9ed62c510298b0e2 in_seq=0 out_seq=0 2024-09-12T02:00:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.804+0000 7f6041ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6041ffb640 1 -- 172.21.15.39:0/1416462356 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c20b36b90 con 0x555c20bded70 2024-09-12T02:00:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6041ffb640 10 client.16149 handle_command_reply: tid=0 2024-09-12T02:00:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 client.16149 shutdown 2024-09-12T02:00:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 msgr2=0x555c20bcc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6044009900 tx=0x7f6044009260 comp rx=0 tx=0).stop 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 shutdown_connections 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20bded70 0x555c20be11a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bcf240 0x555c20bccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bcc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6041ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 --2- 172.21.15.39:0/1416462356 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bcc0f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 >> 172.21.15.39:0/1416462356 conn(0x555c20bc05f0 msgr2=0x555c20bbf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 shutdown_connections 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.805+0000 7f6062f50740 1 -- 172.21.15.39:0/1416462356 wait complete. 2024-09-12T02:00:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.806+0000 7f6062f50740 20 client.16149 trim_cache size 0 max 16384 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 Processor -- start 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 -- start start 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bbf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1b2160 con 0x555c20bcf240 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1afa30 con 0x555c20bc4060 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6062f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1ad880 con 0x555c20bc4980 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35412/0 (socket says 172.21.15.39:35412) 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 -- 172.21.15.39:0/1673218278 learned_addr learned my addr 172.21.15.39:0/1673218278 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f6059d9b640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bbf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605a59c640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 -- 172.21.15.39:0/1673218278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 msgr2=0x555c20bbf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bbf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 -- 172.21.15.39:0/1673218278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 msgr2=0x555c20bc6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605ad9d640 1 -- 172.21.15.39:0/1673218278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c20bc5570 con 0x555c20bcf240 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.823+0000 7f605a59c640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.824+0000 7f605ad9d640 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f605401a980 tx=0x7f6054009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaafdd7cd5307e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.824+0000 7f6043fff640 1 -- 172.21.15.39:0/1673218278 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054029070 con 0x555c20bcf240 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.824+0000 7f6043fff640 1 -- 172.21.15.39:0/1673218278 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f605401a660 con 0x555c20bcf240 2024-09-12T02:00:01.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.824+0000 7f6043fff640 1 -- 172.21.15.39:0/1673218278 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054015040 con 0x555c20bcf240 2024-09-12T02:00:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- 172.21.15.39:0/1673218278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 msgr2=0x555c20be6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f605401a980 tx=0x7f6054009d00 comp rx=0 tx=0).stop 2024-09-12T02:00:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- 172.21.15.39:0/1673218278 shutdown_connections 2024-09-12T02:00:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bcf240 0x555c20be6a70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bc4980 0x555c20bbf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- 172.21.15.39:0/1673218278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4060 0x555c20bc6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- 172.21.15.39:0/1673218278 >> 172.21.15.39:0/1673218278 conn(0x555c20bc05f0 msgr2=0x555c20bbef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- 172.21.15.39:0/1673218278 shutdown_connections 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- 172.21.15.39:0/1673218278 wait complete. 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- start start 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 Processor -- start 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4980 0x555c20bd37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20c48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1adef0 con 0x555c20bc4060 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1af360 con 0x555c20bc4980 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.825+0000 7f6062f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1ae5c0 con 0x555c20bcf240 2024-09-12T02:00:01.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6062f50740 10 client.0 _ll_register_callbacks cb 0x7f6044004130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35428/0 (socket says 172.21.15.39:35428) 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 -- 172.21.15.39:0/3686647129 learned_addr learned my addr 172.21.15.39:0/3686647129 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6059d9b640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4980 0x555c20bd37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605ad9d640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20c48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 -- 172.21.15.39:0/3686647129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 msgr2=0x555c20c48a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20c48a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 -- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4980 msgr2=0x555c20bd37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4980 0x555c20bd37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 -- 172.21.15.39:0/3686647129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c20bd4040 con 0x555c20bc4060 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605ad9d640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20c48a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f605a59c640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6044009230 tx=0x7f60440315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de82e21b4ba8539 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604404c040 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6044003ed0 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.826+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f605401a660 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f604403c440 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 10 client.16155 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c20c4a090 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f605401a660 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f60440664e0 con 0x555c20bc4060 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 10 client.16155 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 10 client.16155 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 20 client.16155 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20c4a810 0x555c20c4cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 4 client.16155 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1156ee8c", "release": true, "await": true}] 2024-09-12T02:00:01.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1156ee8c", "release": true, "await": true}) -- 0x555c20b310a0 con 0x555c20c4a810 2024-09-12T02:00:01.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.827+0000 7f6059d9b640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20c4a810 0x555c20c4cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:01.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.828+0000 7f6059d9b640 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20c4a810 0x555c20c4cc50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c48e5333a5d631e server_cookie=853ee3a6b2ae55d9 in_seq=0 out_seq=0 2024-09-12T02:00:01.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.828+0000 7f6041ffb640 10 client.16155 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:01.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6041ffb640 1 -- 172.21.15.39:0/3686647129 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555c20b310a0 con 0x555c20c4a810 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6041ffb640 10 client.16155 handle_command_reply: tid=0 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 client.16155 shutdown 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 msgr2=0x555c20bd3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6044009230 tx=0x7f60440315b0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 shutdown_connections 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x555c20c4a810 0x555c20c4cc50 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c20bcf240 0x555c20c48a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c20bc4980 0x555c20bd37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 --2- 172.21.15.39:0/3686647129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555c20bc4060 0x555c20bd3270 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6041ffb640 0 client.16155 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:01.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 >> 172.21.15.39:0/3686647129 conn(0x555c20bc05f0 msgr2=0x555c20bcc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 shutdown_connections 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.980+0000 7f6062f50740 1 -- 172.21.15.39:0/3686647129 wait complete. 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6062f50740 20 client.16155 trim_cache size 0 max 16384 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 29, 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 12, 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "1156ee8c": { 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 12, 2024-09-12T02:00:01.983 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 144.7, 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:01.984 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 msgr2=0x7f60480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 0x7f60480a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60440096c0 tx=0x7f6044005bd0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 msgr2=0x7f605c19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f604c00b450 tx=0x7f604c00b910 comp rx=0 tx=0).stop 2024-09-12T02:00:01.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 shutdown_connections 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f605c106a80 0x7f605c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f605c101420 0x7f605c19ac80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f60480a2c00 0x7f60480a50c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 --2- 172.21.15.39:0/101752941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c100a80 0x7f605c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.981+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 >> 172.21.15.39:0/101752941 conn(0x7f605c0fc7a0 msgr2=0x7f605c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.982+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 shutdown_connections 2024-09-12T02:00:01.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:01.982+0000 7f6060b77640 1 -- 172.21.15.39:0/101752941 wait complete. 2024-09-12T02:00:02.879 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1156ee8c', total seconds elapsed: 28.5 2024-09-12T02:00:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:02 smithi039 ceph-mon[31204]: pgmap v431: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T02:00:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:02 smithi044 ceph-mon[35259]: pgmap v431: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T02:00:03.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:02 smithi172 ceph-mon[35073]: pgmap v431: 97 pgs: 97 active+clean; 48 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-12T02:00:04.564 INFO:tasks.workunit.client.0.smithi039.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-12T02:00:04.867 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xffcdd 2024-09-12T02:00:05.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:04 smithi039 ceph-mon[31204]: pgmap v432: 97 pgs: 97 active+clean; 47 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-09-12T02:00:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:04 smithi044 ceph-mon[35259]: pgmap v432: 97 pgs: 97 active+clean; 47 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-09-12T02:00:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:04 smithi172 ceph-mon[35073]: pgmap v432: 97 pgs: 97 active+clean; 47 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-09-12T02:00:06.273 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xffd97 2024-09-12T02:00:07.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:06 smithi039 ceph-mon[31204]: pgmap v433: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 88 op/s 2024-09-12T02:00:07.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:06 smithi044 ceph-mon[35259]: pgmap v433: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 88 op/s 2024-09-12T02:00:07.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:06 smithi172 ceph-mon[35073]: pgmap v433: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 88 op/s 2024-09-12T02:00:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 -- 172.21.15.39:0/408901556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 msgr2=0x7f0ed01072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 --2- 172.21.15.39:0/408901556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01072e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009900 tx=0x7f0ec402a410 comp rx=0 tx=0).stop 2024-09-12T02:00:07.522 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 -- 172.21.15.39:0/408901556 shutdown_connections 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 --2- 172.21.15.39:0/408901556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed0107820 0x7f0ed0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 --2- 172.21.15.39:0/408901556 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01072e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 --2- 172.21.15.39:0/408901556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed01025c0 0x7f0ed01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 -- 172.21.15.39:0/408901556 >> 172.21.15.39:0/408901556 conn(0x7f0ed00fc1e0 msgr2=0x7f0ed00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 -- 172.21.15.39:0/408901556 shutdown_connections 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 -- 172.21.15.39:0/408901556 wait complete. 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.521+0000 7f0ed532c640 1 Processor -- start 2024-09-12T02:00:07.523 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 -- start start 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 0x7f0ed0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed0107820 0x7f0ed019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed010d7f0 con 0x7f0ed0104ef0 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed010d670 con 0x7f0ed01025c0 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ed532c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed010d970 con 0x7f0ed0107820 2024-09-12T02:00:07.525 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56560/0 (socket says 172.21.15.39:56560) 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 0x7f0ed0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ece7fc640 1 -- 172.21.15.39:0/3079058811 learned_addr learned my addr 172.21.15.39:0/3079058811 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed0107820 0x7f0ed019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 -- 172.21.15.39:0/3079058811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed0107820 msgr2=0x7f0ed019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed0107820 0x7f0ed019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 -- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 msgr2=0x7f0ed01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0eceffd640 1 -- 172.21.15.39:0/3079058811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed019fa90 con 0x7f0ed01025c0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.522+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0eceffd640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 0x7f0ed0197e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000e9f0 tx=0x7f0ec000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0eb7fff640 1 -- 172.21.15.39:0/3079058811 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000ccc0 con 0x7f0ed01025c0 2024-09-12T02:00:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed019fd80 con 0x7f0ed01025c0 2024-09-12T02:00:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0eb7fff640 1 -- 172.21.15.39:0/3079058811 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec0005020 con 0x7f0ed01025c0 2024-09-12T02:00:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0eb7fff640 1 -- 172.21.15.39:0/3079058811 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00049e0 con 0x7f0ed01025c0 2024-09-12T02:00:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.523+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01a01e0 con 0x7f0ed01025c0 2024-09-12T02:00:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.525+0000 7f0eb7fff640 1 -- 172.21.15.39:0/3079058811 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0ec0005560 con 0x7f0ed01025c0 2024-09-12T02:00:07.532 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.525+0000 7f0ed80c0740 1 Processor -- start 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 -- start start 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562ee971b2f0 con 0x562ee97b82e0 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ee96c3270 con 0x562ee97bd370 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562ee97172b0 con 0x562ee97b79a0 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:59110/0 (socket says 172.21.15.39:59110) 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56576/0 (socket says 172.21.15.39:56576) 2024-09-12T02:00:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ecf7fe640 1 -- 172.21.15.39:0/1567742610 learned_addr learned my addr 172.21.15.39:0/1567742610 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eb7fff640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 0x7f0eb80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 0x7f0eb80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eb7fff640 1 -- 172.21.15.39:0/3079058811 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ec00ceff0 con 0x7f0ed01025c0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 -- 172.21.15.39:0/1567742610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 msgr2=0x562ee97b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 -- 172.21.15.39:0/1567742610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 msgr2=0x562ee97bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.526+0000 7f0eceffd640 1 -- 172.21.15.39:0/1567742610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee96c2340 con 0x562ee97b82e0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.527+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ec009b520 tx=0x7f0ec00096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ea5f2b82751d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.527+0000 7f0eb57fa640 1 -- 172.21.15.39:0/1567742610 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec001c070 con 0x562ee97b82e0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.527+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 0x7f0eb80a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8013860 tx=0x7f0ec8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.527+0000 7f0eb57fa640 1 -- 172.21.15.39:0/1567742610 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec009bf20 con 0x562ee97b82e0 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.527+0000 7f0eb57fa640 1 -- 172.21.15.39:0/1567742610 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00a4490 con 0x562ee97b82e0 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1567742610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 msgr2=0x562ee97bcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ec009b520 tx=0x7f0ec00096e0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1567742610 shutdown_connections 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97bcda0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1567742610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1567742610 >> 172.21.15.39:0/1567742610 conn(0x562ee97b3010 msgr2=0x562ee97b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1567742610 shutdown_connections 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1567742610 wait complete. 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 -- start start 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.528+0000 7f0ed80c0740 1 Processor -- start 2024-09-12T02:00:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562ee97c02e0 con 0x562ee97b82e0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ee96a4290 con 0x562ee97bd370 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562ee97c0460 con 0x562ee97b79a0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ed80c0740 10 client.0 _ll_register_callbacks cb 0x562ee96d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56588/0 (socket says 172.21.15.39:56588) 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ece7fc640 1 -- 172.21.15.39:0/1513422154 learned_addr learned my addr 172.21.15.39:0/1513422154 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 -- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 msgr2=0x562ee97c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 -- 172.21.15.39:0/1513422154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 msgr2=0x562ee97c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 -- 172.21.15.39:0/1513422154 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee942e210 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eceffd640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ec009b2f0 tx=0x7f0ec00051d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493cfc8960dcadf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.529+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec001c070 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ec0004ca0 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec009bf20 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ec00ba210 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 10 client.25582 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562ee94fa620 con 0x562ee97b79a0 2024-09-12T02:00:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec009bf20 con 0x562ee97b79a0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0ec009cb50 con 0x562ee97b79a0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 10 client.25582 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 10 client.25582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 20 client.25582 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee97cd3b0 0x562ee97cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 4 client.25582 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ee9728a20 con 0x562ee97cd3b0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.530+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee97cd3b0 0x562ee97cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.531+0000 7f0eb2ff5640 10 client.25582 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.531+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee97cd3b0 0x562ee97cf7a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d496a5218a0f4abc server_cookie=d67991ab34b24a90 in_seq=0 out_seq=0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.531+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/1513422154 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ee9728a20 con 0x562ee97cd3b0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.531+0000 7f0eb2ff5640 10 client.25582 handle_command_reply: tid=0 2024-09-12T02:00:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.531+0000 7f0ed80c0740 1 client.25582 shutdown 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 msgr2=0x562ee97c1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ec009b2f0 tx=0x7f0ec00051d0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 shutdown_connections 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee97cd3b0 0x562ee97cf7a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0eb2ff5640 0 client.25582 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/1513422154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c1b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 >> 172.21.15.39:0/1513422154 conn(0x562ee97b3010 msgr2=0x562ee97b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 shutdown_connections 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 1 -- 172.21.15.39:0/1513422154 wait complete. 2024-09-12T02:00:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.532+0000 7f0ed80c0740 20 client.25582 trim_cache size 0 max 16384 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 Processor -- start 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 -- start start 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a95f0 con 0x562ee97b82e0 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a6ec0 con 0x562ee97bd370 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a4d10 con 0x562ee97b79a0 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56594/0 (socket says 172.21.15.39:56594) 2024-09-12T02:00:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 -- 172.21.15.39:0/916229945 learned_addr learned my addr 172.21.15.39:0/916229945 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ecf7fe640 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0eceffd640 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 -- 172.21.15.39:0/916229945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 msgr2=0x562ee97b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 -- 172.21.15.39:0/916229945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 msgr2=0x562ee97d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 -- 172.21.15.39:0/916229945 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee97b2e30 con 0x562ee97b82e0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.548+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4031610 tx=0x7f0ec4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c7259a2bd2663e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0eb4ff9640 1 -- 172.21.15.39:0/916229945 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4035040 con 0x562ee97b82e0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0eb4ff9640 1 -- 172.21.15.39:0/916229945 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4031dd0 con 0x562ee97b82e0 2024-09-12T02:00:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0eb4ff9640 1 -- 172.21.15.39:0/916229945 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4004a00 con 0x562ee97b82e0 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0ed80c0740 1 -- 172.21.15.39:0/916229945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 msgr2=0x562ee97c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4031610 tx=0x7f0ec4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0ed80c0740 1 -- 172.21.15.39:0/916229945 shutdown_connections 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97bd370 0x562ee97d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.549+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97b82e0 0x562ee97c8fd0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/916229945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- 172.21.15.39:0/916229945 >> 172.21.15.39:0/916229945 conn(0x562ee97b3010 msgr2=0x562ee97b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- 172.21.15.39:0/916229945 shutdown_connections 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- 172.21.15.39:0/916229945 wait complete. 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- start start 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 Processor -- start 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97bd370 0x562ee97c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a5380 con 0x562ee97bd370 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a67f0 con 0x562ee97b82e0 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01a5a50 con 0x562ee97b79a0 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97bd370 0x562ee97c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ece7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:58480/0 (socket says 172.21.15.39:58480) 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ece7fc640 1 -- 172.21.15.39:0/87740287 learned_addr learned my addr 172.21.15.39:0/87740287 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0eceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:59142/0 (socket says 172.21.15.39:59142) 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.550+0000 7f0ed80c0740 10 client.0 _ll_register_callbacks cb 0x7f0ec0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 -- 172.21.15.39:0/87740287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 msgr2=0x562ee97c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 -- 172.21.15.39:0/87740287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97bd370 msgr2=0x562ee97c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97bd370 0x562ee97c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 -- 172.21.15.39:0/87740287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee97c8730 con 0x562ee97b82e0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ece7fc640 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009850 tx=0x7f0ec402abb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=173342b2eff33a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0eb2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4057030 con 0x562ee97b82e0 2024-09-12T02:00:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ec40318f0 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec4031dd0 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.551+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ec4035040 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 10 client.25742 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562ee9840b60 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4031af0 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0ec4051040 con 0x562ee97b82e0 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 10 client.25742 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 10 client.25742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 20 client.25742 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee9841520 0x562ee9843940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 4 client.25742 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0ec4031dd0 con 0x562ee9841520 2024-09-12T02:00:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0eceffd640 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee9841520 0x562ee9843940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0eceffd640 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee9841520 0x562ee9843940 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247e5381b14010aa server_cookie=b2298549bf382955 in_seq=0 out_seq=0 2024-09-12T02:00:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.552+0000 7f0eb2ff5640 10 client.25742 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0eb2ff5640 1 -- 172.21.15.39:0/87740287 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0ec4031dd0 con 0x562ee9841520 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0eb2ff5640 10 client.25742 handle_command_reply: tid=0 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 client.25742 shutdown 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 msgr2=0x562ee97c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009850 tx=0x7f0ec402abb0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 shutdown_connections 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x562ee9841520 0x562ee9843940 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562ee97bd370 0x562ee97c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ee97b82e0 0x562ee97c7110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0eb2ff5640 0 client.25742 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 --2- 172.21.15.39:0/87740287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ee97b79a0 0x562ee97c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.565+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 >> 172.21.15.39:0/87740287 conn(0x562ee97b3010 msgr2=0x562ee97b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 shutdown_connections 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed80c0740 1 -- 172.21.15.39:0/87740287 wait complete. 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed80c0740 20 client.25742 trim_cache size 0 max 16384 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:00:07.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 msgr2=0x7f0eb80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 0x7f0eb80a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8013860 tx=0x7f0ec8004ab0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 msgr2=0x7f0ed0197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 0x7f0ed0197e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000e9f0 tx=0x7f0ec000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 shutdown_connections 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0eb80a2c30 0x7f0eb80a50f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed0107820 0x7f0ed019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed0104ef0 0x7f0ed01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 --2- 172.21.15.39:0/3079058811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed01025c0 0x7f0ed0197e70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 >> 172.21.15.39:0/3079058811 conn(0x7f0ed00fc1e0 msgr2=0x7f0ed0103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 shutdown_connections 2024-09-12T02:00:07.570 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:07.566+0000 7f0ed532c640 1 -- 172.21.15.39:0/3079058811 wait complete. 2024-09-12T02:00:08.911 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T02:00:09.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:08 smithi039 ceph-mon[31204]: pgmap v434: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 86 op/s 2024-09-12T02:00:09.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:08 smithi044 ceph-mon[35259]: pgmap v434: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 86 op/s 2024-09-12T02:00:09.194 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:09.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:08 smithi172 ceph-mon[35073]: pgmap v434: 97 pgs: 97 active+clean; 48 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 535 KiB/s wr, 86 op/s 2024-09-12T02:00:09.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 -- 172.21.15.39:0/1775480041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 msgr2=0x7f4cb0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/1775480041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb0101200 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009900 tx=0x7f4ca402a480 comp rx=0 tx=0).stop 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 -- 172.21.15.39:0/1775480041 shutdown_connections 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/1775480041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/1775480041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/1775480041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb0101200 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 -- 172.21.15.39:0/1775480041 >> 172.21.15.39:0/1775480041 conn(0x7f4cb00fc7d0 msgr2=0x7f4cb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 -- 172.21.15.39:0/1775480041 shutdown_connections 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.708+0000 7f4cb71b9640 1 -- 172.21.15.39:0/1775480041 wait complete. 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 Processor -- start 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 -- start start 2024-09-12T02:00:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0110f80 con 0x7f4cb0100e20 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0110e00 con 0x7f4cb0102ef0 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb71b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0111100 con 0x7f4cb0102570 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56618/0 (socket says 172.21.15.39:56618) 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb4f55640 1 -- 172.21.15.39:0/4261018251 learned_addr learned my addr 172.21.15.39:0/4261018251 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.709+0000 7f4caffff640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 -- 172.21.15.39:0/4261018251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 msgr2=0x7f4cb019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 -- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 msgr2=0x7f4cb019f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 -- 172.21.15.39:0/4261018251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb019af80 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4caffff640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb019a800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009fd0 tx=0x7f4ca800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cadffb640 1 -- 172.21.15.39:0/4261018251 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800ce20 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cadffb640 1 -- 172.21.15.39:0/4261018251 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca8005020 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb019b270 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cadffb640 1 -- 172.21.15.39:0/4261018251 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8010720 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.710+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb01a7210 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cadffb640 1 -- 172.21.15.39:0/4261018251 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4ca8005540 con 0x7f4cb0102ef0 2024-09-12T02:00:09.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 Processor -- start 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 -- start start 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc63880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc70a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55733cbc92e0 con 0x55733cc6e680 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55733cb70ce0 con 0x55733cc63dc0 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb9592740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55733cbc52a0 con 0x55733cc634a0 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4caffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc70a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:58512/0 (socket says 172.21.15.39:58512) 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cb4f55640 1 -- 172.21.15.39:0/3061472513 learned_addr learned my addr 172.21.15.39:0/3061472513 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4caffff640 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc63880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.714+0000 7f4cadffb640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 0x7f4ca00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 -- 172.21.15.39:0/3061472513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 msgr2=0x55733cc63880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc63880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 -- 172.21.15.39:0/3061472513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 msgr2=0x55733cc70a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc70a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 -- 172.21.15.39:0/3061472513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55733cb55440 con 0x55733cc63dc0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cadffb640 1 -- 172.21.15.39:0/4261018251 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ca80cf6b0 con 0x7f4cb0102ef0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 0x7f4ca00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000c00 tx=0x7f4ca4005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90feeba25c46a4bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4c9affd640 1 -- 172.21.15.39:0/3061472513 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4040070 con 0x55733cc63dc0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4c9affd640 1 -- 172.21.15.39:0/3061472513 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca4003cd0 con 0x55733cc63dc0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.715+0000 7f4c9affd640 1 -- 172.21.15.39:0/3061472513 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4035040 con 0x55733cc63dc0 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 -- 172.21.15.39:0/3061472513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 msgr2=0x55733cc6e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb5756640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 0x7f4ca00a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c760 tx=0x7f4ca8005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4000c00 tx=0x7f4ca4005e80 comp rx=0 tx=0).stop 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 -- 172.21.15.39:0/3061472513 shutdown_connections 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc70a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc6e140 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 --2- 172.21.15.39:0/3061472513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc63880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 -- 172.21.15.39:0/3061472513 >> 172.21.15.39:0/3061472513 conn(0x55733cc5fa30 msgr2=0x55733cc5fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 -- 172.21.15.39:0/3061472513 shutdown_connections 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.716+0000 7f4cb9592740 1 -- 172.21.15.39:0/3061472513 wait complete. 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 -- start start 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 Processor -- start 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc63dc0 0x55733cc6b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc6e680 0x55733cc6b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55733cc71250 con 0x55733cc63dc0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55733cb84050 con 0x55733cc634a0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55733cc713d0 con 0x55733cc6e680 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb9592740 10 client.0 _ll_register_callbacks cb 0x55733cbc4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4caffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc63dc0 0x55733cc6b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4caffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:58526/0 (socket says 172.21.15.39:58526) 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.717+0000 7f4caffff640 1 -- 172.21.15.39:0/2287912772 learned_addr learned my addr 172.21.15.39:0/2287912772 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc6e680 0x55733cc6b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 -- 172.21.15.39:0/2287912772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc6e680 msgr2=0x55733cc6b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc6e680 0x55733cc6b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 -- 172.21.15.39:0/2287912772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc63dc0 msgr2=0x55733cc6b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc63dc0 0x55733cc6b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 -- 172.21.15.39:0/2287912772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55733c93a3c0 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4caffff640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00f4a0 tx=0x7f4c9c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa940ed9b269ac2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c004020 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4c9c01a040 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca4003cd0 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c9c0041c0 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4cb9592740 10 client.25754 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.718+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55733cc7cbf0 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca4003cd0 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4c9c01d070 con 0x55733cc634a0 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 10 client.25754 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:09.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 10 client.25754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 20 client.25754 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cc7e000 0x55733cc80480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 4 client.25754 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55733cbd6850 con 0x55733cc7e000 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.719+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cc7e000 0x55733cc80480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4c8ffff640 10 client.25754 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cc7e000 0x55733cc80480 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a976fcfedfde59bb server_cookie=3c23330a654be185 in_seq=0 out_seq=0 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4c8ffff640 1 -- 172.21.15.39:0/2287912772 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55733cbd6850 con 0x55733cc7e000 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4c8ffff640 10 client.25754 handle_command_reply: tid=0 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4cb9592740 1 client.25754 shutdown 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 msgr2=0x55733cc6df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.720+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00f4a0 tx=0x7f4c9c004730 comp rx=0 tx=0).stop 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 shutdown_connections 2024-09-12T02:00:09.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cc7e000 0x55733cc80480 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc6e680 0x55733cc6b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc63dc0 0x55733cc6b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 --2- 172.21.15.39:0/2287912772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc634a0 0x55733cc6df60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4c8ffff640 0 client.25754 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 >> 172.21.15.39:0/2287912772 conn(0x55733cc5fa30 msgr2=0x55733cc65710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 shutdown_connections 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 1 -- 172.21.15.39:0/2287912772 wait complete. 2024-09-12T02:00:09.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.721+0000 7f4cb9592740 20 client.25754 trim_cache size 0 max 16384 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 Processor -- start 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 -- start start 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc7a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01b1fc0 con 0x55733cc6e680 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01af890 con 0x55733cc63dc0 2024-09-12T02:00:09.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb9592740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01ad6e0 con 0x55733cc634a0 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4caffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4caffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56646/0 (socket says 172.21.15.39:56646) 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4caffff640 1 -- 172.21.15.39:0/4239939387 learned_addr learned my addr 172.21.15.39:0/4239939387 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:58532/0 (socket says 172.21.15.39:58532) 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.740+0000 7f4caffff640 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc7a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 -- 172.21.15.39:0/4239939387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 msgr2=0x55733cc7a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 -- 172.21.15.39:0/4239939387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 msgr2=0x55733cc69ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 -- 172.21.15.39:0/4239939387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55733cc6a1c0 con 0x55733cc63dc0 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4caffff640 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4006010 tx=0x7f4ca4031900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df9752e5112cdcae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4c9a7fc640 1 -- 172.21.15.39:0/4239939387 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4035040 con 0x55733cc63dc0 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4c9a7fc640 1 -- 172.21.15.39:0/4239939387 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca4031e50 con 0x55733cc63dc0 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.741+0000 7f4c9a7fc640 1 -- 172.21.15.39:0/4239939387 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4040040 con 0x55733cc63dc0 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- 172.21.15.39:0/4239939387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 msgr2=0x55733cc66900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4006010 tx=0x7f4ca4031900 comp rx=0 tx=0).stop 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- 172.21.15.39:0/4239939387 shutdown_connections 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc6e680 0x55733cc69ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc63dc0 0x55733cc66900 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 --2- 172.21.15.39:0/4239939387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc634a0 0x55733cc7a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- 172.21.15.39:0/4239939387 >> 172.21.15.39:0/4239939387 conn(0x55733cc5fa30 msgr2=0x55733cc5e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- 172.21.15.39:0/4239939387 shutdown_connections 2024-09-12T02:00:09.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- 172.21.15.39:0/4239939387 wait complete. 2024-09-12T02:00:09.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.742+0000 7f4cb9592740 1 -- start start 2024-09-12T02:00:09.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 Processor -- start 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 0x55733cc724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 0x55733cc72a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc6e680 0x55733cc72f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01add50 con 0x55733cc634a0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01af1c0 con 0x55733cc6e680 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01ae420 con 0x55733cc63dc0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb9592740 10 client.0 _ll_register_callbacks cb 0x7f4c9c011530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4caffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 0x55733cc724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4cb4f55640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 0x55733cc72a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4caffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 0x55733cc724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56660/0 (socket says 172.21.15.39:56660) 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4caffff640 1 -- 172.21.15.39:0/622530032 learned_addr learned my addr 172.21.15.39:0/622530032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.743+0000 7f4caffff640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc6e680 0x55733cc72f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 -- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc6e680 msgr2=0x55733cc72f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc6e680 0x55733cc72f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 -- 172.21.15.39:0/622530032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 msgr2=0x55733cc724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 0x55733cc724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 -- 172.21.15.39:0/622530032 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55733cc6e2d0 con 0x55733cc63dc0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb4f55640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 0x55733cc72a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55733cc69940 tx=0x7f4ca40039a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53488b9832687df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4040050 con 0x55733cc63dc0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ca4003a80 con 0x55733cc63dc0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca4031e50 con 0x55733cc63dc0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ca4035040 con 0x55733cc63dc0 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb9592740 10 client.25606 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:09.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.744+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55733cce8f30 con 0x55733cc63dc0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca405d030 con 0x55733cc63dc0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4ca404f560 con 0x55733cc63dc0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 10 client.25606 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 10 client.25606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 20 client.25606 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cce9170 0x55733cceb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 4 client.25606 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4ca4031e50 con 0x55733cce9170 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.745+0000 7f4caffff640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cce9170 0x55733cceb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4c8ffff640 10 client.25606 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4caffff640 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cce9170 0x55733cceb560 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9166f1c3357b0c0e server_cookie=1acb308fb89616c3 in_seq=0 out_seq=0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4c8ffff640 1 -- 172.21.15.39:0/622530032 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f4ca4031e50 con 0x55733cce9170 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4c8ffff640 10 client.25606 handle_command_reply: tid=0 2024-09-12T02:00:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 client.25606 shutdown 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 msgr2=0x55733cc72a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 0x55733cc72a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55733cc69940 tx=0x7f4ca40039a0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 shutdown_connections 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55733cce9170 0x55733cceb560 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55733cc6e680 0x55733cc72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55733cc63dc0 0x55733cc72a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 --2- 172.21.15.39:0/622530032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55733cc634a0 0x55733cc724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 >> 172.21.15.39:0/622530032 conn(0x55733cc5fa30 msgr2=0x55733cc5eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4c8ffff640 0 client.25606 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 shutdown_connections 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.746+0000 7f4cb9592740 1 -- 172.21.15.39:0/622530032 wait complete. 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb9592740 20 client.25606 trim_cache size 0 max 16384 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stdout: "status": "no active scrubs running", 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stdout: "scrubs": {} 2024-09-12T02:00:09.753 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 msgr2=0x7f4ca00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 0x7f4ca00a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c760 tx=0x7f4ca8005940 comp rx=0 tx=0).stop 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 msgr2=0x7f4cb019a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb019a800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009fd0 tx=0x7f4ca800ef10 comp rx=0 tx=0).stop 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 shutdown_connections 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cb0102ef0 0x7f4cb019a800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f4ca00a2c00 0x7f4ca00a50c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb0102570 0x7f4cb019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 --2- 172.21.15.39:0/4261018251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4cb0100e20 0x7f4cb019f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.747+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 >> 172.21.15.39:0/4261018251 conn(0x7f4cb00fc7d0 msgr2=0x7f4cb00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.748+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 shutdown_connections 2024-09-12T02:00:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:09.748+0000 7f4cb71b9640 1 -- 172.21.15.39:0/4261018251 wait complete. 2024-09-12T02:00:10.552 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T02:00:10.553 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:00:10.836 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:11.122 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:10 smithi039 ceph-mon[31204]: pgmap v435: 97 pgs: 97 active+clean; 47 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:11.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:10 smithi044 ceph-mon[35259]: pgmap v435: 97 pgs: 97 active+clean; 47 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:10 smithi172 ceph-mon[35073]: pgmap v435: 97 pgs: 97 active+clean; 47 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:11.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 -- 172.21.15.39:0/3466300100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8102790 msgr2=0x7f0ee81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/3466300100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8102790 0x7f0ee81067e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009900 tx=0x7f0edc02a410 comp rx=0 tx=0).stop 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 -- 172.21.15.39:0/3466300100 shutdown_connections 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/3466300100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8106f10 0x7f0ee810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/3466300100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8102790 0x7f0ee81067e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/3466300100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8101de0 0x7f0ee81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 -- 172.21.15.39:0/3466300100 >> 172.21.15.39:0/3466300100 conn(0x7f0ee80fd8c0 msgr2=0x7f0ee80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 -- 172.21.15.39:0/3466300100 shutdown_connections 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.615+0000 7f0eee2b4640 1 -- 172.21.15.39:0/3466300100 wait complete. 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.616+0000 7f0eee2b4640 1 Processor -- start 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.616+0000 7f0eee2b4640 1 -- start start 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.616+0000 7f0eee2b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 0x7f0ee81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:11.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.616+0000 7f0eee2b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 0x7f0ee8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.616+0000 7f0eee2b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 0x7f0ee819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eee2b4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8111fc0 con 0x7f0ee8106f10 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eee2b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8111e40 con 0x7f0ee8102790 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eee2b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8112140 con 0x7f0ee8101de0 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eec851640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 0x7f0ee819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 0x7f0ee81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 0x7f0ee8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eec851640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 0x7f0ee819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56678/0 (socket says 172.21.15.39:56678) 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 0x7f0ee8198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:58578/0 (socket says 172.21.15.39:58578) 2024-09-12T02:00:11.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0eec851640 1 -- 172.21.15.39:0/2690778621 learned_addr learned my addr 172.21.15.39:0/2690778621 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 -- 172.21.15.39:0/2690778621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 msgr2=0x7f0ee8198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 0x7f0ee8198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 -- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 msgr2=0x7f0ee819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 0x7f0ee819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 -- 172.21.15.39:0/2690778621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee819d470 con 0x7f0ee8101de0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.617+0000 7f0ee7fff640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 0x7f0ee81984c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8005fd0 tx=0x7f0ed800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.618+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8009c30 con 0x7f0ee8101de0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.618+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ed8009dd0 con 0x7f0ee8101de0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.618+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee819d760 con 0x7f0ee8101de0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.618+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8010460 con 0x7f0ee8101de0 2024-09-12T02:00:11.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.618+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee81a5040 con 0x7f0ee8101de0 2024-09-12T02:00:11.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.619+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee81021c0 con 0x7f0ee8101de0 2024-09-12T02:00:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.620+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0ed8003f50 con 0x7f0ee8101de0 2024-09-12T02:00:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.621+0000 7f0ee57fa640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 0x7f0ed00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.621+0000 7f0ee77fe640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 0x7f0ed00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.621+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ed80ceb60 con 0x7f0ee8101de0 2024-09-12T02:00:11.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.622+0000 7f0ee77fe640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 0x7f0ed00a50c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:11.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.625+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ed8017020 con 0x7f0ee8101de0 2024-09-12T02:00:11.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.872+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee810a180 con 0x7f0ee8101de0 2024-09-12T02:00:11.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.872+0000 7f0ee57fa640 1 -- 172.21.15.39:0/2690778621 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11913 (secure 0 0 0) 0x7f0ed809b420 con 0x7f0ee8101de0 2024-09-12T02:00:11.874 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:00:11.874 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"btime":"2024-09-12T01:59:40:731312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T01:59:40.692742+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/2267029874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2267029874},{"type":"v1","addr":"172.21.15.172:6837","nonce":2267029874}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:00:11.874 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 29 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 msgr2=0x7f0ed00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 0x7f0ed00a50c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc005b50 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 msgr2=0x7f0ee81984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 0x7f0ee81984c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8005fd0 tx=0x7f0ed800dde0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 shutdown_connections 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ee8106f10 0x7f0ee819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ee8102790 0x7f0ee8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0ed00a2c00 0x7f0ed00a50c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 --2- 172.21.15.39:0/2690778621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8101de0 0x7f0ee81984c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:11.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 >> 172.21.15.39:0/2690778621 conn(0x7f0ee80fd8c0 msgr2=0x7f0ee80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:11.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 shutdown_connections 2024-09-12T02:00:11.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:11.876+0000 7f0eee2b4640 1 -- 172.21.15.39:0/2690778621 wait complete. 2024-09-12T02:00:12.683 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T02:00:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:12 smithi039 ceph-mon[31204]: pgmap v436: 97 pgs: 97 active+clean; 47 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:12.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:12 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2690778621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:12.959 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:12 smithi044 ceph-mon[35259]: pgmap v436: 97 pgs: 97 active+clean; 47 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:12 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2690778621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:12 smithi172 ceph-mon[35073]: pgmap v436: 97 pgs: 97 active+clean; 47 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 366 op/s 2024-09-12T02:00:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:12 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2690778621' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:13.907 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0xffdb8 2024-09-12T02:00:14.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.076+0000 7f01bf61f640 1 -- 172.21.15.39:0/2666220664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81036e0 msgr2=0x7f01b8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.076+0000 7f01bf61f640 1 --2- 172.21.15.39:0/2666220664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81036e0 0x7f01b8107b90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009930 tx=0x7f01a802a420 comp rx=0 tx=0).stop 2024-09-12T02:00:14.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 -- 172.21.15.39:0/2666220664 shutdown_connections 2024-09-12T02:00:14.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 --2- 172.21.15.39:0/2666220664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81082a0 0x7f01b810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 --2- 172.21.15.39:0/2666220664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81036e0 0x7f01b8107b90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 --2- 172.21.15.39:0/2666220664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 -- 172.21.15.39:0/2666220664 >> 172.21.15.39:0/2666220664 conn(0x7f01b80fc7d0 msgr2=0x7f01b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 -- 172.21.15.39:0/2666220664 shutdown_connections 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 -- 172.21.15.39:0/2666220664 wait complete. 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 Processor -- start 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.077+0000 7f01bf61f640 1 -- start start 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81036e0 0x7f01b8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81082a0 0x7f01b8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8112060 con 0x7f01b81082a0 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8111ee0 con 0x7f01b8102d30 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bf61f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81121e0 con 0x7f01b81036e0 2024-09-12T02:00:14.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bdbbc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81082a0 0x7f01b8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33116/0 (socket says 172.21.15.39:33116) 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3383442465 learned_addr learned my addr 172.21.15.39:0/3383442465 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bcbba640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81036e0 0x7f01b8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3383442465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81036e0 msgr2=0x7f01b8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81036e0 0x7f01b8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81082a0 msgr2=0x7f01b8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81082a0 0x7f01b8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3383442465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b81a6a80 con 0x7f01b8102d30 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e9f0 tx=0x7f01b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.078+0000 7f01ae7fc640 1 -- 172.21.15.39:0/3383442465 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b400cd80 con 0x7f01b8102d30 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.079+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b81a6d70 con 0x7f01b8102d30 2024-09-12T02:00:14.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.079+0000 7f01ae7fc640 1 -- 172.21.15.39:0/3383442465 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b4010910 con 0x7f01b8102d30 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.079+0000 7f01ae7fc640 1 -- 172.21.15.39:0/3383442465 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40188f0 con 0x7f01b8102d30 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.079+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b81a7220 con 0x7f01b8102d30 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.081+0000 7f01ae7fc640 1 -- 172.21.15.39:0/3383442465 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f01b4010ac0 con 0x7f01b8102d30 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 Processor -- start 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 -- start start 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01ae7fc640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 0x7f01a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9db760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59420/0 (socket says 172.21.15.39:59420) 2024-09-12T02:00:14.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bcbba640 1 -- 172.21.15.39:0/1982638437 learned_addr learned my addr 172.21.15.39:0/1982638437 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55589d9342f0 con 0x55589d9d9370 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55589d8dbcf0 con 0x55589d9cfb40 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55589d9302b0 con 0x55589d9ce5d0 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 0x7f01a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.082+0000 7f01ae7fc640 1 -- 172.21.15.39:0/3383442465 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f01b40cf3c0 con 0x7f01b8102d30 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1982638437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 msgr2=0x55589d9ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1982638437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 msgr2=0x55589d9db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1982638437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589d8c03a0 con 0x55589d9ce5d0 2024-09-12T02:00:14.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9cea10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01b40ccf20 tx=0x7f01b406ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f6ed0700ac6556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 0x7f01a40a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01b0005fd0 tx=0x7f01b0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01a37fe640 1 -- 172.21.15.39:0/1982638437 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b409ffe0 con 0x55589d9ce5d0 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01a37fe640 1 -- 172.21.15.39:0/1982638437 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b40a48a0 con 0x55589d9ce5d0 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.083+0000 7f01a37fe640 1 -- 172.21.15.39:0/1982638437 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b409bf40 con 0x55589d9ce5d0 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 msgr2=0x55589d9cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9cea10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01b40ccf20 tx=0x7f01b406ee60 comp rx=0 tx=0).stop 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 shutdown_connections 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9cea10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1982638437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 >> 172.21.15.39:0/1982638437 conn(0x55589d997310 msgr2=0x55589d9cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 shutdown_connections 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- 172.21.15.39:0/1982638437 wait complete. 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.084+0000 7f01c19f8740 1 -- start start 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 Processor -- start 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9d8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9d65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55589d9dc070 con 0x55589d9d9370 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55589d8ef060 con 0x55589d9cfb40 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55589d9dc1f0 con 0x55589d9ce5d0 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01c19f8740 10 client.0 _ll_register_callbacks cb 0x55589d6428c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9d8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33124/0 (socket says 172.21.15.39:33124) 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01bcbba640 1 -- 172.21.15.39:0/1447368643 learned_addr learned my addr 172.21.15.39:0/1447368643 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.085+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9d65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1447368643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 msgr2=0x55589d9d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1447368643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 msgr2=0x55589d9d65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9d65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 -- 172.21.15.39:0/1447368643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589d6a53c0 con 0x55589d9ce5d0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bcbba640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9d8d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01b409bea0 tx=0x7f01b4097f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7da809874fb05f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a4410 con 0x55589d9ce5d0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f01b40a45b0 con 0x55589d9ce5d0 2024-09-12T02:00:14.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01b40a48a0 con 0x55589d9ce5d0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01b409b130 con 0x55589d9ce5d0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01c19f8740 10 client.25624 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55589d9dc070 con 0x55589d9ce5d0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b40a48a0 con 0x55589d9ce5d0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.086+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f01b4097a30 con 0x55589d9ce5d0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 10 client.25624 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 10 client.25624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 20 client.25624 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589d9e8ca0 0x55589d9eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 4 client.25624 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55589d941860 con 0x55589d9e8ca0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01bcbba640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589d9e8ca0 0x55589d9eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01a0ff9640 10 client.25624 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.087+0000 7f01bcbba640 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589d9e8ca0 0x55589d9eb090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c88394f44b4548b2 server_cookie=59c3afa4957355b9 in_seq=0 out_seq=0 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01a0ff9640 1 -- 172.21.15.39:0/1447368643 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55589d941860 con 0x55589d9e8ca0 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01a0ff9640 10 client.25624 handle_command_reply: tid=0 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 client.25624 shutdown 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 msgr2=0x55589d9d8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9d8d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01b409bea0 tx=0x7f01b4097f80 comp rx=0 tx=0).stop 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 shutdown_connections 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589d9e8ca0 0x55589d9eb090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9d9370 0x55589d9d65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.088+0000 7f01c19f8740 1 --2- 172.21.15.39:0/1447368643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9ce5d0 0x55589d9d8d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.089+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 >> 172.21.15.39:0/1447368643 conn(0x55589d997310 msgr2=0x55589d9d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.089+0000 7f01a0ff9640 0 client.25624 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T02:00:14.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.089+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 shutdown_connections 2024-09-12T02:00:14.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.089+0000 7f01c19f8740 1 -- 172.21.15.39:0/1447368643 wait complete. 2024-09-12T02:00:14.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.089+0000 7f01c19f8740 20 client.25624 trim_cache size 0 max 16384 2024-09-12T02:00:14.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.102+0000 7f01c19f8740 1 Processor -- start 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.102+0000 7f01c19f8740 1 -- start start 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 0x55589d9f0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81b20b0 con 0x55589d9ce5d0 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81af980 con 0x55589d9cfb40 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01c19f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81ad7d0 con 0x55589d9d9370 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 0x55589d9f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bcbba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33128/0 (socket says 172.21.15.39:33128) 2024-09-12T02:00:14.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bcbba640 1 -- 172.21.15.39:0/3306621810 learned_addr learned my addr 172.21.15.39:0/3306621810 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 -- 172.21.15.39:0/3306621810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 msgr2=0x55589d9d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 -- 172.21.15.39:0/3306621810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 msgr2=0x55589d9e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bdbbc640 1 -- 172.21.15.39:0/3306621810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589d9cbdd0 con 0x55589d9d9370 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bcbba640 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.103+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.104+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 0x55589d9f0690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01b0011aa0 tx=0x7f01b000e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a08c7d524cc70fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.104+0000 7f01a2ffd640 1 -- 172.21.15.39:0/3306621810 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0004b20 con 0x55589d9d9370 2024-09-12T02:00:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.104+0000 7f01a2ffd640 1 -- 172.21.15.39:0/3306621810 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b0004cc0 con 0x55589d9d9370 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.104+0000 7f01a2ffd640 1 -- 172.21.15.39:0/3306621810 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b0005600 con 0x55589d9d9370 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- 172.21.15.39:0/3306621810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 msgr2=0x55589d9f0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 0x55589d9f0690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01b0011aa0 tx=0x7f01b000e000 comp rx=0 tx=0).stop 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- 172.21.15.39:0/3306621810 shutdown_connections 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9d9370 0x55589d9f0690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9cfb40 0x55589d9d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3306621810 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- 172.21.15.39:0/3306621810 >> 172.21.15.39:0/3306621810 conn(0x55589d997310 msgr2=0x55589d9d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- 172.21.15.39:0/3306621810 shutdown_connections 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- 172.21.15.39:0/3306621810 wait complete. 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 -- start start 2024-09-12T02:00:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.105+0000 7f01c19f8740 1 Processor -- start 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9cfb40 0x55589d9d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 0x55589d9d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81ade40 con 0x55589d9ce5d0 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81af2b0 con 0x55589d9d9370 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01b81ae510 con 0x55589d9cfb40 2024-09-12T02:00:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01c19f8740 10 client.0 _ll_register_callbacks cb 0x7f01b00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59452/0 (socket says 172.21.15.39:59452) 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3984350925 learned_addr learned my addr 172.21.15.39:0/3984350925 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 0x55589d9d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bcbba640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9cfb40 0x55589d9d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9cfb40 msgr2=0x55589d9d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9cfb40 0x55589d9d2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3984350925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 msgr2=0x55589d9d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 0x55589d9d33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 -- 172.21.15.39:0/3984350925 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589d9d1040 con 0x55589d9ce5d0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bdbbc640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 0x55589d9d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01bd3bb640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e9c0 tx=0x7f01b409b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e245e1532aa4e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.106+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b40b9060 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f01b409ace0 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01b0004cc0 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01b409ffe0 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 10 client.16215 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55589d9d1040 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01b0004cc0 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f01b40a4410 con 0x55589d9ce5d0 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 10 client.16215 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 10 client.16215 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 20 client.16215 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589da53910 0x55589da55d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 4 client.16215 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 --> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55589d93bd70 con 0x55589da53910 2024-09-12T02:00:14.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.107+0000 7f01bcbba640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589da53910 0x55589da55d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01a0ff9640 10 client.16215 ms_handle_connect on v2:172.21.15.172:6838/3543698961 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01bcbba640 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589da53910 0x55589da55d00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed5d4971d9905691 server_cookie=94bcd4d79f8230e7 in_seq=0 out_seq=0 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01a0ff9640 1 -- 172.21.15.39:0/3984350925 <== mds.2 v2:172.21.15.172:6838/3543698961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+907 (crc 0 0 0) 0x55589d93bd70 con 0x55589da53910 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01a0ff9640 10 client.16215 handle_command_reply: tid=0 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 client.16215 shutdown 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 msgr2=0x55589d9e1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e9c0 tx=0x7f01b409b770 comp rx=0 tx=0).stop 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 shutdown_connections 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:6838/3543698961,v1:172.21.15.172:6839/3543698961] conn(0x55589da53910 0x55589da55d00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55589d9d9370 0x55589d9d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55589d9cfb40 0x55589d9d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 --2- 172.21.15.39:0/3984350925 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55589d9ce5d0 0x55589d9e1d20 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 >> 172.21.15.39:0/3984350925 conn(0x55589d997310 msgr2=0x55589d9c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.108+0000 7f01a0ff9640 0 client.16215 ms_handle_reset on v2:172.21.15.172:6838/3543698961 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 shutdown_connections 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01c19f8740 1 -- 172.21.15.39:0/3984350925 wait complete. 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01c19f8740 20 client.16215 trim_cache size 0 max 16384 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 103781209, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634563, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list" 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1748527239, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634577, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list" 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2786885462, 2024-09-12T02:00:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634559, 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list" 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3559830370, 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634556, 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list" 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:14.116 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 msgr2=0x7f01a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 0x7f01a40a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01b0005fd0 tx=0x7f01b0009500 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 msgr2=0x7f01b8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01b400e9f0 tx=0x7f01b400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 shutdown_connections 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01b81082a0 0x7f01b8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f01a40a2b80 0x7f01a40a5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01b81036e0 0x7f01b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 --2- 172.21.15.39:0/3383442465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8102d30 0x7f01b8100990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.109+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 >> 172.21.15.39:0/3383442465 conn(0x7f01b80fc7d0 msgr2=0x7f01b8105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:14.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.110+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 shutdown_connections 2024-09-12T02:00:14.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:14.110+0000 7f01bf61f640 1 -- 172.21.15.39:0/3383442465 wait complete. 2024-09-12T02:00:15.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:14 smithi039 ceph-mon[31204]: pgmap v437: 97 pgs: 97 active+clean; 47 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 522 op/s 2024-09-12T02:00:15.051 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T02:00:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:14 smithi044 ceph-mon[35259]: pgmap v437: 97 pgs: 97 active+clean; 47 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 522 op/s 2024-09-12T02:00:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:14 smithi172 ceph-mon[35073]: pgmap v437: 97 pgs: 97 active+clean; 47 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 522 op/s 2024-09-12T02:00:15.327 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 -- 172.21.15.39:0/237765537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 msgr2=0x7f191c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 --2- 172.21.15.39:0/237765537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c10ec30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1914009cd0 tx=0x7f191402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 -- 172.21.15.39:0/237765537 shutdown_connections 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 --2- 172.21.15.39:0/237765537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c10ec30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 --2- 172.21.15.39:0/237765537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c103740 0x7f191c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 --2- 172.21.15.39:0/237765537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c102d90 0x7f191c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.830+0000 7f19245c6640 1 -- 172.21.15.39:0/237765537 >> 172.21.15.39:0/237765537 conn(0x7f191c0fc7d0 msgr2=0x7f191c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.831+0000 7f19245c6640 1 -- 172.21.15.39:0/237765537 shutdown_connections 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.831+0000 7f19245c6640 1 -- 172.21.15.39:0/237765537 wait complete. 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.831+0000 7f19245c6640 1 Processor -- start 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.831+0000 7f19245c6640 1 -- start start 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c102d90 0x7f191c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 0x7f191c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f191c112090 con 0x7f191c108290 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f191c111f10 con 0x7f191c103740 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f19245c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f191c112210 con 0x7f191c102d90 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59466/0 (socket says 172.21.15.39:59466) 2024-09-12T02:00:15.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 -- 172.21.15.39:0/2939670844 learned_addr learned my addr 172.21.15.39:0/2939670844 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1921b61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 0x7f191c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922362640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c102d90 0x7f191c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 -- 172.21.15.39:0/2939670844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c102d90 msgr2=0x7f191c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c102d90 0x7f191c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 -- 172.21.15.39:0/2939670844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 msgr2=0x7f191c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 0x7f191c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 -- 172.21.15.39:0/2939670844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c19d4d0 con 0x7f191c108290 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1921b61640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 0x7f191c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.832+0000 7f1922b63640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1914005cc0 tx=0x7f19140093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.833+0000 7f19137fe640 1 -- 172.21.15.39:0/2939670844 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914003e00 con 0x7f191c108290 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.833+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c19d760 con 0x7f191c108290 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.833+0000 7f19137fe640 1 -- 172.21.15.39:0/2939670844 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1914004520 con 0x7f191c108290 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.833+0000 7f19137fe640 1 -- 172.21.15.39:0/2939670844 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914030db0 con 0x7f191c108290 2024-09-12T02:00:15.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.833+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c1a50a0 con 0x7f191c108290 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.835+0000 7f192699f740 1 Processor -- start 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f19137fe640 1 -- 172.21.15.39:0/2939670844 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1914046480 con 0x7f191c108290 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 -- start start 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f858296090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f858296a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f8582a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f8581fc2f0 con 0x55f858297b40 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f8581a3cf0 con 0x55f8582965d0 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f192699f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f8581f82b0 con 0x55f8582a1370 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f1921b61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f858296090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f1921b61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f858296090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59474/0 (socket says 172.21.15.39:59474) 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f1922362640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f858296a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.836+0000 7f1921b61640 1 -- 172.21.15.39:0/1713152024 learned_addr learned my addr 172.21.15.39:0/1713152024 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1921b61640 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f8582a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 -- 172.21.15.39:0/1713152024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 msgr2=0x55f8582a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f8582a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 -- 172.21.15.39:0/1713152024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 msgr2=0x55f858296090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f858296090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 -- 172.21.15.39:0/1713152024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8581883a0 con 0x55f8582965d0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f19137fe640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1922362640 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f858296a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1918009c20 tx=0x7f1918011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30c71b49fcc071e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1921b61640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f19137fe640 1 -- 172.21.15.39:0/2939670844 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f191402e030 con 0x7f191c108290 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1910ff9640 1 -- 172.21.15.39:0/1713152024 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191801e070 con 0x55f8582965d0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1910ff9640 1 -- 172.21.15.39:0/1713152024 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1918019910 con 0x55f8582965d0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.837+0000 7f1910ff9640 1 -- 172.21.15.39:0/1713152024 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191800ea80 con 0x55f8582965d0 2024-09-12T02:00:15.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 -- 172.21.15.39:0/1713152024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 msgr2=0x55f858296a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f858296a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1918009c20 tx=0x7f1918011810 comp rx=0 tx=0).stop 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f1921b61640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 0x7f19080a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55f858297070 tx=0x7f190c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 -- 172.21.15.39:0/1713152024 shutdown_connections 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f8582a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f858296a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 --2- 172.21.15.39:0/1713152024 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f858296090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 -- 172.21.15.39:0/1713152024 >> 172.21.15.39:0/1713152024 conn(0x55f85825f310 msgr2=0x55f858292c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 -- 172.21.15.39:0/1713152024 shutdown_connections 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.838+0000 7f192699f740 1 -- 172.21.15.39:0/1713152024 wait complete. 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 -- start start 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 Processor -- start 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f85829e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55f8582a4070 con 0x55f858297b40 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f8581b7060 con 0x55f8582965d0 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f8582a41f0 con 0x55f8582a1370 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1921b61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f85829e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f192699f740 10 client.0 _ll_register_callbacks cb 0x55f857f0a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1922362640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1922362640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33174/0 (socket says 172.21.15.39:33174) 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1922362640 1 -- 172.21.15.39:0/3237417670 learned_addr learned my addr 172.21.15.39:0/3237417670 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1922b63640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.839+0000 7f1921b61640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f85829e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59482/0 (socket says 172.21.15.39:59482) 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 -- 172.21.15.39:0/3237417670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 msgr2=0x55f85829e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 -- 172.21.15.39:0/3237417670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 msgr2=0x55f85829e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f85829e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 -- 172.21.15.39:0/3237417670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f857f6d3c0 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1922362640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19180097b0 tx=0x7f1918019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b9a42da8af822b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918027020 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1918004040 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1918019910 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f191801e040 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f192699f740 10 client.25796 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f8582afb10 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.840+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1918019910 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f191800e800 con 0x55f8582965d0 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 10 client.25796 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:15.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 10 client.25796 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 20 client.25796 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f8582b0e60 0x55f8582b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 4 client.25796 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f858209860 con 0x55f8582b0e60 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f1921b61640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f8582b0e60 0x55f8582b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f1921b61640 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f8582b0e60 0x55f8582b3250 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b7b9195cd38459d server_cookie=464cb2dd11b41997 in_seq=0 out_seq=0 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.841+0000 7f1905ffb640 10 client.25796 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f1905ffb640 1 -- 172.21.15.39:0/3237417670 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f858209860 con 0x55f8582b0e60 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f1905ffb640 10 client.25796 handle_command_reply: tid=0 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 client.25796 shutdown 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 msgr2=0x55f8582a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19180097b0 tx=0x7f1918019660 comp rx=0 tx=0).stop 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 shutdown_connections 2024-09-12T02:00:15.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f8582b0e60 0x55f8582b3250 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f85829e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f1905ffb640 0 client.25796 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 --2- 172.21.15.39:0/3237417670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a0d60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 >> 172.21.15.39:0/3237417670 conn(0x55f85825f310 msgr2=0x55f858298930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 shutdown_connections 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 1 -- 172.21.15.39:0/3237417670 wait complete. 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.842+0000 7f192699f740 20 client.25796 trim_cache size 0 max 16384 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 Processor -- start 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 -- start start 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f858297b40 0x55f8582ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1adc00 con 0x55f8582965d0 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1ab4d0 con 0x55f8582a1370 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f192699f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1a9340 con 0x55f858297b40 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1922362640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1922b63640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1921b61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f858297b40 0x55f8582ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1922b63640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33184/0 (socket says 172.21.15.39:33184) 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1922362640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59490/0 (socket says 172.21.15.39:59490) 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.856+0000 7f1922b63640 1 -- 172.21.15.39:0/89698784 learned_addr learned my addr 172.21.15.39:0/89698784 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 -- 172.21.15.39:0/89698784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f858297b40 msgr2=0x55f8582ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f858297b40 0x55f8582ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 -- 172.21.15.39:0/89698784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 msgr2=0x55f858292e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 -- 172.21.15.39:0/89698784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8582a3f50 con 0x55f8582a1370 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922362640 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1922b63640 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19140ee110 tx=0x7f191402a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2704651889b50c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1907fff640 1 -- 172.21.15.39:0/89698784 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140bce70 con 0x55f8582a1370 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1907fff640 1 -- 172.21.15.39:0/89698784 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1914036040 con 0x55f8582a1370 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.857+0000 7f1907fff640 1 -- 172.21.15.39:0/89698784 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19140b94e0 con 0x55f8582a1370 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- 172.21.15.39:0/89698784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 msgr2=0x55f85828dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19140ee110 tx=0x7f191402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- 172.21.15.39:0/89698784 shutdown_connections 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582a1370 0x55f85828dad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f858297b40 0x55f8582ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 --2- 172.21.15.39:0/89698784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f8582965d0 0x55f858292e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- 172.21.15.39:0/89698784 >> 172.21.15.39:0/89698784 conn(0x55f85825f310 msgr2=0x55f858292700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- 172.21.15.39:0/89698784 shutdown_connections 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- 172.21.15.39:0/89698784 wait complete. 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 -- start start 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.858+0000 7f192699f740 1 Processor -- start 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1a9990 con 0x55f858297b40 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1aae00 con 0x55f8582965d0 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f191c1aa060 con 0x55f8582a1370 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f192699f740 10 client.0 _ll_register_callbacks cb 0x7f191801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59494/0 (socket says 172.21.15.39:59494) 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 -- 172.21.15.39:0/3783766337 learned_addr learned my addr 172.21.15.39:0/3783766337 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:15.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1922b63640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1922362640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 -- 172.21.15.39:0/3783766337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 msgr2=0x55f85829a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 -- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 msgr2=0x55f8582a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1921b61640 1 -- 172.21.15.39:0/3783766337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85829b070 con 0x55f858297b40 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1922b63640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.859+0000 7f1922362640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1921b61640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55f8582a1340 tx=0x7f190c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af76de540c240174 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c024ad0 con 0x55f858297b40 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f190c01e040 con 0x55f858297b40 2024-09-12T02:00:15.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1914036040 con 0x55f858297b40 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f190c024c70 con 0x55f858297b40 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f192699f740 10 client.16233 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f85831b4c0 con 0x55f858297b40 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1914036040 con 0x55f858297b40 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.860+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f190c004bd0 con 0x55f858297b40 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 10 client.16233 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 10 client.16233 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 20 client.16233 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f85831bc70 0x55f85831e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 4 client.16233 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 --> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f858203d70 con 0x55f85831bc70 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f1922362640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f85831bc70 0x55f85831e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f1905ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.44:6836/3549353612 2024-09-12T02:00:15.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.861+0000 7f1922362640 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f85831bc70 0x55f85831e090 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=511fd82f3ed6260b server_cookie=51b8d9c236de9280 in_seq=0 out_seq=0 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f1905ffb640 1 -- 172.21.15.39:0/3783766337 <== mds.1 v2:172.21.15.44:6836/3549353612 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9703 (crc 0 0 0) 0x55f858203d70 con 0x55f85831bc70 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f1905ffb640 10 client.16233 handle_command_reply: tid=0 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 client.16233 shutdown 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 msgr2=0x55f8582a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x55f8582a1340 tx=0x7f190c005f90 comp rx=0 tx=0).stop 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 shutdown_connections 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:6836/3549353612,v1:172.21.15.44:6837/3549353612] conn(0x55f85831bc70 0x55f85831e090 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8582a1370 0x55f85829a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55f858297b40 0x55f8582a9ba0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 --2- 172.21.15.39:0/3783766337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f8582965d0 0x55f8582a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 >> 172.21.15.39:0/3783766337 conn(0x55f85825f310 msgr2=0x55f8582914e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f1905ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.44:6836/3549353612 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 shutdown_connections 2024-09-12T02:00:15.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 1 -- 172.21.15.39:0/3783766337 wait complete. 2024-09-12T02:00:15.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.862+0000 7f192699f740 20 client.16233 trim_cache size 0 max 16384 2024-09-12T02:00:15.879 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-09-12T02:00:15.879 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 27576541, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634575, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo" 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 118746928, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634568, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o" 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.880 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 161479106, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634565, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o" 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 163204924, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634573, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo" 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.881 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 334510884, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634600, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o" 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 415774993, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634572, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o" 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 424105262, 2024-09-12T02:00:15.882 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634589, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o" 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 425335784, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634585, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o" 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 433019094, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634606, 2024-09-12T02:00:15.883 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo" 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 504434890, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634571, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o" 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 513812587, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634574, 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o" 2024-09-12T02:00:15.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 580097386, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634594, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o" 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 617834599, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634607, 2024-09-12T02:00:15.885 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a" 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 620319860, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634570, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o" 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 647125232, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634579, 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o" 2024-09-12T02:00:15.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 699544314, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634561, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs" 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 742247574, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634583, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo" 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.887 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 763163134, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634582, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o" 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 858606000, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634569, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo" 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 929468977, 2024-09-12T02:00:15.888 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634552, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep" 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1079044981, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634580, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo" 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1149075062, 2024-09-12T02:00:15.889 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634611, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la" 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1251418200, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634603, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o" 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1350585172, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634597, 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo" 2024-09-12T02:00:15.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1576213051, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634596, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo" 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1822293066, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634595, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o" 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.891 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1870073632, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634604, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo" 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 1981511177, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634576, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o" 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2042449890, 2024-09-12T02:00:15.892 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634601, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o" 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2046121377, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634586, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo" 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2086159895, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634578, 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o" 2024-09-12T02:00:15.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2206999233, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634590, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o" 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2324405641, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634598, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o" 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2692308795, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634584, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o" 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2800191460, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634593, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o" 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2922830391, 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634588, 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo" 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2960206526, 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634602, 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo" 2024-09-12T02:00:15.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 2983828890, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634587, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o" 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3250880596, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634610, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la" 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.897 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3321863291, 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634605, 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o" 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3409894311, 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634591, 2024-09-12T02:00:15.898 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o" 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3546256709, 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634592, 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo" 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3698649433, 2024-09-12T02:00:15.899 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634581, 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o" 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: "damage_type": "backtrace", 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 3866439275, 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 1099511634599, 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: "path": "/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o" 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 msgr2=0x7f19080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 0x7f19080a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55f858297070 tx=0x7f190c005850 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 msgr2=0x7f191c19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1914005cc0 tx=0x7f19140093d0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 shutdown_connections 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f191c108290 0x7f191c19cdf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f191c103740 0x7f191c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f19080a2b80 0x7f19080a5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 --2- 172.21.15.39:0/2939670844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f191c102d90 0x7f191c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 >> 172.21.15.39:0/2939670844 conn(0x7f191c0fc7d0 msgr2=0x7f191c106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 shutdown_connections 2024-09-12T02:00:15.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:15.863+0000 7f19245c6640 1 -- 172.21.15.39:0/2939670844 wait complete. 2024-09-12T02:00:16.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T02:00:17.154 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:16 smithi039 ceph-mon[31204]: pgmap v438: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-12T02:00:17.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:16 smithi044 ceph-mon[35259]: pgmap v438: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-12T02:00:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:16 smithi172 ceph-mon[35073]: pgmap v438: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-12T02:00:17.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- 172.21.15.39:0/3578291543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348109120 msgr2=0x7fa348110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 --2- 172.21.15.39:0/3578291543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348109120 0x7fa348110ca0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa340009ca0 tx=0x7fa34002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- 172.21.15.39:0/3578291543 shutdown_connections 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 --2- 172.21.15.39:0/3578291543 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348109120 0x7fa348110ca0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 --2- 172.21.15.39:0/3578291543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa3481089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 --2- 172.21.15.39:0/3578291543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348103ff0 0x7fa3481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- 172.21.15.39:0/3578291543 >> 172.21.15.39:0/3578291543 conn(0x7fa3480ffab0 msgr2=0x7fa348101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- 172.21.15.39:0/3578291543 shutdown_connections 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- 172.21.15.39:0/3578291543 wait complete. 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 Processor -- start 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.665+0000 7fa34d791640 1 -- start start 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa34819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 0x7fa34819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa348114150 con 0x7fa348103ff0 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa348113fd0 con 0x7fa348109120 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa34d791640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481142d0 con 0x7fa3481049a0 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59506/0 (socket says 172.21.15.39:59506) 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 -- 172.21.15.39:0/4272336314 learned_addr learned my addr 172.21.15.39:0/4272336314 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa33ffff640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa34819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa3477fe640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 0x7fa34819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 -- 172.21.15.39:0/4272336314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 msgr2=0x7fa34819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa34819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 -- 172.21.15.39:0/4272336314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 msgr2=0x7fa34819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 0x7fa34819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 -- 172.21.15.39:0/4272336314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34819f570 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa33ffff640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa34819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa3477fe640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 0x7fa34819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa346ffd640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa33800ea60 tx=0x7fa33800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.666+0000 7fa344ff9640 1 -- 172.21.15.39:0/4272336314 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33800cde0 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.667+0000 7fa344ff9640 1 -- 172.21.15.39:0/4272336314 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3380035f0 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.667+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34819f860 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.667+0000 7fa344ff9640 1 -- 172.21.15.39:0/4272336314 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338010670 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.667+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3481a7140 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.669+0000 7fa344ff9640 1 -- 172.21.15.39:0/4272336314 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa3380037a0 con 0x7fa348103ff0 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.669+0000 7fa34fb6a740 1 Processor -- start 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.669+0000 7fa34fb6a740 1 -- start start 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb115d0 0x55e45bb11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb1c370 0x55e45bb1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e45ba772f0 con 0x55e45bb115d0 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e45ba1ecf0 con 0x55e45bb1c370 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e45ba732b0 con 0x55e45bb12b40 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa346ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb115d0 0x55e45bb11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:46408/0 (socket says 172.21.15.39:46408) 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 -- 172.21.15.39:0/3416927923 learned_addr learned my addr 172.21.15.39:0/3416927923 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa33ffff640 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb1c370 0x55e45bb1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 -- 172.21.15.39:0/3416927923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb1c370 msgr2=0x55e45bb1e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb1c370 0x55e45bb1e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 -- 172.21.15.39:0/3416927923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb115d0 msgr2=0x55e45bb11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb115d0 0x55e45bb11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa3477fe640 1 -- 172.21.15.39:0/3416927923 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45ba033a0 con 0x55e45bb12b40 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.670+0000 7fa344ff9640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 0x7fa3340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa346ffd640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 0x7fa3340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa340031f80 tx=0x7fa340005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76169af0b3d3de0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa344ff9640 1 -- 172.21.15.39:0/4272336314 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa3380cf2a0 con 0x7fa348103ff0 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa33d7fa640 1 -- 172.21.15.39:0/3416927923 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340003b70 con 0x55e45bb12b40 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa33d7fa640 1 -- 172.21.15.39:0/3416927923 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340036040 con 0x55e45bb12b40 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.671+0000 7fa33d7fa640 1 -- 172.21.15.39:0/3416927923 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400045f0 con 0x55e45bb12b40 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3416927923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 msgr2=0x55e45bb11090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa346ffd640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 0x7fa3340a50c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55e45bb0eac0 tx=0x7fa3380d2d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa340031f80 tx=0x7fa340005ef0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3416927923 shutdown_connections 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb1c370 0x55e45bb1e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb115d0 0x55e45bb11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3416927923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb11090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3416927923 >> 172.21.15.39:0/3416927923 conn(0x55e45bada310 msgr2=0x55e45bb0dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3416927923 shutdown_connections 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3416927923 wait complete. 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.672+0000 7fa34fb6a740 1 -- start start 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 Processor -- start 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 0x55e45bb1bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 0x55e45bb19020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb19610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e45bb1ee90 con 0x55e45bb1c370 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e45ba32060 con 0x55e45bb12b40 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e45bb1f010 con 0x55e45bb115d0 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 0x55e45bb1bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa34fb6a740 10 client.0 _ll_register_callbacks cb 0x55e45b7858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:17.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 0x55e45bb1bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:46410/0 (socket says 172.21.15.39:46410) 2024-09-12T02:00:17.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa3477fe640 1 -- 172.21.15.39:0/2671127371 learned_addr learned my addr 172.21.15.39:0/2671127371 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:17.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.673+0000 7fa33ffff640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 0x55e45bb19020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa3477fe640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb19610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 -- 172.21.15.39:0/2671127371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 msgr2=0x55e45bb1bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 0x55e45bb1bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 -- 172.21.15.39:0/2671127371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 msgr2=0x55e45bb19610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb19610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 -- 172.21.15.39:0/2671127371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45b7e83c0 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa33ffff640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 0x55e45bb19020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa3480ffed0 tx=0x7fa33000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28aeda56bc460d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa32e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33000fe60 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa340036040 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.674+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa3300120d0 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa3300047a0 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 10 client.25814 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e45bb331a0 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340036040 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa330010550 con 0x55e45bb12b40 2024-09-12T02:00:17.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 10 client.25814 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 10 client.25814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 20 client.25814 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb34700 0x55e45bb36af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 4 client.25814 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e45ba84860 con 0x55e45bb34700 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.675+0000 7fa3477fe640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb34700 0x55e45bb36af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa32e7fc640 10 client.25814 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa3477fe640 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb34700 0x55e45bb36af0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2323148e1ba94263 server_cookie=f667978f3c840cde in_seq=0 out_seq=0 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa32e7fc640 1 -- 172.21.15.39:0/2671127371 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e45ba84860 con 0x55e45bb34700 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa32e7fc640 10 client.25814 handle_command_reply: tid=0 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 client.25814 shutdown 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 msgr2=0x55e45bb19020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 0x55e45bb19020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa3480ffed0 tx=0x7fa33000f790 comp rx=0 tx=0).stop 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 shutdown_connections 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb34700 0x55e45bb36af0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb19610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb12b40 0x55e45bb19020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/2671127371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb115d0 0x55e45bb1bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa32e7fc640 0 client.25814 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.676+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 >> 172.21.15.39:0/2671127371 conn(0x55e45bada310 msgr2=0x55e45bb13960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.677+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 shutdown_connections 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.677+0000 7fa34fb6a740 1 -- 172.21.15.39:0/2671127371 wait complete. 2024-09-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.677+0000 7fa34fb6a740 20 client.25814 trim_cache size 0 max 16384 2024-09-12T02:00:17.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 Processor -- start 2024-09-12T02:00:17.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 -- start start 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb3c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481adbc0 con 0x55e45bb1c370 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481ab490 con 0x55e45bb115d0 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.692+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481a92e0 con 0x55e45bb12b40 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa33ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb3c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59546/0 (socket says 172.21.15.39:59546) 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 -- 172.21.15.39:0/547168369 learned_addr learned my addr 172.21.15.39:0/547168369 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 -- 172.21.15.39:0/547168369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 msgr2=0x55e45bb3c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb3c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 -- 172.21.15.39:0/547168369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 msgr2=0x55e45bb309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 -- 172.21.15.39:0/547168369 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45bb19bf0 con 0x55e45bb1c370 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa33ffff640 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:17.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa3477fe640 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa340005fe0 tx=0x7fa340005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888ff5cb2466454d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa33cff9640 1 -- 172.21.15.39:0/547168369 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34004a040 con 0x55e45bb1c370 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa33cff9640 1 -- 172.21.15.39:0/547168369 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340036050 con 0x55e45bb1c370 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.693+0000 7fa33cff9640 1 -- 172.21.15.39:0/547168369 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34002f610 con 0x55e45bb1c370 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 -- 172.21.15.39:0/547168369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 msgr2=0x55e45bb3c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa340005fe0 tx=0x7fa340005ef0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 -- 172.21.15.39:0/547168369 shutdown_connections 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb1c370 0x55e45bb3c900 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb12b40 0x55e45bb3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/547168369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 -- 172.21.15.39:0/547168369 >> 172.21.15.39:0/547168369 conn(0x55e45bada310 msgr2=0x55e45bb18110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 -- 172.21.15.39:0/547168369 shutdown_connections 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.694+0000 7fa34fb6a740 1 -- 172.21.15.39:0/547168369 wait complete. 2024-09-12T02:00:17.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 -- start start 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 Processor -- start 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb16130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb1c370 0x55e45bb16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481a9950 con 0x55e45bb12b40 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481aadc0 con 0x55e45bb115d0 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3481aa020 con 0x55e45bb1c370 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa34fb6a740 10 client.0 _ll_register_callbacks cb 0x7fa330009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa33ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa33ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59562/0 (socket says 172.21.15.39:59562) 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa3477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb16130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa33ffff640 1 -- 172.21.15.39:0/3047485456 learned_addr learned my addr 172.21.15.39:0/3047485456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.695+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb1c370 0x55e45bb16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 -- 172.21.15.39:0/3047485456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb1c370 msgr2=0x55e45bb16bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb1c370 0x55e45bb16bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 -- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 msgr2=0x55e45bb16130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb16130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 -- 172.21.15.39:0/3047485456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45bb9e440 con 0x55e45bb12b40 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa33ffff640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa3300059f0 tx=0x7fa330009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418a7b0f4f018929 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa32e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa330012880 con 0x55e45bb12b40 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa330010640 con 0x55e45bb12b40 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa340036050 con 0x55e45bb12b40 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa330004040 con 0x55e45bb12b40 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa34fb6a740 10 client.16251 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:17.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.696+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e45bb9f720 con 0x55e45bb12b40 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa340036050 con 0x55e45bb12b40 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa33002e030 con 0x55e45bb12b40 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 10 client.16251 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 20 client.16251 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb9fed0 0x55e45bba22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 4 client.16251 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e45ba7ed70 con 0x55e45bb9fed0 2024-09-12T02:00:17.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb9fed0 0x55e45bba22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:17.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa32e7fc640 10 client.16251 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:17.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.697+0000 7fa3477fe640 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb9fed0 0x55e45bba22f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa95eb6426ce4bba server_cookie=6d59dfd2998522c2 in_seq=0 out_seq=0 2024-09-12T02:00:17.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa32e7fc640 1 -- 172.21.15.39:0/3047485456 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e45ba7ed70 con 0x55e45bb9fed0 2024-09-12T02:00:17.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa32e7fc640 10 client.16251 handle_command_reply: tid=0 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 client.16251 shutdown 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 msgr2=0x55e45bb16670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa3300059f0 tx=0x7fa330009c50 comp rx=0 tx=0).stop 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 shutdown_connections 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55e45bb9fed0 0x55e45bba22f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e45bb1c370 0x55e45bb16bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e45bb12b40 0x55e45bb16670 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 --2- 172.21.15.39:0/3047485456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e45bb115d0 0x55e45bb16130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 >> 172.21.15.39:0/3047485456 conn(0x55e45bada310 msgr2=0x55e45bb130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa32e7fc640 0 client.16251 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 shutdown_connections 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 1 -- 172.21.15.39:0/3047485456 wait complete. 2024-09-12T02:00:17.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.698+0000 7fa34fb6a740 20 client.16251 trim_cache size 0 max 16384 2024-09-12T02:00:17.704 INFO:teuthology.orchestra.run.smithi039.stdout:[] 2024-09-12T02:00:17.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 msgr2=0x7fa3340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 0x7fa3340a50c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55e45bb0eac0 tx=0x7fa3380d2d80 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 msgr2=0x7fa34819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa33800ea60 tx=0x7fa33800ef20 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 shutdown_connections 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa348109120 0x7fa34819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fa3340a2c00 0x7fa3340a50c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3481049a0 0x7fa34819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 --2- 172.21.15.39:0/4272336314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa348103ff0 0x7fa34819a5c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 >> 172.21.15.39:0/4272336314 conn(0x7fa3480ffab0 msgr2=0x7fa348100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 shutdown_connections 2024-09-12T02:00:17.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:17.699+0000 7fa34d791640 1 -- 172.21.15.39:0/4272336314 wait complete. 2024-09-12T02:00:18.476 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 103781209, 'ino': 1099511634563, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/generic/group.list'}, {'damage_type': 'backtrace', 'id': 1748527239, 'ino': 1099511634577, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/xfs/group.list'}, {'damage_type': 'backtrace', 'id': 2786885462, 'ino': 1099511634559, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/overlay/group.list'}, {'damage_type': 'backtrace', 'id': 3559830370, 'ino': 1099511634556, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/tests/ext4/group.list'}] 2024-09-12T02:00:18.477 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 27576541, 'ino': 1099511634575, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.lo'}, {'damage_type': 'backtrace', 'id': 118746928, 'ino': 1099511634568, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.o'}, {'damage_type': 'backtrace', 'id': 161479106, 'ino': 1099511634565, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/dataascii.o'}, {'damage_type': 'backtrace', 'id': 163204924, 'ino': 1099511634573, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.lo'}, {'damage_type': 'backtrace', 'id': 334510884, 'ino': 1099511634600, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random.o'}, {'damage_type': 'backtrace', 'id': 415774993, 'ino': 1099511634572, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/datapid.o'}, {'damage_type': 'backtrace', 'id': 424105262, 'ino': 1099511634589, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/string_to_tokens.o'}, {'damage_type': 'backtrace', 'id': 425335784, 'ino': 1099511634585, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.o'}, {'damage_type': 'backtrace', 'id': 433019094, 'ino': 1099511634606, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.lo'}, {'damage_type': 'backtrace', 'id': 504434890, 'ino': 1099511634571, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/databin.o'}, {'damage_type': 'backtrace', 'id': 513812587, 'ino': 1099511634574, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/databin.o'}, {'damage_type': 'backtrace', 'id': 580097386, 'ino': 1099511634594, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.o'}, {'damage_type': 'backtrace', 'id': 617834599, 'ino': 1099511634607, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.a'}, {'damage_type': 'backtrace', 'id': 620319860, 'ino': 1099511634570, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/datapid.o'}, {'damage_type': 'backtrace', 'id': 647125232, 'ino': 1099511634579, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/forker.o'}, {'damage_type': 'backtrace', 'id': 699544314, 'ino': 1099511634561, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs'}, {'damage_type': 'backtrace', 'id': 742247574, 'ino': 1099511634583, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.lo'}, {'damage_type': 'backtrace', 'id': 763163134, 'ino': 1099511634582, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/forker.o'}, {'damage_type': 'backtrace', 'id': 858606000, 'ino': 1099511634569, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/dataascii.lo'}, {'damage_type': 'backtrace', 'id': 929468977, 'ino': 1099511634552, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.ltdep'}, {'damage_type': 'backtrace', 'id': 1079044981, 'ino': 1099511634580, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.lo'}, {'damage_type': 'backtrace', 'id': 1149075062, 'ino': 1099511634611, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/libtest.la'}, {'damage_type': 'backtrace', 'id': 1251418200, 'ino': 1099511634603, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.o'}, {'damage_type': 'backtrace', 'id': 1350585172, 'ino': 1099511634597, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.lo'}, {'damage_type': 'backtrace', 'id': 1576213051, 'ino': 1099511634596, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/str_to_bytes.lo'}, {'damage_type': 'backtrace', 'id': 1822293066, 'ino': 1099511634595, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random_range.o'}, {'damage_type': 'backtrace', 'id': 1870073632, 'ino': 1099511634604, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo'}, {'damage_type': 'backtrace', 'id': 1981511177, 'ino': 1099511634576, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/file_lock.o'}, {'damage_type': 'backtrace', 'id': 2042449890, 'ino': 1099511634601, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.o'}, {'damage_type': 'backtrace', 'id': 2046121377, 'ino': 1099511634586, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/pattern.lo'}, {'damage_type': 'backtrace', 'id': 2086159895, 'ino': 1099511634578, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/file_lock.o'}, {'damage_type': 'backtrace', 'id': 2206999233, 'ino': 1099511634590, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/random_range.o'}, {'damage_type': 'backtrace', 'id': 2324405641, 'ino': 1099511634598, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/tlibio.o'}, {'damage_type': 'backtrace', 'id': 2692308795, 'ino': 1099511634584, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/open_flags.o'}, {'damage_type': 'backtrace', 'id': 2800191460, 'ino': 1099511634593, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/str_to_bytes.o'}, {'damage_type': 'backtrace', 'id': 2922830391, 'ino': 1099511634588, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.lo'}, {'damage_type': 'backtrace', 'id': 2960206526, 'ino': 1099511634602, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/random.lo'}, {'damage_type': 'backtrace', 'id': 2983828890, 'ino': 1099511634587, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/open_flags.o'}, {'damage_type': 'backtrace', 'id': 3250880596, 'ino': 1099511634610, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/libtest.la'}, {'damage_type': 'backtrace', 'id': 3321863291, 'ino': 1099511634605, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/write_log.o'}, {'damage_type': 'backtrace', 'id': 3409894311, 'ino': 1099511634591, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.o'}, {'damage_type': 'backtrace', 'id': 3546256709, 'ino': 1099511634592, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/string_to_tokens.lo'}, {'damage_type': 'backtrace', 'id': 3698649433, 'ino': 1099511634581, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/pattern.o'}, {'damage_type': 'backtrace', 'id': 3866439275, 'ino': 1099511634599, 'path': '/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/.libs/write_log.o'}] 2024-09-12T02:00:18.477 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-12T02:00:19.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:18 smithi039 ceph-mon[31204]: pgmap v439: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 527 op/s 2024-09-12T02:00:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:18 smithi044 ceph-mon[35259]: pgmap v439: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 527 op/s 2024-09-12T02:00:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:18 smithi172 ceph-mon[35073]: pgmap v439: 97 pgs: 97 active+clean; 49 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 527 op/s 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 -- 172.21.15.39:0/790161760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58103710 msgr2=0x7f0c58109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/790161760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58103710 0x7f0c58109fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009ca0 tx=0x7f0c5002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 -- 172.21.15.39:0/790161760 shutdown_connections 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/790161760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58103710 0x7f0c58109fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/790161760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58102d50 0x7f0c581031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/790161760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 -- 172.21.15.39:0/790161760 >> 172.21.15.39:0/790161760 conn(0x7f0c580fd2c0 msgr2=0x7f0c580ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 -- 172.21.15.39:0/790161760 shutdown_connections 2024-09-12T02:00:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.663+0000 7f0c5cae6640 1 -- 172.21.15.39:0/790161760 wait complete. 2024-09-12T02:00:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 Processor -- start 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 -- start start 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58102d50 0x7f0c58198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5810d7e0 con 0x7f0c58103710 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5810d660 con 0x7f0c58102d50 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5cae6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5810d960 con 0x7f0c58101b60 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59588/0 (socket says 172.21.15.39:59588) 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:46438/0 (socket says 172.21.15.39:46438) 2024-09-12T02:00:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 -- 172.21.15.39:0/3275333807 learned_addr learned my addr 172.21.15.39:0/3275333807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58102d50 0x7f0c58198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 -- 172.21.15.39:0/3275333807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 msgr2=0x7f0c58197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 -- 172.21.15.39:0/3275333807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58102d50 msgr2=0x7f0c58198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58102d50 0x7f0c58198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.665+0000 7f0c56d9d640 1 -- 172.21.15.39:0/3275333807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5819fa00 con 0x7f0c58103710 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c56d9d640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005e30 tx=0x7f0c50004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c477fe640 1 -- 172.21.15.39:0/3275333807 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003b70 con 0x7f0c58103710 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c477fe640 1 -- 172.21.15.39:0/3275333807 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c50003d10 con 0x7f0c58103710 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c58074420 con 0x7f0c58103710 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c477fe640 1 -- 172.21.15.39:0/3275333807 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5002fad0 con 0x7f0c58103710 2024-09-12T02:00:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.666+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c58074970 con 0x7f0c58103710 2024-09-12T02:00:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.668+0000 7f0c477fe640 1 -- 172.21.15.39:0/3275333807 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c500045c0 con 0x7f0c58103710 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 Processor -- start 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 -- start start 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a503da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a509370 0x55fe4a50b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a4672f0 con 0x55fe4a5039a0 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a40f270 con 0x55fe4a5042e0 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a4632b0 con 0x55fe4a509370 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c477fe640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 0x7f0c400a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a503da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:33252/0 (socket says 172.21.15.39:33252) 2024-09-12T02:00:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c5659c640 1 -- 172.21.15.39:0/1875430530 learned_addr learned my addr 172.21.15.39:0/1875430530 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a503da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59596/0 (socket says 172.21.15.39:59596) 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c56d9d640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 0x7f0c400a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a509370 0x55fe4a50b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.669+0000 7f0c477fe640 1 -- 172.21.15.39:0/3275333807 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0c500f0020 con 0x7f0c58103710 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 -- 172.21.15.39:0/1875430530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a509370 msgr2=0x55fe4a50b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a509370 0x55fe4a50b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 -- 172.21.15.39:0/1875430530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 msgr2=0x55fe4a503da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a503da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 -- 172.21.15.39:0/1875430530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4a40e340 con 0x55fe4a5042e0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c5659c640 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009ca0 tx=0x7f0c4c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cbbf33ffbce6fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c56d9d640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 0x7f0c400a50f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0c500bc940 tx=0x7f0c50087750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c44ff9640 1 -- 172.21.15.39:0/1875430530 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004220 con 0x55fe4a5042e0 2024-09-12T02:00:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c44ff9640 1 -- 172.21.15.39:0/1875430530 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c009e50 con 0x55fe4a5042e0 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.670+0000 7f0c44ff9640 1 -- 172.21.15.39:0/1875430530 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c019760 con 0x55fe4a5042e0 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- 172.21.15.39:0/1875430530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 msgr2=0x55fe4a508da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009ca0 tx=0x7f0c4c011810 comp rx=0 tx=0).stop 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- 172.21.15.39:0/1875430530 shutdown_connections 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a509370 0x55fe4a50b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5042e0 0x55fe4a508da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/1875430530 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a503da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- 172.21.15.39:0/1875430530 >> 172.21.15.39:0/1875430530 conn(0x55fe4a4ff010 msgr2=0x55fe4a4ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- 172.21.15.39:0/1875430530 shutdown_connections 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- 172.21.15.39:0/1875430530 wait complete. 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 -- start start 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.671+0000 7f0c5f87d740 1 Processor -- start 2024-09-12T02:00:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a50e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a5150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a50c340 con 0x55fe4a5039a0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a3f0290 con 0x55fe4a509370 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe4a50c4c0 con 0x55fe4a5042e0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 10 client.0 _ll_register_callbacks cb 0x55fe4a421140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59608/0 (socket says 172.21.15.39:59608) 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 -- 172.21.15.39:0/781343218 learned_addr learned my addr 172.21.15.39:0/781343218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a50e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a5150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 -- 172.21.15.39:0/781343218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 msgr2=0x55fe4a50e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a50e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 -- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 msgr2=0x55fe4a5150e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a5150e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 -- 172.21.15.39:0/781343218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4a17a210 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009e80 tx=0x7f0c48012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c616e0fdf7c25f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48005020 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0c48009040 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.672+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c009e50 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c48004020 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 10 client.16263 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe4a246620 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c009e50 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0c4801c030 con 0x55fe4a5039a0 2024-09-12T02:00:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 10 client.16263 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 20 client.16263 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a51bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 4 client.16263 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe4a474a20 con 0x55fe4a519840 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.673+0000 7f0c5659c640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a51bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c3dffb640 10 client.16263 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c5659c640 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a51bc80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c89e7fe91cae6b server_cookie=77529951c258d5f in_seq=0 out_seq=0 2024-09-12T02:00:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c3dffb640 1 -- 172.21.15.39:0/781343218 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe4a474a20 con 0x55fe4a519840 2024-09-12T02:00:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c3dffb640 10 client.16263 handle_command_reply: tid=0 2024-09-12T02:00:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c5f87d740 1 client.16263 shutdown 2024-09-12T02:00:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 msgr2=0x55fe4a50dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.674+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009e80 tx=0x7f0c48012040 comp rx=0 tx=0).stop 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 shutdown_connections 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a51bc80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c3dffb640 0 client.16263 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a5150e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a50e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/781343218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5039a0 0x55fe4a50dbd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 >> 172.21.15.39:0/781343218 conn(0x55fe4a4ff010 msgr2=0x55fe4a500820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 shutdown_connections 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 1 -- 172.21.15.39:0/781343218 wait complete. 2024-09-12T02:00:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.675+0000 7f0c5f87d740 20 client.16263 trim_cache size 0 max 16384 2024-09-12T02:00:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 Processor -- start 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 -- start start 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5039a0 0x55fe4a51bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a9670 con 0x55fe4a509370 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a6f40 con 0x55fe4a5039a0 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.690+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a4d90 con 0x55fe4a5042e0 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c55d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59624/0 (socket says 172.21.15.39:59624) 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:46468/0 (socket says 172.21.15.39:46468) 2024-09-12T02:00:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c55d9b640 1 -- 172.21.15.39:0/3061755199 learned_addr learned my addr 172.21.15.39:0/3061755199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5039a0 0x55fe4a51bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 -- 172.21.15.39:0/3061755199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5039a0 msgr2=0x55fe4a51bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5039a0 0x55fe4a51bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 -- 172.21.15.39:0/3061755199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 msgr2=0x55fe4a4ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 -- 172.21.15.39:0/3061755199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4a50d710 con 0x55fe4a5042e0 2024-09-12T02:00:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c5659c640 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01b040 tx=0x7f0c4c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49393bf9f43d95f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.691+0000 7f0c3ffff640 1 -- 172.21.15.39:0/3061755199 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c02f070 con 0x55fe4a5042e0 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c3ffff640 1 -- 172.21.15.39:0/3061755199 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c0040d0 con 0x55fe4a5042e0 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c3ffff640 1 -- 172.21.15.39:0/3061755199 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c003a10 con 0x55fe4a5042e0 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 -- 172.21.15.39:0/3061755199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 msgr2=0x55fe4a515000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01b040 tx=0x7f0c4c011810 comp rx=0 tx=0).stop 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 -- 172.21.15.39:0/3061755199 shutdown_connections 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a509370 0x55fe4a4ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5042e0 0x55fe4a515000 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/3061755199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a5039a0 0x55fe4a51bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 -- 172.21.15.39:0/3061755199 >> 172.21.15.39:0/3061755199 conn(0x55fe4a4ff010 msgr2=0x55fe4a50d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 -- 172.21.15.39:0/3061755199 shutdown_connections 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.692+0000 7f0c5f87d740 1 -- 172.21.15.39:0/3061755199 wait complete. 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 -- start start 2024-09-12T02:00:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 Processor -- start 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5039a0 0x55fe4a512440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a513990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a5400 con 0x55fe4a5042e0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a6870 con 0x55fe4a509370 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581a5ad0 con 0x55fe4a5039a0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5f87d740 10 client.0 _ll_register_callbacks cb 0x7f0c480096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59636/0 (socket says 172.21.15.39:59636) 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 -- 172.21.15.39:0/143150947 learned_addr learned my addr 172.21.15.39:0/143150947 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5039a0 0x55fe4a512440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a513990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.697 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 -- 172.21.15.39:0/143150947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5039a0 msgr2=0x55fe4a512440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5039a0 0x55fe4a512440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 -- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 msgr2=0x55fe4a513990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a513990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c5659c640 1 -- 172.21.15.39:0/143150947 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4a513fa0 con 0x55fe4a5042e0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.693+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a513990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c5659c640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005730 tx=0x7f0c4c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bbe5ce56eceb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c039020 con 0x55fe4a5042e0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0c4c005220 con 0x55fe4a5042e0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe4a46ed70 con 0x55fe4a5042e0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c02f070 con 0x55fe4a5042e0 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c5f87d740 10 client.16269 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe4a5152b0 con 0x55fe4a5042e0 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.694+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55fe4a46ed70 con 0x55fe4a5042e0 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0c4c004920 con 0x55fe4a5042e0 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 10 client.16269 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 20 client.16269 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a586b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 4 client.16269 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe4a3eb900 con 0x55fe4a519840 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a586b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c55d9b640 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a586b50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c049ccbb59277d5 server_cookie=d9c1c476198edd9c in_seq=0 out_seq=0 2024-09-12T02:00:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.695+0000 7f0c3dffb640 10 client.16269 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c3dffb640 1 -- 172.21.15.39:0/143150947 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe4a3eb900 con 0x55fe4a519840 2024-09-12T02:00:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c3dffb640 10 client.16269 handle_command_reply: tid=0 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 client.16269 shutdown 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 msgr2=0x55fe4a512980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005730 tx=0x7f0c4c009ec0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 shutdown_connections 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55fe4a519840 0x55fe4a586b50 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c3dffb640 0 client.16269 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fe4a509370 0x55fe4a513990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55fe4a5042e0 0x55fe4a512980 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 --2- 172.21.15.39:0/143150947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe4a5039a0 0x55fe4a512440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 >> 172.21.15.39:0/143150947 conn(0x55fe4a4ff010 msgr2=0x55fe4a4fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 shutdown_connections 2024-09-12T02:00:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.707+0000 7f0c5f87d740 1 -- 172.21.15.39:0/143150947 wait complete. 2024-09-12T02:00:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5f87d740 20 client.16269 trim_cache size 0 max 16384 2024-09-12T02:00:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:00:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:00:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:00:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:00:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 msgr2=0x7f0c400a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 0x7f0c400a50f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0c500bc940 tx=0x7f0c50087750 comp rx=0 tx=0).stop 2024-09-12T02:00:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 msgr2=0x7f0c5819f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0c50005e30 tx=0x7f0c50004ab0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 shutdown_connections 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c58103710 0x7f0c5819f390 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c58102d50 0x7f0c58198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f0c400a2c30 0x7f0c400a50f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 --2- 172.21.15.39:0/3275333807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101b60 0x7f0c58197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 >> 172.21.15.39:0/3275333807 conn(0x7f0c580fd2c0 msgr2=0x7f0c581060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 shutdown_connections 2024-09-12T02:00:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:20.708+0000 7f0c5cae6640 1 -- 172.21.15.39:0/3275333807 wait complete. 2024-09-12T02:00:21.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:20 smithi039 ceph-mon[31204]: pgmap v440: 97 pgs: 97 active+clean; 51 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 750 op/s 2024-09-12T02:00:21.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:21.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:21.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:21.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:00:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:20 smithi044 ceph-mon[35259]: pgmap v440: 97 pgs: 97 active+clean; 51 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 750 op/s 2024-09-12T02:00:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:00:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:20 smithi172 ceph-mon[35073]: pgmap v440: 97 pgs: 97 active+clean; 51 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 750 op/s 2024-09-12T02:00:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:00:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:00:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:00:21.254 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:00:21.374 INFO:tasks.workunit.client.0.smithi039.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-12T02:00:21.374 INFO:tasks.workunit.client.0.smithi039.stdout:All 50000 operations completed A-OK! 2024-09-12T02:00:21.374 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-12T02:00:21.377 INFO:tasks.workunit.client.0.smithi039.stdout:Seed set to 1 2024-09-12T02:00:21.505 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T02:00:21.505 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T02:00:21.507 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T02:00:21.507 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T02:00:21.507 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T02:00:21.510 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T02:00:21.512 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero length punch hole 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero length punch hole 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero length punch hole 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero size read 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero length punch hole 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero size read 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero length punch hole 2024-09-12T02:00:21.513 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x4310e9 2024-09-12T02:00:21.519 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x954a45 2024-09-12T02:00:21.547 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x9bc582 2024-09-12T02:00:21.568 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x9eecbc 2024-09-12T02:00:23.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:22 smithi039 ceph-mon[31204]: pgmap v441: 97 pgs: 97 active+clean; 51 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 469 op/s 2024-09-12T02:00:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:22 smithi044 ceph-mon[35259]: pgmap v441: 97 pgs: 97 active+clean; 51 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 469 op/s 2024-09-12T02:00:23.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:22 smithi172 ceph-mon[35073]: pgmap v441: 97 pgs: 97 active+clean; 51 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 469 op/s 2024-09-12T02:00:23.281 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x9fdd84 2024-09-12T02:00:25.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:24 smithi039 ceph-mon[31204]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 618 op/s 2024-09-12T02:00:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:24 smithi044 ceph-mon[35259]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 618 op/s 2024-09-12T02:00:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:24 smithi172 ceph-mon[35073]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 618 op/s 2024-09-12T02:00:27.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:26 smithi039 ceph-mon[31204]: pgmap v443: 97 pgs: 97 active+clean; 50 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-12T02:00:27.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:26 smithi044 ceph-mon[35259]: pgmap v443: 97 pgs: 97 active+clean; 50 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-12T02:00:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:26 smithi172 ceph-mon[35073]: pgmap v443: 97 pgs: 97 active+clean; 50 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 599 op/s 2024-09-12T02:00:29.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:28 smithi039 ceph-mon[31204]: pgmap v444: 97 pgs: 97 active+clean; 51 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 571 op/s 2024-09-12T02:00:29.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:28 smithi044 ceph-mon[35259]: pgmap v444: 97 pgs: 97 active+clean; 51 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 571 op/s 2024-09-12T02:00:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:28 smithi172 ceph-mon[35073]: pgmap v444: 97 pgs: 97 active+clean; 51 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.2 MiB/s wr, 571 op/s 2024-09-12T02:00:31.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:30 smithi039 ceph-mon[31204]: pgmap v445: 97 pgs: 97 active+clean; 56 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.3 MiB/s wr, 797 op/s 2024-09-12T02:00:31.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:30 smithi044 ceph-mon[35259]: pgmap v445: 97 pgs: 97 active+clean; 56 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.3 MiB/s wr, 797 op/s 2024-09-12T02:00:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:30 smithi172 ceph-mon[35073]: pgmap v445: 97 pgs: 97 active+clean; 56 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.3 MiB/s wr, 797 op/s 2024-09-12T02:00:32.835 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x9ff773 2024-09-12T02:00:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:32 smithi039 ceph-mon[31204]: pgmap v446: 97 pgs: 97 active+clean; 57 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 730 op/s 2024-09-12T02:00:33.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:32 smithi044 ceph-mon[35259]: pgmap v446: 97 pgs: 97 active+clean; 57 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 730 op/s 2024-09-12T02:00:33.189 INFO:tasks.workunit.client.0.smithi039.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-12T02:00:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:32 smithi172 ceph-mon[35073]: pgmap v446: 97 pgs: 97 active+clean; 57 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 730 op/s 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.805+0000 7fdf54e0e640 1 -- 172.21.15.39:0/3481088942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50101b70 msgr2=0x7fdf50101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.805+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/3481088942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50101b70 0x7fdf50101f70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009900 tx=0x7fdf4002a410 comp rx=0 tx=0).stop 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 -- 172.21.15.39:0/3481088942 shutdown_connections 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/3481088942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50103720 0x7fdf50109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/3481088942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50102d60 0x7fdf501031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/3481088942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50101b70 0x7fdf50101f70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 -- 172.21.15.39:0/3481088942 >> 172.21.15.39:0/3481088942 conn(0x7fdf500fd2f0 msgr2=0x7fdf500ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 -- 172.21.15.39:0/3481088942 shutdown_connections 2024-09-12T02:00:33.806 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 -- 172.21.15.39:0/3481088942 wait complete. 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 Processor -- start 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.806+0000 7fdf54e0e640 1 -- start start 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50101b70 0x7fdf50197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50103720 0x7fdf5019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d7f0 con 0x7fdf50102d60 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d670 con 0x7fdf50103720 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf54e0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5010d970 con 0x7fdf50101b70 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59048/0 (socket says 172.21.15.39:59048) 2024-09-12T02:00:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50101b70 0x7fdf50197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/687710339 learned_addr learned my addr 172.21.15.39:0/687710339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50103720 0x7fdf5019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/687710339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50101b70 msgr2=0x7fdf50197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50101b70 0x7fdf50197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/687710339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50103720 msgr2=0x7fdf5019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50103720 0x7fdf5019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/687710339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5019f9e0 con 0x7fdf50102d60 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.807+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e9f0 tx=0x7fdf4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.808+0000 7fdf3f7fe640 1 -- 172.21.15.39:0/687710339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400cd80 con 0x7fdf50102d60 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.808+0000 7fdf3f7fe640 1 -- 172.21.15.39:0/687710339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf44010910 con 0x7fdf50102d60 2024-09-12T02:00:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.808+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5019fcd0 con 0x7fdf50102d60 2024-09-12T02:00:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.808+0000 7fdf3f7fe640 1 -- 172.21.15.39:0/687710339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44018990 con 0x7fdf50102d60 2024-09-12T02:00:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.808+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf501a01d0 con 0x7fdf50102d60 2024-09-12T02:00:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.810+0000 7fdf3f7fe640 1 -- 172.21.15.39:0/687710339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdf44010ac0 con 0x7fdf50102d60 2024-09-12T02:00:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.810+0000 7fdf57c83740 1 Processor -- start 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 -- start start 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b56f0 0x5570612ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5570612142f0 con 0x5570612ba780 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5570611bc270 con 0x5570612b4db0 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf57c83740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5570612102b0 con 0x5570612b56f0 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59060/0 (socket says 172.21.15.39:59060) 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/3082428019 learned_addr learned my addr 172.21.15.39:0/3082428019 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf3f7fe640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 0x7fdf380a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b56f0 0x5570612ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 0x7fdf380a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/3082428019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b56f0 msgr2=0x5570612ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf3f7fe640 1 -- 172.21.15.39:0/687710339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdf440cf320 con 0x7fdf50102d60 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b56f0 0x5570612ba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/3082428019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 msgr2=0x5570612bcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/3082428019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570611bb340 con 0x5570612b4db0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.811+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.812+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612b51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005fd0 tx=0x7fdf48013ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=683434db56250b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.812+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 0x7fdf380a50f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800f850 tx=0x7fdf48020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.812+0000 7fdf3cff9640 1 -- 172.21.15.39:0/3082428019 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4801fd10 con 0x5570612b4db0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.812+0000 7fdf3cff9640 1 -- 172.21.15.39:0/3082428019 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf48023020 con 0x5570612b4db0 2024-09-12T02:00:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.812+0000 7fdf3cff9640 1 -- 172.21.15.39:0/3082428019 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48004290 con 0x5570612b4db0 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- 172.21.15.39:0/3082428019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 msgr2=0x5570612b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612b51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005fd0 tx=0x7fdf48013ef0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- 172.21.15.39:0/3082428019 shutdown_connections 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612bcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b56f0 0x5570612ba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3082428019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612b51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- 172.21.15.39:0/3082428019 >> 172.21.15.39:0/3082428019 conn(0x5570612ac010 msgr2=0x5570612ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- 172.21.15.39:0/3082428019 shutdown_connections 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- 172.21.15.39:0/3082428019 wait complete. 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 -- start start 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 Processor -- start 2024-09-12T02:00:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.813+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612bef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5570612bd6f0 con 0x5570612b56f0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55706119d290 con 0x5570612b4db0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5570612bd870 con 0x5570612ba780 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 10 client.0 _ll_register_callbacks cb 0x5570611ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59072/0 (socket says 172.21.15.39:59072) 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59670/0 (socket says 172.21.15.39:59670) 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/2470155420 learned_addr learned my addr 172.21.15.39:0/2470155420 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/2470155420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 msgr2=0x5570612c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 msgr2=0x5570612bef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612bef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/2470155420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557060f27210 con 0x5570612b56f0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdf440cce80 tx=0x7fdf440d2910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735082e488428214 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4409b5a0 con 0x5570612b56f0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdf44018b30 con 0x5570612b56f0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.814+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf48023020 con 0x5570612b56f0 2024-09-12T02:00:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf4409bc40 con 0x5570612b56f0 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 10 client.16281 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557060ff3620 con 0x5570612b56f0 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf48023020 con 0x5570612b56f0 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdf440ce030 con 0x5570612b56f0 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 10 client.16281 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 20 client.16281 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5570612cac40 0x5570612cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 4 client.16281 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557061221a20 con 0x5570612cac40 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.815+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5570612cac40 0x5570612cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.816+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5570612cac40 0x5570612cd070 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d13d0276b40be2c server_cookie=758113f384871fa9 in_seq=0 out_seq=0 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.816+0000 7fdf35ffb640 10 client.16281 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.816+0000 7fdf35ffb640 1 -- 172.21.15.39:0/2470155420 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557061221a20 con 0x5570612cac40 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.816+0000 7fdf35ffb640 10 client.16281 handle_command_reply: tid=0 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.816+0000 7fdf57c83740 1 client.16281 shutdown 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 msgr2=0x5570612bf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdf440cce80 tx=0x7fdf440d2910 comp rx=0 tx=0).stop 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 shutdown_connections 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5570612cac40 0x5570612cd070 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b56f0 0x5570612bf4b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf35ffb640 0 client.16281 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 --2- 172.21.15.39:0/2470155420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b4db0 0x5570612bef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 >> 172.21.15.39:0/2470155420 conn(0x5570612ac010 msgr2=0x5570612ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 shutdown_connections 2024-09-12T02:00:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 1 -- 172.21.15.39:0/2470155420 wait complete. 2024-09-12T02:00:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.817+0000 7fdf57c83740 20 client.16281 trim_cache size 0 max 16384 2024-09-12T02:00:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 Processor -- start 2024-09-12T02:00:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 -- start start 2024-09-12T02:00:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a95d0 con 0x5570612b4db0 2024-09-12T02:00:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a6ea0 con 0x5570612b56f0 2024-09-12T02:00:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf57c83740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a4cf0 con 0x5570612ba780 2024-09-12T02:00:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59080/0 (socket says 172.21.15.39:59080) 2024-09-12T02:00:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 -- 172.21.15.39:0/3054651859 learned_addr learned my addr 172.21.15.39:0/3054651859 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 -- 172.21.15.39:0/3054651859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 msgr2=0x5570612d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 -- 172.21.15.39:0/3054651859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 msgr2=0x5570612c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4e59c640 1 -- 172.21.15.39:0/3054651859 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570612b5bd0 con 0x5570612b4db0 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.834+0000 7fdf4dd9b640 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.835+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf400314e0 tx=0x7fdf40005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa5232d14be8bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.835+0000 7fdf37fff640 1 -- 172.21.15.39:0/3054651859 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4004b070 con 0x5570612b4db0 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.835+0000 7fdf37fff640 1 -- 172.21.15.39:0/3054651859 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf40005520 con 0x5570612b4db0 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.835+0000 7fdf37fff640 1 -- 172.21.15.39:0/3054651859 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40035040 con 0x5570612b4db0 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- 172.21.15.39:0/3054651859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 msgr2=0x5570612d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf400314e0 tx=0x7fdf40005fd0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- 172.21.15.39:0/3054651859 shutdown_connections 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612ba780 0x5570612d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- 172.21.15.39:0/3054651859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612b4db0 0x5570612d19c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- 172.21.15.39:0/3054651859 >> 172.21.15.39:0/3054651859 conn(0x5570612ac010 msgr2=0x5570612ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- 172.21.15.39:0/3054651859 shutdown_connections 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- 172.21.15.39:0/3054651859 wait complete. 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- start start 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 Processor -- start 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 0x5570612c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a5360 con 0x5570612ba780 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a67d0 con 0x5570612b56f0 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501a5a30 con 0x5570612b4db0 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf57c83740 10 client.0 _ll_register_callbacks cb 0x7fdf4400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.836+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59682/0 (socket says 172.21.15.39:59682) 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59084/0 (socket says 172.21.15.39:59084) 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4dd9b640 1 -- 172.21.15.39:0/1721624036 learned_addr learned my addr 172.21.15.39:0/1721624036 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 0x5570612c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/1721624036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 msgr2=0x5570612c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 0x5570612c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 msgr2=0x5570612c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 -- 172.21.15.39:0/1721624036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570612c5c40 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 0x5570612c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf4ed9d640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf48013930 tx=0x7fdf4801fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5c68b8b0507577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48031060 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf40005520 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdf4800fcb0 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf48003970 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf57c83740 10 client.16287 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.837+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557061335f70 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf40005520 con 0x5570612ba780 2024-09-12T02:00:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdf480055f0 con 0x5570612ba780 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 10 client.16287 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 20 client.16287 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557061336800 0x557061338c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 4 client.16287 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55706121bd70 con 0x557061336800 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557061336800 0x557061338c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf4e59c640 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557061336800 0x557061338c20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c299ecaf04c3368 server_cookie=99813361fca66954 in_seq=0 out_seq=0 2024-09-12T02:00:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.838+0000 7fdf35ffb640 10 client.16287 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf35ffb640 1 -- 172.21.15.39:0/1721624036 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55706121bd70 con 0x557061336800 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf35ffb640 10 client.16287 handle_command_reply: tid=0 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 client.16287 shutdown 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 msgr2=0x5570612c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf48013930 tx=0x7fdf4801fce0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 shutdown_connections 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x557061336800 0x557061338c20 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5570612ba780 0x5570612c5630 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5570612b56f0 0x5570612c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 --2- 172.21.15.39:0/1721624036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570612b4db0 0x5570612c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 >> 172.21.15.39:0/1721624036 conn(0x5570612ac010 msgr2=0x5570612ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.854+0000 7fdf35ffb640 0 client.16287 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 shutdown_connections 2024-09-12T02:00:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf57c83740 1 -- 172.21.15.39:0/1721624036 wait complete. 2024-09-12T02:00:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf57c83740 20 client.16287 trim_cache size 0 max 16384 2024-09-12T02:00:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:00:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:00:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:00:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 msgr2=0x7fdf380a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 0x7fdf380a50f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800f850 tx=0x7fdf48020000 comp rx=0 tx=0).stop 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 msgr2=0x7fdf50198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.855+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e9f0 tx=0x7fdf4400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 shutdown_connections 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf50103720 0x7fdf5019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdf50102d60 0x7fdf50198300 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdf380a2c30 0x7fdf380a50f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 --2- 172.21.15.39:0/687710339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf50101b70 0x7fdf50197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 >> 172.21.15.39:0/687710339 conn(0x7fdf500fd2f0 msgr2=0x7fdf501060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 shutdown_connections 2024-09-12T02:00:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:33.856+0000 7fdf54e0e640 1 -- 172.21.15.39:0/687710339 wait complete. 2024-09-12T02:00:35.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:34 smithi039 ceph-mon[31204]: pgmap v447: 97 pgs: 97 active+clean; 55 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.8 MiB/s wr, 858 op/s 2024-09-12T02:00:35.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:34 smithi044 ceph-mon[35259]: pgmap v447: 97 pgs: 97 active+clean; 55 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.8 MiB/s wr, 858 op/s 2024-09-12T02:00:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:34 smithi172 ceph-mon[35073]: pgmap v447: 97 pgs: 97 active+clean; 55 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.8 MiB/s wr, 858 op/s 2024-09-12T02:00:37.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:36 smithi039 ceph-mon[31204]: pgmap v448: 97 pgs: 97 active+clean; 53 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 899 op/s 2024-09-12T02:00:37.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:36 smithi044 ceph-mon[35259]: pgmap v448: 97 pgs: 97 active+clean; 53 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 899 op/s 2024-09-12T02:00:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:36 smithi172 ceph-mon[35073]: pgmap v448: 97 pgs: 97 active+clean; 53 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 899 op/s 2024-09-12T02:00:39.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:38 smithi039 ceph-mon[31204]: pgmap v449: 97 pgs: 97 active+clean; 53 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.4 MiB/s wr, 813 op/s 2024-09-12T02:00:39.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:38 smithi044 ceph-mon[35259]: pgmap v449: 97 pgs: 97 active+clean; 53 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.4 MiB/s wr, 813 op/s 2024-09-12T02:00:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:38 smithi172 ceph-mon[35073]: pgmap v449: 97 pgs: 97 active+clean; 53 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.4 MiB/s wr, 813 op/s 2024-09-12T02:00:40.212 INFO:tasks.workunit.client.0.smithi039.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-12T02:00:41.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:40 smithi039 ceph-mon[31204]: pgmap v450: 97 pgs: 97 active+clean; 51 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 949 op/s 2024-09-12T02:00:41.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:40 smithi044 ceph-mon[35259]: pgmap v450: 97 pgs: 97 active+clean; 51 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 949 op/s 2024-09-12T02:00:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:40 smithi172 ceph-mon[35073]: pgmap v450: 97 pgs: 97 active+clean; 51 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.9 MiB/s wr, 949 op/s 2024-09-12T02:00:43.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:42 smithi039 ceph-mon[31204]: pgmap v451: 97 pgs: 97 active+clean; 53 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 843 op/s 2024-09-12T02:00:43.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:42 smithi044 ceph-mon[35259]: pgmap v451: 97 pgs: 97 active+clean; 53 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 843 op/s 2024-09-12T02:00:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:42 smithi172 ceph-mon[35073]: pgmap v451: 97 pgs: 97 active+clean; 53 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.7 MiB/s wr, 843 op/s 2024-09-12T02:00:44.239 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x9ffb01 2024-09-12T02:00:45.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:44 smithi039 ceph-mon[31204]: pgmap v452: 97 pgs: 97 active+clean; 53 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 772 op/s 2024-09-12T02:00:45.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:44 smithi044 ceph-mon[35259]: pgmap v452: 97 pgs: 97 active+clean; 53 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 772 op/s 2024-09-12T02:00:45.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:44 smithi172 ceph-mon[35073]: pgmap v452: 97 pgs: 97 active+clean; 53 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 772 op/s 2024-09-12T02:00:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3750667209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd941025d0 msgr2=0x7fcd941049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3750667209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd941025d0 0x7fcd941049c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009ca0 tx=0x7fcd8402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3750667209 shutdown_connections 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3750667209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd94107830 0x7fcd94109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3750667209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3750667209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd941025d0 0x7fcd941049c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3750667209 >> 172.21.15.39:0/3750667209 conn(0x7fcd940fc1b0 msgr2=0x7fcd940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3750667209 shutdown_connections 2024-09-12T02:00:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.953+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3750667209 wait complete. 2024-09-12T02:00:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 Processor -- start 2024-09-12T02:00:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 -- start start 2024-09-12T02:00:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd941025d0 0x7fcd94197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd94198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9410d810 con 0x7fcd94107830 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9410d690 con 0x7fcd94104f00 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd9b53b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9410d990 con 0x7fcd941025d0 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.954+0000 7fcd99ad8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd94198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54736/0 (socket says 172.21.15.39:54736) 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 -- 172.21.15.39:0/3368781642 learned_addr learned my addr 172.21.15.39:0/3368781642 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd992d7640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd941025d0 0x7fcd94197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 -- 172.21.15.39:0/3368781642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd941025d0 msgr2=0x7fcd94197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd941025d0 0x7fcd94197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 -- 172.21.15.39:0/3368781642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 msgr2=0x7fcd94198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd94198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 -- 172.21.15.39:0/3368781642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9419fa10 con 0x7fcd94107830 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd94198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd99ad8640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00d720 tx=0x7fcd8c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd927fc640 1 -- 172.21.15.39:0/3368781642 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c017070 con 0x7fcd94107830 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9419fd00 con 0x7fcd94107830 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd927fc640 1 -- 172.21.15.39:0/3368781642 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd8c00de30 con 0x7fcd94107830 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd927fc640 1 -- 172.21.15.39:0/3368781642 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c004d90 con 0x7fcd94107830 2024-09-12T02:00:46.959 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.955+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941a01a0 con 0x7fcd94107830 2024-09-12T02:00:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd927fc640 1 -- 172.21.15.39:0/3368781642 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcd8c005020 con 0x7fcd94107830 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 Processor -- start 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 -- start start 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f96dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f975830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a93f8d12f0 con 0x55a93f96e2e0 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a93f879270 con 0x55a93f973370 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.958+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a93f8cd2b0 con 0x55a93f96d9a0 2024-09-12T02:00:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd927fc640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 0x7fcd7c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd992d7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f975830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd992d7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54740/0 (socket says 172.21.15.39:54740) 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd992d7640 1 -- 172.21.15.39:0/959975098 learned_addr learned my addr 172.21.15.39:0/959975098 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f96dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd99ad8640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 0x7fcd7c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd927fc640 1 -- 172.21.15.39:0/3368781642 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd8c0ce880 con 0x7fcd94107830 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 -- 172.21.15.39:0/959975098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 msgr2=0x55a93f96dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f96dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 -- 172.21.15.39:0/959975098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 msgr2=0x55a93f972da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 -- 172.21.15.39:0/959975098 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93f878340 con 0x55a93f973370 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd992d7640 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f975830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd94199300 tx=0x7fcd88005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7045a88a1d1389 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd99ad8640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 0x7fcd7c0a50f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005d00 tx=0x7fcd8c065e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.959+0000 7fcd7b7fe640 1 -- 172.21.15.39:0/959975098 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801ae60 con 0x55a93f973370 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd7b7fe640 1 -- 172.21.15.39:0/959975098 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88005500 con 0x55a93f973370 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd7b7fe640 1 -- 172.21.15.39:0/959975098 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88004de0 con 0x55a93f973370 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/959975098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 msgr2=0x55a93f975830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f975830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd94199300 tx=0x7fcd88005850 comp rx=0 tx=0).stop 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/959975098 shutdown_connections 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f975830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f972da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/959975098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f96dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.960+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/959975098 >> 172.21.15.39:0/959975098 conn(0x55a93f969010 msgr2=0x55a93f969410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/959975098 shutdown_connections 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/959975098 wait complete. 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- start start 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 Processor -- start 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f977b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 0x55a93f97f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55a93f9762e0 con 0x55a93f973370 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a93f85a290 con 0x55a93f96e2e0 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a93f976460 con 0x55a93f96d9a0 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd9e2d5740 10 client.0 _ll_register_callbacks cb 0x55a93f88b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 0x55a93f97f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.961+0000 7fcd992d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43856/0 (socket says 172.21.15.39:43856) 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 -- 172.21.15.39:0/1529626742 learned_addr learned my addr 172.21.15.39:0/1529626742 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 0x55a93f97f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54754/0 (socket says 172.21.15.39:54754) 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f977b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 -- 172.21.15.39:0/1529626742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 msgr2=0x55a93f977b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f977b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 -- 172.21.15.39:0/1529626742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 msgr2=0x55a93f97f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 0x55a93f97f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 -- 172.21.15.39:0/1529626742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a93f5e4210 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd992d7640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd8402f540 tx=0x7fcd84031a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3dbdaf21e9afcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8402f610 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd8402f7b0 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd88005500 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd8402f9f0 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd9e2d5740 10 client.25868 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.962+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a93f6b0620 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88005500 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fcd84045440 con 0x55a93f96e2e0 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 10 client.25868 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 10 client.25868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 20 client.25868 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f983910 0x55a93f985d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 4 client.25868 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a93f8dea20 con 0x55a93f983910 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f983910 0x55a93f985d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd78ff9640 10 client.25868 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.963+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f983910 0x55a93f985d30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42d7fc37d883ef3 server_cookie=ee986f90792af825 in_seq=0 out_seq=0 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd78ff9640 1 -- 172.21.15.39:0/1529626742 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a93f8dea20 con 0x55a93f983910 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd78ff9640 10 client.25868 handle_command_reply: tid=0 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 client.25868 shutdown 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 msgr2=0x55a93f9780d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd8402f540 tx=0x7fcd84031a00 comp rx=0 tx=0).stop 2024-09-12T02:00:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 shutdown_connections 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f983910 0x55a93f985d30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f973370 0x55a93f97f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f9780d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/1529626742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f977b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd78ff9640 0 client.25868 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 >> 172.21.15.39:0/1529626742 conn(0x55a93f969010 msgr2=0x55a93f96a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 shutdown_connections 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/1529626742 wait complete. 2024-09-12T02:00:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.965+0000 7fcd9e2d5740 20 client.25868 trim_cache size 0 max 16384 2024-09-12T02:00:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.982+0000 7fcd9e2d5740 1 Processor -- start 2024-09-12T02:00:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.982+0000 7fcd9e2d5740 1 -- start start 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f97f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f973370 0x55a93f96a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a9610 con 0x55a93f96d9a0 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a6ee0 con 0x55a93f96e2e0 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a4d30 con 0x55a93f973370 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54766/0 (socket says 172.21.15.39:54766) 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 -- 172.21.15.39:0/4113269619 learned_addr learned my addr 172.21.15.39:0/4113269619 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd992d7640 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f97f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 -- 172.21.15.39:0/4113269619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f973370 msgr2=0x55a93f96a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f973370 0x55a93f96a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 -- 172.21.15.39:0/4113269619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 msgr2=0x55a93f97f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f97f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 -- 172.21.15.39:0/4113269619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93f968e30 con 0x55a93f96d9a0 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009730 tx=0x7fcd88009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dae6516d261247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.983+0000 7fcd7affd640 1 -- 172.21.15.39:0/4113269619 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801a4e0 con 0x55a93f96d9a0 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd7affd640 1 -- 172.21.15.39:0/4113269619 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88030070 con 0x55a93f96d9a0 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd7affd640 1 -- 172.21.15.39:0/4113269619 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88003de0 con 0x55a93f96d9a0 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/4113269619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 msgr2=0x55a93f96a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009730 tx=0x7fcd88009eb0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/4113269619 shutdown_connections 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f973370 0x55a93f96a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f96e2e0 0x55a93f97f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/4113269619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96d9a0 0x55a93f96a400 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/4113269619 >> 172.21.15.39:0/4113269619 conn(0x55a93f969010 msgr2=0x55a93f9681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/4113269619 shutdown_connections 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.984+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/4113269619 wait complete. 2024-09-12T02:00:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 -- start start 2024-09-12T02:00:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 Processor -- start 2024-09-12T02:00:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f97c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f97d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a53a0 con 0x55a93f96e2e0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a6810 con 0x55a93f973370 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941a5a70 con 0x55a93f96d9a0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd9e2d5740 10 client.0 _ll_register_callbacks cb 0x7fcd84009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd98ad6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57344/0 (socket says 172.21.15.39:57344) 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd98ad6640 1 -- 172.21.15.39:0/870711717 learned_addr learned my addr 172.21.15.39:0/870711717 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f97d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.985+0000 7fcd992d7640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f97c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 -- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 msgr2=0x55a93f97d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f97d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 -- 172.21.15.39:0/870711717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 msgr2=0x55a93f97c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f97c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 -- 172.21.15.39:0/870711717 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a93f97df20 con 0x55a93f96d9a0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd98ad6640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd8801acb0 tx=0x7fcd88029040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f6e9c5ab015052 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8801a2d0 con 0x55a93f96d9a0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd8801a470 con 0x55a93f96d9a0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd88030070 con 0x55a93f96d9a0 2024-09-12T02:00:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.986+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd88003b60 con 0x55a93f96d9a0 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 10 client.25717 fetch_fsmap learned FSMap version 29 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a93f97f230 con 0x55a93f96d9a0 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88030070 con 0x55a93f96d9a0 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fcd88049070 con 0x55a93f96d9a0 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 10 client.25717 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 10 client.25717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 20 client.25717 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f9eeb20 0x55a93f9f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 4 client.25717 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a93f8d8d70 con 0x55a93f9eeb20 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.987+0000 7fcd992d7640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f9eeb20 0x55a93f9f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.988+0000 7fcd78ff9640 10 client.25717 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:46.988+0000 7fcd992d7640 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f9eeb20 0x55a93f9f0f40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168fa0050467293d server_cookie=e2b211f1a6ab7efa in_seq=0 out_seq=0 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd78ff9640 1 -- 172.21.15.39:0/870711717 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a93f8d8d70 con 0x55a93f9eeb20 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd78ff9640 10 client.25717 handle_command_reply: tid=0 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 client.25717 shutdown 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 msgr2=0x55a93f97c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd8801acb0 tx=0x7fcd88029040 comp rx=0 tx=0).stop 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 shutdown_connections 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55a93f9eeb20 0x55a93f9f0f40 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a93f973370 0x55a93f97d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55a93f96e2e0 0x55a93f97c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 --2- 172.21.15.39:0/870711717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a93f96d9a0 0x55a93f97c410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.003+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 >> 172.21.15.39:0/870711717 conn(0x55a93f969010 msgr2=0x55a93f9693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd78ff9640 0 client.25717 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 shutdown_connections 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9e2d5740 1 -- 172.21.15.39:0/870711717 wait complete. 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9e2d5740 20 client.25717 trim_cache size 0 max 16384 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:00:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 msgr2=0x7fcd7c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 0x7fcd7c0a50f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c005d00 tx=0x7fcd8c065e20 comp rx=0 tx=0).stop 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 msgr2=0x7fcd9419f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.004+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00d720 tx=0x7fcd8c00dbe0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 shutdown_connections 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd94107830 0x7fcd9419f3a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd94104f00 0x7fcd94198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fcd7c0a2c30 0x7fcd7c0a50f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 --2- 172.21.15.39:0/3368781642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd941025d0 0x7fcd94197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 >> 172.21.15.39:0/3368781642 conn(0x7fcd940fc1b0 msgr2=0x7fcd94102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 shutdown_connections 2024-09-12T02:00:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:00:47.005+0000 7fcd9b53b640 1 -- 172.21.15.39:0/3368781642 wait complete. 2024-09-12T02:00:47.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:46 smithi039 ceph-mon[31204]: pgmap v453: 97 pgs: 97 active+clean; 54 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 810 op/s 2024-09-12T02:00:47.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:46 smithi044 ceph-mon[35259]: pgmap v453: 97 pgs: 97 active+clean; 54 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 810 op/s 2024-09-12T02:00:47.242 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:46 smithi172 ceph-mon[35073]: pgmap v453: 97 pgs: 97 active+clean; 54 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 810 op/s 2024-09-12T02:00:47.503 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:00:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: ignoring --setuser ceph since I am not root 2024-09-12T02:00:47.503 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:00:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: ignoring --setgroup ceph since I am not root 2024-09-12T02:00:47.503 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:00:47 smithi172 ceph-mds[65329]: -- 172.21.15.172:0/1164992630 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7e35d1860 con 0x55a7e35af000 2024-09-12T02:00:47.503 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:00:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: starting mds.c at 2024-09-12T02:00:48.076 INFO:tasks.workunit.client.0.smithi039.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-12T02:00:48.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:47 smithi039 ceph-mon[31204]: daemon mds.c restarted 2024-09-12T02:00:48.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:47 smithi044 ceph-mon[35259]: daemon mds.c restarted 2024-09-12T02:00:48.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:47 smithi172 ceph-mon[35073]: daemon mds.c restarted 2024-09-12T02:00:48.751 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-12T02:00:48.752 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T02:00:48.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:00:49.035 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 660 op/s 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6836/4225205486,v1:172.21.15.172:6837/4225205486] up:boot 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:00:49.154 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:48 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:00:49.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 660 op/s 2024-09-12T02:00:49.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:00:49.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6836/4225205486,v1:172.21.15.172:6837/4225205486] up:boot 2024-09-12T02:00:49.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-09-12T02:00:49.159 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:00:49.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:48 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 3.7 MiB/s wr, 660 op/s 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6836/4225205486,v1:172.21.15.172:6837/4225205486] up:boot 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:00:49.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:48 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:00:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 -- 172.21.15.39:0/3359967280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 msgr2=0x7f360c10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3359967280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c10bb30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009900 tx=0x7f35f802a480 comp rx=0 tx=0).stop 2024-09-12T02:00:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 -- 172.21.15.39:0/3359967280 shutdown_connections 2024-09-12T02:00:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3359967280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c10c150 0x7f360c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3359967280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c10bb30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3359967280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c102d20 0x7f360c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 -- 172.21.15.39:0/3359967280 >> 172.21.15.39:0/3359967280 conn(0x7f360c0fc780 msgr2=0x7f360c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 -- 172.21.15.39:0/3359967280 shutdown_connections 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.665+0000 7f3612b0e640 1 -- 172.21.15.39:0/3359967280 wait complete. 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 Processor -- start 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 -- start start 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 0x7f360c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 0x7f360c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f360c111f50 con 0x7f360c103640 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f360c111dd0 con 0x7f360c102d20 2024-09-12T02:00:49.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.666+0000 7f3612b0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f360c1120d0 con 0x7f360c10c150 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f360bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 0x7f360c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f360bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54788/0 (socket says 172.21.15.39:54788) 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36110ab640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 0x7f360c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f360bfff640 1 -- 172.21.15.39:0/3560439364 learned_addr learned my addr 172.21.15.39:0/3560439364 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 -- 172.21.15.39:0/3560439364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 msgr2=0x7f360c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 0x7f360c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 -- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 msgr2=0x7f360c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 -- 172.21.15.39:0/3560439364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360c19d430 con 0x7f360c102d20 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36110ab640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 0x7f360c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f36108aa640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 0x7f360c198480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f360000e9f0 tx=0x7f360000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:49.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.667+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360000ccc0 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.668+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360c19d720 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.668+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3600005020 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.668+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000049e0 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.668+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f360c1a5000 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.669+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360c103100 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.670+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3600005560 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.671+0000 7f3609ffb640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 0x7f35fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.671+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f36000cef80 con 0x7f360c102d20 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.671+0000 7f360bfff640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 0x7f35fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.671+0000 7f360bfff640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 0x7f35fc0a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35f8031550 tx=0x7f35f8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:49.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.675+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36000051d0 con 0x7f360c102d20 2024-09-12T02:00:49.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.903+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f360c1071c0 con 0x7f360c102d20 2024-09-12T02:00:49.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.904+0000 7f3609ffb640 1 -- 172.21.15.39:0/3560439364 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11913 (secure 0 0 0) 0x7f360009bef0 con 0x7f360c102d20 2024-09-12T02:00:49.905 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:00:49.906 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"btime":"2024-09-12T02:00:47:877694+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:00:47.877682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:00:49.906 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 msgr2=0x7f35fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 0x7f35fc0a5040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35f8031550 tx=0x7f35f8005a20 comp rx=0 tx=0).stop 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 msgr2=0x7f360c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 0x7f360c198480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f360000e9f0 tx=0x7f360000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 shutdown_connections 2024-09-12T02:00:49.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f35fc0a2b80 0x7f35fc0a5040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f360c10c150 0x7f360c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f360c103640 0x7f360c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 --2- 172.21.15.39:0/3560439364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360c102d20 0x7f360c198480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 >> 172.21.15.39:0/3560439364 conn(0x7f360c0fc780 msgr2=0x7f360c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 shutdown_connections 2024-09-12T02:00:49.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:49.907+0000 7f3612b0e640 1 -- 172.21.15.39:0/3560439364 wait complete. 2024-09-12T02:00:50.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T02:00:50.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T02:00:51.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:50 smithi039 ceph-mon[31204]: pgmap v456: 97 pgs: 97 active+clean; 50 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 692 op/s 2024-09-12T02:00:51.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:50 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3560439364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:50 smithi044 ceph-mon[35259]: pgmap v456: 97 pgs: 97 active+clean; 50 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 692 op/s 2024-09-12T02:00:51.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:50 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3560439364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.194 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:00:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:50 smithi172 ceph-mon[35073]: pgmap v456: 97 pgs: 97 active+clean; 50 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.9 MiB/s wr, 692 op/s 2024-09-12T02:00:51.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:50 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3560439364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:00:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 -- 172.21.15.39:0/543355604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4106f00 msgr2=0x7fc2b410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/543355604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4106f00 0x7fc2b410ea80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009ca0 tx=0x7fc2ac02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 -- 172.21.15.39:0/543355604 shutdown_connections 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/543355604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4106f00 0x7fc2b410ea80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/543355604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/543355604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4101dd0 0x7fc2b41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 -- 172.21.15.39:0/543355604 >> 172.21.15.39:0/543355604 conn(0x7fc2b40fd8b0 msgr2=0x7fc2b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 -- 172.21.15.39:0/543355604 shutdown_connections 2024-09-12T02:00:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.831+0000 7fc2ba40c640 1 -- 172.21.15.39:0/543355604 wait complete. 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.832+0000 7fc2ba40c640 1 Processor -- start 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.832+0000 7fc2ba40c640 1 -- start start 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.832+0000 7fc2ba40c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4101dd0 0x7fc2b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2ba40c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2ba40c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4106f00 0x7fc2b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2ba40c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4111f60 con 0x7fc2b4101dd0 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2ba40c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4111de0 con 0x7fc2b4106f00 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2ba40c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41120e0 con 0x7fc2b4102780 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4101dd0 0x7fc2b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57386/0 (socket says 172.21.15.39:57386) 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 -- 172.21.15.39:0/867642881 learned_addr learned my addr 172.21.15.39:0/867642881 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4106f00 0x7fc2b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 -- 172.21.15.39:0/867642881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4106f00 msgr2=0x7fc2b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4106f00 0x7fc2b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 -- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4101dd0 msgr2=0x7fc2b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4101dd0 0x7fc2b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.833+0000 7fc2b37fe640 1 -- 172.21.15.39:0/867642881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b41a6870 con 0x7fc2b4102780 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e9f0 tx=0x7fc2a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2b17fa640 1 -- 172.21.15.39:0/867642881 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a800cd80 con 0x7fc2b4102780 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2b17fa640 1 -- 172.21.15.39:0/867642881 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a8005500 con 0x7fc2b4102780 2024-09-12T02:00:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2b17fa640 1 -- 172.21.15.39:0/867642881 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8010690 con 0x7fc2b4102780 2024-09-12T02:00:51.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b41a6b60 con 0x7fc2b4102780 2024-09-12T02:00:51.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.834+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b41a7050 con 0x7fc2b4102780 2024-09-12T02:00:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2b17fa640 1 -- 172.21.15.39:0/867642881 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc2a80046c0 con 0x7fc2b4102780 2024-09-12T02:00:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 Processor -- start 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 -- start start 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 0x55db8bc294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc2be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55db8bb83160 con 0x55db8bc29a30 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db8bb2a720 con 0x55db8bc1e850 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.837+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db8bb7f120 con 0x55db8bc1f170 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b89a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b89a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43918/0 (socket says 172.21.15.39:43918) 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b89a9640 1 -- 172.21.15.39:0/4291993508 learned_addr learned my addr 172.21.15.39:0/4291993508 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc2be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 0x55db8bc294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b17fa640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 0x7fc29c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 -- 172.21.15.39:0/4291993508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 msgr2=0x55db8bc1ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 -- 172.21.15.39:0/4291993508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 msgr2=0x55db8bc2be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc2be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 -- 172.21.15.39:0/4291993508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db8b8f4ba0 con 0x55db8bc1f170 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 0x7fc29c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b17fa640 1 -- 172.21.15.39:0/867642881 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc2a80cf490 con 0x7fc2b4102780 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.838+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 0x55db8bc294f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009c20 tx=0x7fc2a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec62bb76da83cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc29a7fc640 1 -- 172.21.15.39:0/4291993508 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004050 con 0x55db8bc1f170 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc29a7fc640 1 -- 172.21.15.39:0/4291993508 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a4005500 con 0x55db8bc1f170 2024-09-12T02:00:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc29a7fc640 1 -- 172.21.15.39:0/4291993508 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40035f0 con 0x55db8bc1f170 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/4291993508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 msgr2=0x55db8bc294f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 0x7fc29c0a5040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005e30 tx=0x7fc2ac0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.839+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 0x55db8bc294f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009c20 tx=0x7fc2a4011810 comp rx=0 tx=0).stop 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/4291993508 shutdown_connections 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc2be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1f170 0x55db8bc294f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/4291993508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1e850 0x55db8bc1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/4291993508 >> 172.21.15.39:0/4291993508 conn(0x55db8bc1ade0 msgr2=0x55db8bc1b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/4291993508 shutdown_connections 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/4291993508 wait complete. 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- start start 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 Processor -- start 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc26e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55db8bc2c650 con 0x55db8bc29a30 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db8bb0b900 con 0x55db8bc1f170 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.840+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db8bc2c7d0 con 0x55db8bc1e850 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2bc7e5740 10 client.0 _ll_register_callbacks cb 0x55db8bb09780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:51.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b89a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc26e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b89a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54822/0 (socket says 172.21.15.39:54822) 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57392/0 (socket says 172.21.15.39:57392) 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b89a9640 1 -- 172.21.15.39:0/2586676177 learned_addr learned my addr 172.21.15.39:0/2586676177 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 -- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 msgr2=0x55db8bc26e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc26e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 -- 172.21.15.39:0/2586676177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 msgr2=0x55db8bc27340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 -- 172.21.15.39:0/2586676177 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db8bb4bc50 con 0x55db8bc1e850 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a9e1fec7c0d9998 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.841+0000 7fc2937fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4005030 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc2a40051d0 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a4005500 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc2a4005c50 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 10 client.25741 fetch_fsmap learned FSMap version 31 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55db8bc38290 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a4005500 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc2a4019430 con 0x55db8bc1e850 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 10 client.25741 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 10 client.25741 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 20 client.25741 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bc395e0 0x55db8bc3b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 4 client.25741 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db8bb90890 con 0x55db8bc395e0 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.842+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bc395e0 0x55db8bc3b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.843+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bc395e0 0x55db8bc3b9d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85fe9296809bb7fe server_cookie=6fdf088b77d995d2 in_seq=0 out_seq=0 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.843+0000 7fc2937fe640 10 client.25741 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2937fe640 1 -- 172.21.15.39:0/2586676177 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db8bb90890 con 0x55db8bc395e0 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2937fe640 10 client.25741 handle_command_reply: tid=0 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 client.25741 shutdown 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 msgr2=0x55db8bc268c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000c00 tx=0x7fc2a40046c0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 shutdown_connections 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bc395e0 0x55db8bc3b9d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc29a30 0x55db8bc27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc26e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/2586676177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc268c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2937fe640 0 client.25741 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:51.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 >> 172.21.15.39:0/2586676177 conn(0x55db8bc1ade0 msgr2=0x55db8bc20ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:51.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 shutdown_connections 2024-09-12T02:00:51.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/2586676177 wait complete. 2024-09-12T02:00:51.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.844+0000 7fc2bc7e5740 20 client.25741 trim_cache size 0 max 16384 2024-09-12T02:00:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 Processor -- start 2024-09-12T02:00:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 -- start start 2024-09-12T02:00:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 0x55db8bc21e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41b1fb0 con 0x55db8bc1e850 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41af820 con 0x55db8bc1f170 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41ad670 con 0x55db8bc29a30 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54826/0 (socket says 172.21.15.39:54826) 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43930/0 (socket says 172.21.15.39:43930) 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b3fff640 1 -- 172.21.15.39:0/3393557986 learned_addr learned my addr 172.21.15.39:0/3393557986 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 0x55db8bc21e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b3fff640 1 -- 172.21.15.39:0/3393557986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 msgr2=0x55db8bc21e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.864+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 0x55db8bc21e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b3fff640 1 -- 172.21.15.39:0/3393557986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 msgr2=0x55db8bc212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b3fff640 1 -- 172.21.15.39:0/3393557986 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db8bc1efa0 con 0x55db8bc1e850 2024-09-12T02:00:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 0x55db8bc21e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:00:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:00:51.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.865+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4011850 tx=0x7fc2a4005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b556d19fd9a671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.867+0000 7fc299ffb640 1 -- 172.21.15.39:0/3393557986 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40199f0 con 0x55db8bc1e850 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.867+0000 7fc299ffb640 1 -- 172.21.15.39:0/3393557986 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a4019b90 con 0x55db8bc1e850 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.867+0000 7fc299ffb640 1 -- 172.21.15.39:0/3393557986 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40035f0 con 0x55db8bc1e850 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.867+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/3393557986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 msgr2=0x55db8bc25800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4011850 tx=0x7fc2a4005e10 comp rx=0 tx=0).stop 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/3393557986 shutdown_connections 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc29a30 0x55db8bc21e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc1f170 0x55db8bc212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/3393557986 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1e850 0x55db8bc25800 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/3393557986 >> 172.21.15.39:0/3393557986 conn(0x55db8bc1ade0 msgr2=0x55db8bc28940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:51.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/3393557986 shutdown_connections 2024-09-12T02:00:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/3393557986 wait complete. 2024-09-12T02:00:51.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 -- start start 2024-09-12T02:00:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.868+0000 7fc2bc7e5740 1 Processor -- start 2024-09-12T02:00:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc32160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 0x55db8bc2d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc29a30 0x55db8bc2da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41adce0 con 0x55db8bc1f170 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41af150 con 0x55db8bc29a30 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b41ae3b0 con 0x55db8bc1e850 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2bc7e5740 10 client.0 _ll_register_callbacks cb 0x7fc2a80d2e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc32160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc32160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57406/0 (socket says 172.21.15.39:57406) 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b3fff640 1 -- 172.21.15.39:0/1762189751 learned_addr learned my addr 172.21.15.39:0/1762189751 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 0x55db8bc2d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b89a9640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc29a30 0x55db8bc2da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 -- 172.21.15.39:0/1762189751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 msgr2=0x55db8bc32160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc32160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 -- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc29a30 msgr2=0x55db8bc2da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:00:51.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc29a30 0x55db8bc2da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.869+0000 7fc2b37fe640 1 -- 172.21.15.39:0/1762189751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db8bc2e250 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2b37fe640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 0x55db8bc2d4e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ccff0 tx=0x7fc2a80d2f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbe418d548cb857 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2937fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a809b660 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc2a8098370 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a4019b90 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc2a809c400 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2bc7e5740 10 client.16335 fetch_fsmap learned FSMap version 31 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55db8bca40e0 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.870+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2a809bd00 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc2a80a4570 con 0x55db8bc1f170 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 10 client.16335 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 10 client.16335 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:00:51.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 20 client.16335 populate_metadata read hostname 'smithi039' 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bca4890 0x55db8bca6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 4 client.16335 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x7fc2a4019b90 con 0x55db8bca4890 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bca4890 0x55db8bca6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2b3fff640 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bca4890 0x55db8bca6cb0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=763ceda9db3c72ab server_cookie=dfd776b1f608db8c in_seq=0 out_seq=0 2024-09-12T02:00:51.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:51.871+0000 7fc2937fe640 10 client.16335 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:52.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2937fe640 1 -- 172.21.15.39:0/1762189751 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fc2a4019b90 con 0x55db8bca4890 2024-09-12T02:00:52.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2937fe640 10 client.16335 handle_command_reply: tid=0 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 client.16335 shutdown 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 msgr2=0x55db8bc2d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 0x55db8bc2d4e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ccff0 tx=0x7fc2a80d2f70 comp rx=0 tx=0).stop 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 shutdown_connections 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55db8bca4890 0x55db8bca6cb0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db8bc29a30 0x55db8bc2da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55db8bc1f170 0x55db8bc2d4e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 --2- 172.21.15.39:0/1762189751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db8bc1e850 0x55db8bc32160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 >> 172.21.15.39:0/1762189751 conn(0x55db8bc1ade0 msgr2=0x55db8bc26860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2937fe640 0 client.16335 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 shutdown_connections 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 1 -- 172.21.15.39:0/1762189751 wait complete. 2024-09-12T02:00:52.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.660+0000 7fc2bc7e5740 20 client.16335 trim_cache size 0 max 16384 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 31, 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 14, 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "5099f9cb": { 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 14, 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:00:52.663 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 140.2, 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:52.664 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 msgr2=0x7fc29c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 0x7fc29c0a5040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005e30 tx=0x7fc2ac0095c0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 msgr2=0x7fc2b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800e9f0 tx=0x7fc2a800edf0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 shutdown_connections 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2b4106f00 0x7fc2b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fc29c0a2b80 0x7fc29c0a5040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b4102780 0x7fc2b4074a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 --2- 172.21.15.39:0/867642881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2b4101dd0 0x7fc2b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 >> 172.21.15.39:0/867642881 conn(0x7fc2b40fd8b0 msgr2=0x7fc2b40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 shutdown_connections 2024-09-12T02:00:52.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:00:52.661+0000 7fc2ba40c640 1 -- 172.21.15.39:0/867642881 wait complete. 2024-09-12T02:00:52.975 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:52 smithi039 ceph-mon[31204]: pgmap v457: 97 pgs: 97 active+clean; 47 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 689 op/s 2024-09-12T02:00:53.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:52 smithi044 ceph-mon[35259]: pgmap v457: 97 pgs: 97 active+clean; 47 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 689 op/s 2024-09-12T02:00:53.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:52 smithi172 ceph-mon[35073]: pgmap v457: 97 pgs: 97 active+clean; 47 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 689 op/s 2024-09-12T02:00:53.406 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5099f9cb', quiesce took 4.7 seconds. Will release after: 15.45 2024-09-12T02:00:55.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:54 smithi039 ceph-mon[31204]: pgmap v458: 97 pgs: 97 active+clean; 48 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.7 MiB/s wr, 661 op/s 2024-09-12T02:00:55.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:54 smithi044 ceph-mon[35259]: pgmap v458: 97 pgs: 97 active+clean; 48 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.7 MiB/s wr, 661 op/s 2024-09-12T02:00:55.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:54 smithi172 ceph-mon[35073]: pgmap v458: 97 pgs: 97 active+clean; 48 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 3.7 MiB/s wr, 661 op/s 2024-09-12T02:00:57.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:56 smithi039 ceph-mon[31204]: pgmap v459: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 572 op/s 2024-09-12T02:00:57.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:56 smithi044 ceph-mon[35259]: pgmap v459: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 572 op/s 2024-09-12T02:00:57.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:56 smithi172 ceph-mon[35073]: pgmap v459: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 572 op/s 2024-09-12T02:00:59.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:00:58 smithi039 ceph-mon[31204]: pgmap v460: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 537 op/s 2024-09-12T02:00:59.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:00:58 smithi044 ceph-mon[35259]: pgmap v460: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 537 op/s 2024-09-12T02:00:59.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:00:58 smithi172 ceph-mon[35073]: pgmap v460: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 537 op/s 2024-09-12T02:01:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 -- 172.21.15.39:0/774885449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c103710 msgr2=0x7f174c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 --2- 172.21.15.39:0/774885449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c103710 0x7f174c109fa0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1744009ca0 tx=0x7f174402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 -- 172.21.15.39:0/774885449 shutdown_connections 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 --2- 172.21.15.39:0/774885449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c103710 0x7f174c109fa0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 --2- 172.21.15.39:0/774885449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c102d50 0x7f174c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 --2- 172.21.15.39:0/774885449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c101b60 0x7f174c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 -- 172.21.15.39:0/774885449 >> 172.21.15.39:0/774885449 conn(0x7f174c0fd2e0 msgr2=0x7f174c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 -- 172.21.15.39:0/774885449 shutdown_connections 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.107+0000 7f175325c640 1 -- 172.21.15.39:0/774885449 wait complete. 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 Processor -- start 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 -- start start 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c101b60 0x7f174c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 0x7f174c19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10d7c0 con 0x7f174c102d50 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10d640 con 0x7f174c101b60 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f175325c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f174c10d940 con 0x7f174c103710 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47378/0 (socket says 172.21.15.39:47378) 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.108+0000 7f174bfff640 1 -- 172.21.15.39:0/3865115729 learned_addr learned my addr 172.21.15.39:0/3865115729 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f1750ff8640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c101b60 0x7f174c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f17517f9640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 0x7f174c19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 -- 172.21.15.39:0/3865115729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 msgr2=0x7f174c19f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 0x7f174c19f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 -- 172.21.15.39:0/3865115729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c101b60 msgr2=0x7f174c197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c101b60 0x7f174c197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 -- 172.21.15.39:0/3865115729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c19f960 con 0x7f174c102d50 2024-09-12T02:01:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f17517f9640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 0x7f174c19f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f174bfff640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f173800d950 tx=0x7f173800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f1749ffb640 1 -- 172.21.15.39:0/3865115729 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738017030 con 0x7f174c102d50 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c19fc50 con 0x7f174c102d50 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f1749ffb640 1 -- 172.21.15.39:0/3865115729 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1738004020 con 0x7f174c102d50 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.109+0000 7f1749ffb640 1 -- 172.21.15.39:0/3865115729 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380047a0 con 0x7f174c102d50 2024-09-12T02:01:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.110+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1a01a0 con 0x7f174c102d50 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.112+0000 7f1749ffb640 1 -- 172.21.15.39:0/3865115729 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f17380041d0 con 0x7f174c102d50 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.112+0000 7f1755ff4740 1 Processor -- start 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.112+0000 7f1755ff4740 1 -- start start 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e2ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c19e2592f0 con 0x55c19e2ff780 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c19e201270 con 0x55c19e2f9db0 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1755ff4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c19e2552b0 con 0x55c19e2fa6f0 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1749ffb640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 0x7f173c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47386/0 (socket says 172.21.15.39:47386) 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 -- 172.21.15.39:0/1366485332 learned_addr learned my addr 172.21.15.39:0/1366485332 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f17517f9640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1750ff8640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e2ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f17517f9640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 0x7f173c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f1749ffb640 1 -- 172.21.15.39:0/3865115729 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f17380ceaa0 con 0x7f174c102d50 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 -- 172.21.15.39:0/1366485332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 msgr2=0x55c19e2ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e2ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 -- 172.21.15.39:0/1366485332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 msgr2=0x55c19e2fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 -- 172.21.15.39:0/1366485332 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19e200340 con 0x55c19e2ff780 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f17517f9640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.113+0000 7f174bfff640 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1738005fd0 tx=0x7f173809aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee42b7790361bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f17517f9640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 0x7f173c0a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1744009bf0 tx=0x7f17440095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1736ffd640 1 -- 172.21.15.39:0/1366485332 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380a3f80 con 0x55c19e2ff780 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1736ffd640 1 -- 172.21.15.39:0/1366485332 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173809b310 con 0x55c19e2ff780 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1736ffd640 1 -- 172.21.15.39:0/1366485332 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380a3af0 con 0x55c19e2ff780 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 -- 172.21.15.39:0/1366485332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 msgr2=0x55c19e301c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1738005fd0 tx=0x7f173809aed0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 -- 172.21.15.39:0/1366485332 shutdown_connections 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e301c40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e2ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 --2- 172.21.15.39:0/1366485332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.114+0000 7f1755ff4740 1 -- 172.21.15.39:0/1366485332 >> 172.21.15.39:0/1366485332 conn(0x55c19e2f1010 msgr2=0x55c19e2f1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- 172.21.15.39:0/1366485332 shutdown_connections 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- 172.21.15.39:0/1366485332 wait complete. 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- start start 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 Processor -- start 2024-09-12T02:01:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e303f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c19e302690 con 0x55c19e2fa6f0 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c19e1e2290 con 0x55c19e2ff780 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c19e302810 con 0x55c19e2f9db0 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.115+0000 7f1755ff4740 10 client.0 _ll_register_callbacks cb 0x55c19e213140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47396/0 (socket says 172.21.15.39:47396) 2024-09-12T02:01:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 -- 172.21.15.39:0/2109199250 learned_addr learned my addr 172.21.15.39:0/2109199250 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f1750ff8640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e303f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f17517f9640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 -- 172.21.15.39:0/2109199250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 msgr2=0x55c19e303f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e303f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 -- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 msgr2=0x55c19e30b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 -- 172.21.15.39:0/2109199250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19df6c210 con 0x55c19e2fa6f0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f17517f9640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f174bfff640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f173809b010 tx=0x7f1738009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b8134be7188c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f172bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b4060 con 0x55c19e2fa6f0 2024-09-12T02:01:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f17380b4200 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173809b310 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1738097520 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f1755ff4740 10 client.16347 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.116+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c19e038620 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173809b310 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f173809a760 con 0x55c19e2fa6f0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 10 client.16347 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 10 client.16347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 20 client.16347 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e30f7c0 0x55c19e311bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 4 client.16347 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c19e266a20 con 0x55c19e30f7c0 2024-09-12T02:01:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.117+0000 7f1750ff8640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e30f7c0 0x55c19e311bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.118+0000 7f172bfff640 10 client.16347 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.118+0000 7f1750ff8640 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e30f7c0 0x55c19e311bb0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da425caf8ca00999 server_cookie=675a627720850da8 in_seq=0 out_seq=0 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.118+0000 7f172bfff640 1 -- 172.21.15.39:0/2109199250 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c19e266a20 con 0x55c19e30f7c0 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.118+0000 7f172bfff640 10 client.16347 handle_command_reply: tid=0 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.118+0000 7f1755ff4740 1 client.16347 shutdown 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 msgr2=0x55c19e304480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f173809b010 tx=0x7f1738009740 comp rx=0 tx=0).stop 2024-09-12T02:01:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 shutdown_connections 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e30f7c0 0x55c19e311bb0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e304480 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f172bfff640 0 client.16347 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2109199250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e303f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 >> 172.21.15.39:0/2109199250 conn(0x55c19e2f1010 msgr2=0x55c19e2f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 shutdown_connections 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 1 -- 172.21.15.39:0/2109199250 wait complete. 2024-09-12T02:01:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.119+0000 7f1755ff4740 20 client.16347 trim_cache size 0 max 16384 2024-09-12T02:01:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.133+0000 7f1755ff4740 1 Processor -- start 2024-09-12T02:01:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.133+0000 7f1755ff4740 1 -- start start 2024-09-12T02:01:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e30b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a9600 con 0x55c19e2ff780 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a6e70 con 0x55c19e2f9db0 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1755ff4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a4cc0 con 0x55c19e2fa6f0 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47402/0 (socket says 172.21.15.39:47402) 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 -- 172.21.15.39:0/2917489234 learned_addr learned my addr 172.21.15.39:0/2917489234 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f174bfff640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e30b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1750ff8640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 -- 172.21.15.39:0/2917489234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 msgr2=0x55c19e30b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e30b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 -- 172.21.15.39:0/2917489234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 msgr2=0x55c19e2f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 -- 172.21.15.39:0/2917489234 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19e2f1ca0 con 0x55c19e2ff780 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f174bfff640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e30b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f1750ff8640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17517f9640 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1744035000 tx=0x7f1744041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e299ae05247c9704 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17367fc640 1 -- 172.21.15.39:0/2917489234 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744004050 con 0x55c19e2ff780 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.134+0000 7f17367fc640 1 -- 172.21.15.39:0/2917489234 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1744036040 con 0x55c19e2ff780 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f17367fc640 1 -- 172.21.15.39:0/2917489234 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174402fcf0 con 0x55c19e2ff780 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- 172.21.15.39:0/2917489234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 msgr2=0x55c19e2f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1744035000 tx=0x7f1744041000 comp rx=0 tx=0).stop 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- 172.21.15.39:0/2917489234 shutdown_connections 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2ff780 0x55c19e2f2400 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2fa6f0 0x55c19e30b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 --2- 172.21.15.39:0/2917489234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2f9db0 0x55c19e2f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- 172.21.15.39:0/2917489234 >> 172.21.15.39:0/2917489234 conn(0x55c19e2f1010 msgr2=0x55c19e303f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- 172.21.15.39:0/2917489234 shutdown_connections 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- 172.21.15.39:0/2917489234 wait complete. 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.135+0000 7f1755ff4740 1 -- start start 2024-09-12T02:01:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 Processor -- start 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e308bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a5330 con 0x55c19e2fa6f0 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a67a0 con 0x55c19e2ff780 2024-09-12T02:01:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1a5a00 con 0x55c19e2f9db0 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1755ff4740 10 client.0 _ll_register_callbacks cb 0x7f17380cef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47418/0 (socket says 172.21.15.39:47418) 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 -- 172.21.15.39:0/313317964 learned_addr learned my addr 172.21.15.39:0/313317964 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f1750ff8640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e308bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f17517f9640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 -- 172.21.15.39:0/313317964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 msgr2=0x55c19e308bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e308bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 -- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 msgr2=0x55c19e30a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.136+0000 7f174bfff640 1 -- 172.21.15.39:0/313317964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19e30a720 con 0x55c19e2fa6f0 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1750ff8640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e308bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f17517f9640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f174bfff640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f17380cef20 tx=0x7f1738005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc573a1d93f7fba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b4040 con 0x55c19e2fa6f0 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f17380b41e0 con 0x55c19e2fa6f0 2024-09-12T02:01:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1744036040 con 0x55c19e2fa6f0 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f173809ae50 con 0x55c19e2fa6f0 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 10 client.16353 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c19e37a3a0 con 0x55c19e2fa6f0 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1744036040 con 0x55c19e2fa6f0 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f17380a3af0 con 0x55c19e2fa6f0 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 20 client.16353 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e37aab0 0x55c19e37cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 4 client.16353 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.137+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c19e260d70 con 0x55c19e37aab0 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.138+0000 7f1750ff8640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e37aab0 0x55c19e37cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.138+0000 7f1750ff8640 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e37aab0 0x55c19e37cea0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27c521fb5f89fe0 server_cookie=2e9c854891735391 in_seq=0 out_seq=0 2024-09-12T02:01:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.138+0000 7f172bfff640 10 client.16353 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f172bfff640 1 -- 172.21.15.39:0/313317964 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c19e260d70 con 0x55c19e37aab0 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f172bfff640 10 client.16353 handle_command_reply: tid=0 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 client.16353 shutdown 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 msgr2=0x55c19e309100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f17380cef20 tx=0x7f1738005ab0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 shutdown_connections 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c19e37aab0 0x55c19e37cea0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c19e2ff780 0x55c19e30a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c19e2fa6f0 0x55c19e309100 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f172bfff640 0 client.16353 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 --2- 172.21.15.39:0/313317964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c19e2f9db0 0x55c19e308bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 >> 172.21.15.39:0/313317964 conn(0x55c19e2f1010 msgr2=0x55c19e2ef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 shutdown_connections 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 1 -- 172.21.15.39:0/313317964 wait complete. 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.153+0000 7f1755ff4740 20 client.16353 trim_cache size 0 max 16384 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:01:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:01:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 msgr2=0x7f173c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 0x7f173c0a50f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1744009bf0 tx=0x7f17440095c0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 msgr2=0x7f174c198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f173800d950 tx=0x7f173800de10 comp rx=0 tx=0).stop 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 shutdown_connections 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f173c0a2c30 0x7f173c0a50f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f174c103710 0x7f174c19f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f174c102d50 0x7f174c198290 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 --2- 172.21.15.39:0/3865115729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f174c101b60 0x7f174c197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 >> 172.21.15.39:0/3865115729 conn(0x7f174c0fd2e0 msgr2=0x7f174c105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 shutdown_connections 2024-09-12T02:01:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:00.154+0000 7f175325c640 1 -- 172.21.15.39:0/3865115729 wait complete. 2024-09-12T02:01:01.161 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:00 smithi039 ceph-mon[31204]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.6 MiB/s wr, 470 op/s 2024-09-12T02:01:01.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:00 smithi044 ceph-mon[35259]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.6 MiB/s wr, 470 op/s 2024-09-12T02:01:01.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:00 smithi172 ceph-mon[35073]: pgmap v461: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.6 MiB/s wr, 470 op/s 2024-09-12T02:01:03.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:02 smithi039 ceph-mon[31204]: pgmap v462: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-12T02:01:03.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:02 smithi044 ceph-mon[35259]: pgmap v462: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-12T02:01:03.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:02 smithi172 ceph-mon[35073]: pgmap v462: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-12T02:01:05.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:04 smithi039 ceph-mon[31204]: pgmap v463: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 KiB/s wr, 171 op/s 2024-09-12T02:01:05.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:04 smithi044 ceph-mon[35259]: pgmap v463: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 KiB/s wr, 171 op/s 2024-09-12T02:01:05.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:04 smithi172 ceph-mon[35073]: pgmap v463: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 924 KiB/s wr, 171 op/s 2024-09-12T02:01:07.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:06 smithi044 ceph-mon[35259]: pgmap v464: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 519 KiB/s wr, 113 op/s 2024-09-12T02:01:07.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:06 smithi172 ceph-mon[35073]: pgmap v464: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 519 KiB/s wr, 113 op/s 2024-09-12T02:01:07.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:06 smithi039 ceph-mon[31204]: pgmap v464: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 519 KiB/s wr, 113 op/s 2024-09-12T02:01:08.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:01:09.134 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:09.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:08 smithi039 ceph-mon[31204]: pgmap v465: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-12T02:01:09.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:08 smithi044 ceph-mon[35259]: pgmap v465: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-12T02:01:09.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:08 smithi172 ceph-mon[35073]: pgmap v465: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 112 KiB/s wr, 20 op/s 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 -- 172.21.15.39:0/409581568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8100e20 msgr2=0x7fdfb8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/409581568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8100e20 0x7fdfb8101200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009ca0 tx=0x7fdfac02a950 comp rx=0 tx=0).stop 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 -- 172.21.15.39:0/409581568 shutdown_connections 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/409581568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 0x7fdfb810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/409581568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8102570 0x7fdfb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/409581568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8100e20 0x7fdfb8101200 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 -- 172.21.15.39:0/409581568 >> 172.21.15.39:0/409581568 conn(0x7fdfb80fc7d0 msgr2=0x7fdfb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 -- 172.21.15.39:0/409581568 shutdown_connections 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.640+0000 7fdfbf70f640 1 -- 172.21.15.39:0/409581568 wait complete. 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 Processor -- start 2024-09-12T02:01:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 -- start start 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8100e20 0x7fdfb810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 0x7fdfb810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb81120a0 con 0x7fdfb8102570 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8111f20 con 0x7fdfb8100e20 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbf70f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8112220 con 0x7fdfb8102ef0 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbccaa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbccaa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45304/0 (socket says 172.21.15.39:45304) 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbccaa640 1 -- 172.21.15.39:0/3980015235 learned_addr learned my addr 172.21.15.39:0/3980015235 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbd4ab640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8100e20 0x7fdfb810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.641+0000 7fdfbdcac640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 0x7fdfb810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 -- 172.21.15.39:0/3980015235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 msgr2=0x7fdfb810ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 0x7fdfb810ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 -- 172.21.15.39:0/3980015235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8100e20 msgr2=0x7fdfb810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8100e20 0x7fdfb810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 -- 172.21.15.39:0/3980015235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81a69c0 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbccaa640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d950 tx=0x7fdfb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4017030 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb4004020 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81a6cb0 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40047a0 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.642+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a71a0 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.643+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb8101200 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.644+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdfb40041d0 con 0x7fdfb8102570 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.645+0000 7fdfaa7fc640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 0x7fdfa40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.645+0000 7fdfbd4ab640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 0x7fdfa40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.646+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdfb40cf040 con 0x7fdfb8102570 2024-09-12T02:01:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.646+0000 7fdfbd4ab640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 0x7fdfa40a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfac004ad0 tx=0x7fdfac004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.649+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfb409bfd0 con 0x7fdfb8102570 2024-09-12T02:01:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.865+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfb810fa00 con 0x7fdfb8102570 2024-09-12T02:01:09.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.866+0000 7fdfaa7fc640 1 -- 172.21.15.39:0/3980015235 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11913 (secure 0 0 0) 0x7fdfb810fa00 con 0x7fdfb8102570 2024-09-12T02:01:09.867 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:01:09.867 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"btime":"2024-09-12T02:00:47:877694+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:00:47.877682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:01:09.867 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 msgr2=0x7fdfa40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 0x7fdfa40a5040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfac004ad0 tx=0x7fdfac004a60 comp rx=0 tx=0).stop 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 msgr2=0x7fdfb810ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d950 tx=0x7fdfb400de10 comp rx=0 tx=0).stop 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 shutdown_connections 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdfa40a2b80 0x7fdfa40a5040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8102ef0 0x7fdfb810ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdfb8102570 0x7fdfb810ea10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 --2- 172.21.15.39:0/3980015235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb8100e20 0x7fdfb810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:09.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 >> 172.21.15.39:0/3980015235 conn(0x7fdfb80fc7d0 msgr2=0x7fdfb81068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:09.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 shutdown_connections 2024-09-12T02:01:09.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:09.868+0000 7fdfbf70f640 1 -- 172.21.15.39:0/3980015235 wait complete. 2024-09-12T02:01:10.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:09 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3980015235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:10.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:09 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3980015235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:10.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:09 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3980015235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --set-id 5099f9cb --release --await' 2024-09-12T02:01:10.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --set-id 5099f9cb --release --await 2024-09-12T02:01:11.108 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:11.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:10 smithi039 ceph-mon[31204]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-12T02:01:11.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:10 smithi172 ceph-mon[35073]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-12T02:01:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:10 smithi044 ceph-mon[35259]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2106367396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0102d40 msgr2=0x7fdbc0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2106367396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0102d40 0x7fdbc0103120 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009900 tx=0x7fdbb002a480 comp rx=0 tx=0).stop 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2106367396 shutdown_connections 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2106367396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc010c170 0x7fdbc010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2106367396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 0x7fdbc010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2106367396 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc0102d40 0x7fdbc0103120 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2106367396 >> 172.21.15.39:0/2106367396 conn(0x7fdbc00fc7a0 msgr2=0x7fdbc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2106367396 shutdown_connections 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2106367396 wait complete. 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 Processor -- start 2024-09-12T02:01:11.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.680+0000 7fdbc5e17640 1 -- start start 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0102d40 0x7fdbc01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 0x7fdbc0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0111f70 con 0x7fdbc010c170 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0111df0 con 0x7fdbc0103660 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbc5e17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01120f0 con 0x7fdbc0102d40 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45334/0 (socket says 172.21.15.39:45334) 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 -- 172.21.15.39:0/2967953853 learned_addr learned my addr 172.21.15.39:0/2967953853 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0102d40 0x7fdbc01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 0x7fdbc0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 -- 172.21.15.39:0/2967953853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0102d40 msgr2=0x7fdbc01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0102d40 0x7fdbc01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 -- 172.21.15.39:0/2967953853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 msgr2=0x7fdbc0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 0x7fdbc0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 -- 172.21.15.39:0/2967953853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc01a68f0 con 0x7fdbc010c170 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbffff640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800eaa0 tx=0x7fdbb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.681+0000 7fdbbcff9640 1 -- 172.21.15.39:0/2967953853 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800cdb0 con 0x7fdbc010c170 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.682+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc01a6be0 con 0x7fdbc010c170 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.682+0000 7fdbbcff9640 1 -- 172.21.15.39:0/2967953853 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb8005020 con 0x7fdbc010c170 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.682+0000 7fdbbcff9640 1 -- 172.21.15.39:0/2967953853 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80116b0 con 0x7fdbc010c170 2024-09-12T02:01:11.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.682+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01a7120 con 0x7fdbc010c170 2024-09-12T02:01:11.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.684+0000 7fdbbcff9640 1 -- 172.21.15.39:0/2967953853 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdbb8005560 con 0x7fdbc010c170 2024-09-12T02:01:11.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.684+0000 7fdbc81f0740 1 Processor -- start 2024-09-12T02:01:11.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.684+0000 7fdbc81f0740 1 -- start start 2024-09-12T02:01:11.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x564445107630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56444505f620 con 0x5644450fa980 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564445006e50 con 0x5644450fa060 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56444505b5e0 con 0x564445105240 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45350/0 (socket says 172.21.15.39:45350) 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/2866012752 learned_addr learned my addr 172.21.15.39:0/2866012752 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbcff9640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 0x7fdba80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x564445107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/2866012752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 msgr2=0x564445107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x564445107630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/2866012752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 msgr2=0x5644450fa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/2866012752 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564444ff7d40 con 0x5644450fa980 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbffff640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 0x7fdba80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.685+0000 7fdbbcff9640 1 -- 172.21.15.39:0/2967953853 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdbb80cf2a0 con 0x7fdbc010c170 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.686+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009900 tx=0x7fdbb0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc449be007cf087 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.686+0000 7fdba5ffb640 1 -- 172.21.15.39:0/2866012752 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0040070 con 0x5644450fa980 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.686+0000 7fdbbffff640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 0x7fdba80a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8097f10 tx=0x7fdbb8066730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.686+0000 7fdba5ffb640 1 -- 172.21.15.39:0/2866012752 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb00319f0 con 0x5644450fa980 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.686+0000 7fdba5ffb640 1 -- 172.21.15.39:0/2866012752 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0035040 con 0x5644450fa980 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- 172.21.15.39:0/2866012752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 msgr2=0x564445104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009900 tx=0x7fdbb0005e80 comp rx=0 tx=0).stop 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- 172.21.15.39:0/2866012752 shutdown_connections 2024-09-12T02:01:11.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x564445107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445104d00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/2866012752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- 172.21.15.39:0/2866012752 >> 172.21.15.39:0/2866012752 conn(0x5644450f65f0 msgr2=0x5644450f69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- 172.21.15.39:0/2866012752 shutdown_connections 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- 172.21.15.39:0/2866012752 wait complete. 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 -- start start 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.687+0000 7fdbc81f0740 1 Processor -- start 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x5644451025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x564445102af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564445107e10 con 0x564445105240 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564444fe7f10 con 0x5644450fa060 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564445107f90 con 0x5644450fa980 2024-09-12T02:01:11.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbc81f0740 10 client.0 _ll_register_callbacks cb 0x56444500bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x564445102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x5644451025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:53844/0 (socket says 172.21.15.39:53844) 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbeffd640 1 -- 172.21.15.39:0/3341385839 learned_addr learned my addr 172.21.15.39:0/3341385839 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 msgr2=0x564445102070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/3341385839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 msgr2=0x564445102af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x564445102af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/3341385839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564444d6e580 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x5644451025b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005c40 tx=0x7fdbb0005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f439bec6255443e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.688+0000 7fdb9effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0040030 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb00319f0 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdbb0004260 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdbb0035040 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 10 client.25777 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564444e38960 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb00319f0 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdbb00037b0 con 0x5644450fa980 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 10 client.25777 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 10 client.25777 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:11.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.689+0000 7fdbc81f0740 20 client.25777 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:11.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445114bc0 0x564445116fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdbc81f0740 4 client.25777 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:11.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56444506cb90 con 0x564445114bc0 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445114bc0 0x564445116fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445114bc0 0x564445116fb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632d87827782a133 server_cookie=a6fd23f7ce96c485 in_seq=0 out_seq=0 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.690+0000 7fdb9effd640 10 client.25777 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdb9effd640 1 -- 172.21.15.39:0/3341385839 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56444506cb90 con 0x564445114bc0 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdb9effd640 10 client.25777 handle_command_reply: tid=0 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 client.25777 shutdown 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 msgr2=0x5644451025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x5644451025b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005c40 tx=0x7fdbb0005250 comp rx=0 tx=0).stop 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 shutdown_connections 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445114bc0 0x564445116fb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x564445102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x5644451025b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdb9effd640 0 client.25777 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/3341385839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x564445102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 >> 172.21.15.39:0/3341385839 conn(0x5644450f65f0 msgr2=0x5644450f5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 shutdown_connections 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 1 -- 172.21.15.39:0/3341385839 wait complete. 2024-09-12T02:01:11.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.691+0000 7fdbc81f0740 20 client.25777 trim_cache size 0 max 16384 2024-09-12T02:01:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.708+0000 7fdbc81f0740 1 Processor -- start 2024-09-12T02:01:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.708+0000 7fdbc81f0740 1 -- start start 2024-09-12T02:01:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x5644450f5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b2040 con 0x5644450fa980 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01af8b0 con 0x5644450fa060 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01ad700 con 0x564445105240 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45374/0 (socket says 172.21.15.39:45374) 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/4187222816 learned_addr learned my addr 172.21.15.39:0/4187222816 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/4187222816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 msgr2=0x5644450f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x5644450f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/4187222816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 msgr2=0x5644450fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 -- 172.21.15.39:0/4187222816 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644450fa7b0 con 0x5644450fa980 2024-09-12T02:01:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d50fd89eb5197a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdba57fa640 1 -- 172.21.15.39:0/4187222816 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0040070 con 0x5644450fa980 2024-09-12T02:01:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdba57fa640 1 -- 172.21.15.39:0/4187222816 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb004d070 con 0x5644450fa980 2024-09-12T02:01:11.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.709+0000 7fdba57fa640 1 -- 172.21.15.39:0/4187222816 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00046c0 con 0x5644450fa980 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4187222816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 msgr2=0x564445100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0003f70 comp rx=0 tx=0).stop 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4187222816 shutdown_connections 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564445105240 0x5644450f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5644450fa980 0x564445100940 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4187222816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x5644450fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4187222816 >> 172.21.15.39:0/4187222816 conn(0x5644450f65f0 msgr2=0x5644450f4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4187222816 shutdown_connections 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4187222816 wait complete. 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.710+0000 7fdbc81f0740 1 -- start start 2024-09-12T02:01:11.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 Processor -- start 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x56444510d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x56444510d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01add70 con 0x564445105240 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01af1e0 con 0x5644450fa060 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01ae440 con 0x5644450fa980 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbc81f0740 10 client.0 _ll_register_callbacks cb 0x7fdbb0009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45386/0 (socket says 172.21.15.39:45386) 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 -- 172.21.15.39:0/4216912812 learned_addr learned my addr 172.21.15.39:0/4216912812 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x56444510d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x56444510d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 -- 172.21.15.39:0/4216912812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 msgr2=0x56444510d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x56444510d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 -- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 msgr2=0x56444510d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x56444510d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.711+0000 7fdbbeffd640 1 -- 172.21.15.39:0/4216912812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564445108710 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdbbeffd640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b760 tx=0x7fdbb400b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fce672fb0798148 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4028070 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdbb4022e80 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb004d070 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdbb4033050 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdbc81f0740 10 client.16377 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56444517fd70 con 0x564445105240 2024-09-12T02:01:11.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb004d070 con 0x564445105240 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.712+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdbb40047a0 con 0x564445105240 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 10 client.16377 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 10 client.16377 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 20 client.16377 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445180500 0x564445182920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 4 client.16377 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5099f9cb", "release": true, "await": true}] 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5099f9cb", "release": true, "await": true}) -- 0x5644450670a0 con 0x564445180500 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445180500 0x564445182920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdbbf7fe640 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445180500 0x564445182920 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50dd017877a743 server_cookie=e7b6748ed8665c81 in_seq=0 out_seq=0 2024-09-12T02:01:11.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.713+0000 7fdb9effd640 10 client.16377 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdb9effd640 1 -- 172.21.15.39:0/4216912812 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5644450670a0 con 0x564445180500 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdb9effd640 10 client.16377 handle_command_reply: tid=0 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 client.16377 shutdown 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 msgr2=0x5644451081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b760 tx=0x7fdbb400b3e0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 shutdown_connections 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564445180500 0x564445182920 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564445105240 0x5644451081d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644450fa980 0x56444510d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 --2- 172.21.15.39:0/4216912812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644450fa060 0x56444510d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 >> 172.21.15.39:0/4216912812 conn(0x5644450f65f0 msgr2=0x564445102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdb9effd640 0 client.16377 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 shutdown_connections 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.846+0000 7fdbc81f0740 1 -- 172.21.15.39:0/4216912812 wait complete. 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc81f0740 20 client.16377 trim_cache size 0 max 16384 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 31, 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 16, 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "5099f9cb": { 2024-09-12T02:01:11.849 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 16, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 140.2, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:11.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:11.851 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 msgr2=0x7fdba80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 0x7fdba80a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8097f10 tx=0x7fdbb8066730 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 msgr2=0x7fdbc0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800eaa0 tx=0x7fdbb800ef60 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 shutdown_connections 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdbc010c170 0x7fdbc0101420 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc0103660 0x7fdbc0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdba80a2b80 0x7fdba80a5040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 --2- 172.21.15.39:0/2967953853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc0102d40 0x7fdbc01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 >> 172.21.15.39:0/2967953853 conn(0x7fdbc00fc7a0 msgr2=0x7fdbc00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:11.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.847+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 shutdown_connections 2024-09-12T02:01:11.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:11.848+0000 7fdbc5e17640 1 -- 172.21.15.39:0/2967953853 wait complete. 2024-09-12T02:01:12.646 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5099f9cb', total seconds elapsed: 23.9 2024-09-12T02:01:12.646 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.15 2024-09-12T02:01:12.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:01:12.925 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:13.193 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:12 smithi039 ceph-mon[31204]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-12T02:01:13.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:12 smithi172 ceph-mon[35073]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-12T02:01:13.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 -- 172.21.15.39:0/1934120720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0101c30 msgr2=0x7f79f01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1934120720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0101c30 0x7f79f01020b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009900 tx=0x7f79e002a410 comp rx=0 tx=0).stop 2024-09-12T02:01:13.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 -- 172.21.15.39:0/1934120720 shutdown_connections 2024-09-12T02:01:13.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1934120720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79f01025f0 0x7f79f0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.255 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1934120720 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0101c30 0x7f79f01020b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1934120720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f0100a40 0x7f79f0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.253+0000 7f79f73b9640 1 -- 172.21.15.39:0/1934120720 >> 172.21.15.39:0/1934120720 conn(0x7f79f00fc1e0 msgr2=0x7f79f00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- 172.21.15.39:0/1934120720 shutdown_connections 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- 172.21.15.39:0/1934120720 wait complete. 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 Processor -- start 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- start start 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79f0101c30 0x7f79f019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f01025f0 0x7f79f01a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79f010b640 con 0x7f79f0100a40 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79f010b4c0 con 0x7f79f0101c30 2024-09-12T02:01:13.256 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f73b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f010b7c0 con 0x7f79f01025f0 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f5155640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f5155640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57108/0 (socket says 172.21.15.39:57108) 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.254+0000 7f79f5155640 1 -- 172.21.15.39:0/1144337518 learned_addr learned my addr 172.21.15.39:0/1144337518 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5956640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f01025f0 0x7f79f01a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 -- 172.21.15.39:0/1144337518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f01025f0 msgr2=0x7f79f01a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f01025f0 0x7f79f01a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 -- 172.21.15.39:0/1144337518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79f0101c30 msgr2=0x7f79f019a580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79f0101c30 0x7f79f019a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 -- 172.21.15.39:0/1144337518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f01a1c60 con 0x7f79f0100a40 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f5155640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c970 tx=0x7f79ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79e67fc640 1 -- 172.21.15.39:0/1144337518 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec004220 con 0x7f79f0100a40 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79e67fc640 1 -- 172.21.15.39:0/1144337518 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0043c0 con 0x7f79f0100a40 2024-09-12T02:01:13.257 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f01a1f50 con 0x7f79f0100a40 2024-09-12T02:01:13.258 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79e67fc640 1 -- 172.21.15.39:0/1144337518 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00f450 con 0x7f79f0100a40 2024-09-12T02:01:13.258 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.255+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f01a2430 con 0x7f79f0100a40 2024-09-12T02:01:13.263 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.257+0000 7f79e67fc640 1 -- 172.21.15.39:0/1144337518 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f79ec0079b0 con 0x7f79f0100a40 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.258+0000 7f79e67fc640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 0x7f79dc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.258+0000 7f79fa226740 1 Processor -- start 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.258+0000 7f79e67fc640 1 -- 172.21.15.39:0/1144337518 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f79ec0ceed0 con 0x7f79f0100a40 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 -- start start 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f4954640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 0x7f79dc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d32e0 0x563c309d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563c309362f0 con 0x563c309d8370 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563c308de270 con 0x563c309d32e0 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79fa226740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c309322b0 con 0x563c309d29a0 2024-09-12T02:01:13.264 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5956640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5956640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57110/0 (socket says 172.21.15.39:57110) 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5956640 1 -- 172.21.15.39:0/3762190946 learned_addr learned my addr 172.21.15.39:0/3762190946 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f4954640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 0x7f79dc0a50f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79e002a930 tx=0x7f79e0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 -- 172.21.15.39:0/3762190946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d32e0 msgr2=0x563c309d7da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d32e0 0x563c309d7da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 -- 172.21.15.39:0/3762190946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 msgr2=0x563c309da830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 -- 172.21.15.39:0/3762190946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c308dd340 con 0x563c309d29a0 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5956640 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.259+0000 7f79f5155640 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309d2da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0cc980 tx=0x7f79ec09b130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6bba8d139a57e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.265 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.260+0000 7f79db7fe640 1 -- 172.21.15.39:0/3762190946 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec01d040 con 0x563c309d29a0 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.260+0000 7f79db7fe640 1 -- 172.21.15.39:0/3762190946 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0a4350 con 0x563c309d29a0 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.260+0000 7f79db7fe640 1 -- 172.21.15.39:0/3762190946 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec007ca0 con 0x563c309d29a0 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.260+0000 7f79fa226740 1 -- 172.21.15.39:0/3762190946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 msgr2=0x563c309d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.260+0000 7f79fa226740 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309d2da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0cc980 tx=0x7f79ec09b130 comp rx=0 tx=0).stop 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- 172.21.15.39:0/3762190946 shutdown_connections 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d32e0 0x563c309d7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- 172.21.15.39:0/3762190946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309d2da0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- 172.21.15.39:0/3762190946 >> 172.21.15.39:0/3762190946 conn(0x563c309ce010 msgr2=0x563c309ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- 172.21.15.39:0/3762190946 shutdown_connections 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- 172.21.15.39:0/3762190946 wait complete. 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- start start 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 Processor -- start 2024-09-12T02:01:13.266 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 0x563c309dcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x563c309db2e0 con 0x563c309d8370 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563c308bf290 con 0x563c309d29a0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c309db460 con 0x563c309d32e0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.261+0000 7f79fa226740 10 client.0 _ll_register_callbacks cb 0x563c308f0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5155640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 0x563c309dcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57112/0 (socket says 172.21.15.39:57112) 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 -- 172.21.15.39:0/1288293294 learned_addr learned my addr 172.21.15.39:0/1288293294 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f4954640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.267 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 -- 172.21.15.39:0/1288293294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 msgr2=0x563c309dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 -- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 msgr2=0x563c309dcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 0x563c309dcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 -- 172.21.15.39:0/1288293294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c30649210 con 0x563c309d8370 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5155640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 0x563c309dcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79f5956640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f79e800f910 tx=0x7f79e800fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9edd70873d5479 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8017070 con 0x563c309d8370 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f79e800dcb0 con 0x563c309d8370 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.262+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec0a4350 con 0x563c309d8370 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f79e8023050 con 0x563c309d8370 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:13.268 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563c30715620 con 0x563c309d8370 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0a4350 con 0x563c309d8370 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f79e8011040 con 0x563c309d8370 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 20 client.16389 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c309e8930 0x563c309ead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 4 client.16389 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c30943a20 con 0x563c309e8930 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.263+0000 7f79f5155640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c309e8930 0x563c309ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.264+0000 7f79d8ff9640 10 client.16389 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:13.269 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.264+0000 7f79f5155640 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c309e8930 0x563c309ead20 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6deef8ac10559eba server_cookie=4dd98a4cd2a93b1 in_seq=0 out_seq=0 2024-09-12T02:01:13.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79d8ff9640 1 -- 172.21.15.39:0/1288293294 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c30943a20 con 0x563c309e8930 2024-09-12T02:01:13.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79d8ff9640 10 client.16389 handle_command_reply: tid=0 2024-09-12T02:01:13.270 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 client.16389 shutdown 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 msgr2=0x563c309e4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f79e800f910 tx=0x7f79e800fdd0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 shutdown_connections 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c309e8930 0x563c309ead20 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d8370 0x563c309e4170 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79d8ff9640 0 client.16389 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 --2- 172.21.15.39:0/1288293294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d29a0 0x563c309dcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.271 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 >> 172.21.15.39:0/1288293294 conn(0x563c309ce010 msgr2=0x563c309cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 shutdown_connections 2024-09-12T02:01:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 1 -- 172.21.15.39:0/1288293294 wait complete. 2024-09-12T02:01:13.272 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.265+0000 7f79fa226740 20 client.16389 trim_cache size 0 max 16384 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 Processor -- start 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 -- start start 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.281 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01adb90 con 0x563c309d32e0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01ab400 con 0x563c309d8370 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.280+0000 7f79fa226740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01a9250 con 0x563c309d29a0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f4954640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f4954640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57120/0 (socket says 172.21.15.39:57120) 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f4954640 1 -- 172.21.15.39:0/4162934528 learned_addr learned my addr 172.21.15.39:0/4162934528 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5956640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 -- 172.21.15.39:0/4162934528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 msgr2=0x563c309cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 -- 172.21.15.39:0/4162934528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 msgr2=0x563c309e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 -- 172.21.15.39:0/4162934528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c309d37c0 con 0x563c309d29a0 2024-09-12T02:01:13.282 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f4954640 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:13.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79f5155640 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309cd0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c940 tx=0x7f79ec004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1792a4d5dabd81b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79daffd640 1 -- 172.21.15.39:0/4162934528 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec01d040 con 0x563c309d29a0 2024-09-12T02:01:13.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79daffd640 1 -- 172.21.15.39:0/4162934528 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0b3040 con 0x563c309d29a0 2024-09-12T02:01:13.283 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.281+0000 7f79daffd640 1 -- 172.21.15.39:0/4162934528 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec09ad90 con 0x563c309d29a0 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 -- 172.21.15.39:0/4162934528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 msgr2=0x563c309cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309cd0b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c940 tx=0x7f79ec004570 comp rx=0 tx=0).stop 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 -- 172.21.15.39:0/4162934528 shutdown_connections 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d32e0 0x563c309e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 --2- 172.21.15.39:0/4162934528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d29a0 0x563c309cd0b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 -- 172.21.15.39:0/4162934528 >> 172.21.15.39:0/4162934528 conn(0x563c309ce010 msgr2=0x563c309cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 -- 172.21.15.39:0/4162934528 shutdown_connections 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.282+0000 7f79fa226740 1 -- 172.21.15.39:0/4162934528 wait complete. 2024-09-12T02:01:13.290 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 -- start start 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 Processor -- start 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01a98c0 con 0x563c309d29a0 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01aad30 con 0x563c309d8370 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79f01a9f90 con 0x563c309d32e0 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79fa226740 10 client.0 _ll_register_callbacks cb 0x7f79e8007940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79f5155640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79f5155640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57134/0 (socket says 172.21.15.39:57134) 2024-09-12T02:01:13.291 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79f5155640 1 -- 172.21.15.39:0/2612592994 learned_addr learned my addr 172.21.15.39:0/2612592994 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.283+0000 7f79f5956640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f4954640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 -- 172.21.15.39:0/2612592994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 msgr2=0x563c309e1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309e1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 -- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 msgr2=0x563c309e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 -- 172.21.15.39:0/2612592994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c309e33a0 con 0x563c309d29a0 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f4954640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79f5155640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0a3e20 tx=0x7f79ec0ba200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31fc7c86a6dcc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.292 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec064070 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f79ec09ab30 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec0b3040 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f79ec01d070 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 10 client.16395 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563c30a53600 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0b3040 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f79ec0a0c20 con 0x563c309d29a0 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 10 client.16395 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 20 client.16395 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.284+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c30a53a80 0x563c30a55ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.293 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.285+0000 7f79fa226740 4 client.16395 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.285+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c3093dd70 con 0x563c30a53a80 2024-09-12T02:01:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.285+0000 7f79f4954640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c30a53a80 0x563c30a55ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.285+0000 7f79f4954640 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c30a53a80 0x563c30a55ea0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a232bd225975c564 server_cookie=2ed213ae88ccaf44 in_seq=0 out_seq=0 2024-09-12T02:01:13.294 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.285+0000 7f79d8ff9640 10 client.16395 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:13.298 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79d8ff9640 1 -- 172.21.15.39:0/2612592994 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c3093dd70 con 0x563c30a53a80 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79d8ff9640 10 client.16395 handle_command_reply: tid=0 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 client.16395 shutdown 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 msgr2=0x563c309e1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0a3e20 tx=0x7f79ec0ba200 comp rx=0 tx=0).stop 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 shutdown_connections 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x563c30a53a80 0x563c30a55ea0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563c309d8370 0x563c309e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c309d32e0 0x563c309e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79d8ff9640 0 client.16395 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 --2- 172.21.15.39:0/2612592994 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x563c309d29a0 0x563c309e1840 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 >> 172.21.15.39:0/2612592994 conn(0x563c309ce010 msgr2=0x563c309cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 shutdown_connections 2024-09-12T02:01:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 1 -- 172.21.15.39:0/2612592994 wait complete. 2024-09-12T02:01:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.298+0000 7f79fa226740 20 client.16395 trim_cache size 0 max 16384 2024-09-12T02:01:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:01:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:01:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:01:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 msgr2=0x7f79dc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 0x7f79dc0a50f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79e002a930 tx=0x7f79e0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 msgr2=0x7f79f019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00c970 tx=0x7f79ec00ce30 comp rx=0 tx=0).stop 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 shutdown_connections 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f79dc0a2c30 0x7f79dc0a50f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79f01025f0 0x7f79f01a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79f0101c30 0x7f79f019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 --2- 172.21.15.39:0/1144337518 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79f0100a40 0x7f79f019a040 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 >> 172.21.15.39:0/1144337518 conn(0x7f79f00fc1e0 msgr2=0x7f79f0190d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 shutdown_connections 2024-09-12T02:01:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:13.299+0000 7f79f73b9640 1 -- 172.21.15.39:0/1144337518 wait complete. 2024-09-12T02:01:13.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:12 smithi044 ceph-mon[35259]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-12T02:01:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 -- 172.21.15.39:0/1325991763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 msgr2=0x7fe70c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 --2- 172.21.15.39:0/1325991763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c107b90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009930 tx=0x7fe6fc02a420 comp rx=0 tx=0).stop 2024-09-12T02:01:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 -- 172.21.15.39:0/1325991763 shutdown_connections 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 --2- 172.21.15.39:0/1325991763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c1082a0 0x7fe70c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 --2- 172.21.15.39:0/1325991763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c107b90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 --2- 172.21.15.39:0/1325991763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c102d30 0x7fe70c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 -- 172.21.15.39:0/1325991763 >> 172.21.15.39:0/1325991763 conn(0x7fe70c0fc7d0 msgr2=0x7fe70c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 -- 172.21.15.39:0/1325991763 shutdown_connections 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.417+0000 7fe714425640 1 -- 172.21.15.39:0/1325991763 wait complete. 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 Processor -- start 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 -- start start 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 0x7fe70c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 0x7fe70c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c1120a0 con 0x7fe70c1036e0 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c111f20 con 0x7fe70c1082a0 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe714425640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c112220 con 0x7fe70c102d30 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe7119c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe7121c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 0x7fe70c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe7119c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57154/0 (socket says 172.21.15.39:57154) 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe7119c0640 1 -- 172.21.15.39:0/3861958354 learned_addr learned my addr 172.21.15.39:0/3861958354 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.418+0000 7fe7129c2640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 0x7fe70c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 -- 172.21.15.39:0/3861958354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 msgr2=0x7fe70c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 0x7fe70c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 -- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 msgr2=0x7fe70c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 -- 172.21.15.39:0/3861958354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c19d570 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7119c0640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7129c2640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 0x7fe70c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7121c1640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 0x7fe70c1985c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e9f0 tx=0x7fe70800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70800ccc0 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe708010910 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c19d860 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708018960 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.419+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c1a5140 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.420+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70c103110 con 0x7fe70c102d30 2024-09-12T02:01:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.421+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe708010ac0 con 0x7fe70c102d30 2024-09-12T02:01:13.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.422+0000 7fe7037fe640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 0x7fe6f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:13.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.422+0000 7fe7119c0640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 0x7fe6f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:13.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.422+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe7080cf420 con 0x7fe70c102d30 2024-09-12T02:01:13.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.422+0000 7fe7119c0640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 0x7fe6f80a5040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc000c00 tx=0x7fe6fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:13.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.426+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe70809bce0 con 0x7fe70c102d30 2024-09-12T02:01:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.666+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe70c199920 con 0x7fe70c102d30 2024-09-12T02:01:13.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.667+0000 7fe7037fe640 1 -- 172.21.15.39:0/3861958354 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11913 (secure 0 0 0) 0x7fe70809ffe0 con 0x7fe70c102d30 2024-09-12T02:01:13.667 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:01:13.668 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"btime":"2024-09-12T02:00:47:877694+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:00:47.877682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:01:13.668 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-09-12T02:01:13.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 msgr2=0x7fe6f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 0x7fe6f80a5040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc000c00 tx=0x7fe6fc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 msgr2=0x7fe70c1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 0x7fe70c1985c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e9f0 tx=0x7fe70800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 shutdown_connections 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe70c1082a0 0x7fe70c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe70c1036e0 0x7fe70c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe6f80a2b80 0x7fe6f80a5040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 --2- 172.21.15.39:0/3861958354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe70c102d30 0x7fe70c1985c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 >> 172.21.15.39:0/3861958354 conn(0x7fe70c0fc7d0 msgr2=0x7fe70c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 shutdown_connections 2024-09-12T02:01:13.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:13.669+0000 7fe714425640 1 -- 172.21.15.39:0/3861958354 wait complete. 2024-09-12T02:01:14.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:13 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3861958354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:14.324 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:13 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3861958354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:14.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:13 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3861958354' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:14.466 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0' 2024-09-12T02:01:14.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db / --timeout 90 --expiration 140.15 --await-for 45.0 2024-09-12T02:01:14.741 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:15.155 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:14 smithi039 ceph-mon[31204]: pgmap v468: 97 pgs: 97 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-12T02:01:15.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:14 smithi172 ceph-mon[35073]: pgmap v468: 97 pgs: 97 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-12T02:01:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 -- 172.21.15.39:0/2134324036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc8102db0 msgr2=0x7f7bc8103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 --2- 172.21.15.39:0/2134324036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc8102db0 0x7f7bc8103190 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009cd0 tx=0x7f7bb802a8e0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 -- 172.21.15.39:0/2134324036 shutdown_connections 2024-09-12T02:01:15.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 --2- 172.21.15.39:0/2134324036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc81082e0 0x7f7bc810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 --2- 172.21.15.39:0/2134324036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8103760 0x7f7bc8107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 --2- 172.21.15.39:0/2134324036 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc8102db0 0x7f7bc8103190 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 -- 172.21.15.39:0/2134324036 >> 172.21.15.39:0/2134324036 conn(0x7f7bc80fc7d0 msgr2=0x7f7bc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 -- 172.21.15.39:0/2134324036 shutdown_connections 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.253+0000 7f7bcd677640 1 -- 172.21.15.39:0/2134324036 wait complete. 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.254+0000 7f7bcd677640 1 Processor -- start 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.254+0000 7f7bcd677640 1 -- start start 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 0x7f7bc819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81120b0 con 0x7f7bc81082e0 2024-09-12T02:01:15.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc8111f30 con 0x7f7bc8103760 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bcd677640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc8112230 con 0x7f7bc8102db0 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:38032/0 (socket says 172.21.15.39:38032) 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 0x7f7bc819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/3390286456 learned_addr learned my addr 172.21.15.39:0/3390286456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50242/0 (socket says 172.21.15.39:50242) 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/3390286456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 msgr2=0x7f7bc8198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 msgr2=0x7f7bc819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 0x7f7bc819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/3390286456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc819d580 con 0x7f7bc8102db0 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:15.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.255+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 0x7f7bc819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:15.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.256+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bb802ae00 tx=0x7f7bb8031e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.256+0000 7f7bbffff640 1 -- 172.21.15.39:0/3390286456 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8003d80 con 0x7f7bc8102db0 2024-09-12T02:01:15.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.256+0000 7f7bbffff640 1 -- 172.21.15.39:0/3390286456 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb8004520 con 0x7f7bc8102db0 2024-09-12T02:01:15.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.256+0000 7f7bbffff640 1 -- 172.21.15.39:0/3390286456 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8030de0 con 0x7f7bc8102db0 2024-09-12T02:01:15.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.256+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc819d810 con 0x7f7bc8102db0 2024-09-12T02:01:15.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.257+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc81a5150 con 0x7f7bc8102db0 2024-09-12T02:01:15.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.259+0000 7f7bbffff640 1 -- 172.21.15.39:0/3390286456 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7bb80046d0 con 0x7f7bc8102db0 2024-09-12T02:01:15.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.259+0000 7f7bcfa50740 1 Processor -- start 2024-09-12T02:01:15.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.259+0000 7f7bcfa50740 1 -- start start 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bbffff640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 0x7f7bb40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec10c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec1b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5612deb75160 con 0x5612dec1ba30 2024-09-12T02:01:15.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5612deb1c720 con 0x5612dec11170 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5612deb71120 con 0x5612dec10850 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 0x7f7bb40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57188/0 (socket says 172.21.15.39:57188) 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 -- 172.21.15.39:0/559172237 learned_addr learned my addr 172.21.15.39:0/559172237 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec1b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bbffff640 1 -- 172.21.15.39:0/3390286456 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f7bb802e070 con 0x7f7bc8102db0 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 -- 172.21.15.39:0/559172237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 msgr2=0x5612dec10c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec10c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.260+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec10c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc77fe640 1 -- 172.21.15.39:0/559172237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 msgr2=0x5612dec1b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec1b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc77fe640 1 -- 172.21.15.39:0/559172237 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612de8e6ba0 con 0x5612dec1ba30 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec1b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 0x7f7bb40a5190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0011cc0 tx=0x7f7bc00118d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0005b90 tx=0x7f7bc001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6954187a7d47a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bbd7fa640 1 -- 172.21.15.39:0/559172237 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0024070 con 0x5612dec1ba30 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bbd7fa640 1 -- 172.21.15.39:0/559172237 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bc0011cf0 con 0x5612dec1ba30 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.261+0000 7f7bbd7fa640 1 -- 172.21.15.39:0/559172237 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc001fe10 con 0x5612dec1ba30 2024-09-12T02:01:15.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- 172.21.15.39:0/559172237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 msgr2=0x5612dec1de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0005b90 tx=0x7f7bc001d000 comp rx=0 tx=0).stop 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- 172.21.15.39:0/559172237 shutdown_connections 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec1de20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec1b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/559172237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec10c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- 172.21.15.39:0/559172237 >> 172.21.15.39:0/559172237 conn(0x5612dec0cde0 msgr2=0x5612dec0d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- 172.21.15.39:0/559172237 shutdown_connections 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- 172.21.15.39:0/559172237 wait complete. 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.262+0000 7f7bcfa50740 1 -- start start 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 Processor -- start 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec18f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec19460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5612dec1e600 con 0x5612dec1ba30 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5612deafd900 con 0x5612dec10850 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5612dec1e780 con 0x5612dec11170 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bcfa50740 10 client.0 _ll_register_callbacks cb 0x5612deafb780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50268/0 (socket says 172.21.15.39:50268) 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/1599551615 learned_addr learned my addr 172.21.15.39:0/1599551615 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec18f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec19460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/1599551615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 msgr2=0x5612dec18f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec18f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/1599551615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 msgr2=0x5612dec19460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec19460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.263+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/1599551615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612deb3dc50 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b8660 tx=0x7f7bb80bbe30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1a7eb8fc81891a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80c05b0 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f7bb80b8870 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bc0011cf0 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7bb80c4e70 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bcfa50740 10 client.25967 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5612dec2a370 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb8036040 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.264+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7bb8030070 con 0x5612dec10850 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 10 client.25967 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:15.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 10 client.25967 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 20 client.25967 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec2b8a0 0x5612dec2dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 4 client.25967 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7bc0011cf0 con 0x5612dec2b8a0 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec2b8a0 0x5612dec2dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec2b8a0 0x5612dec2dcc0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df05fab687099328 server_cookie=9b21d814295d5e19 in_seq=0 out_seq=0 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.265+0000 7f7bae7fc640 10 client.25967 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.266+0000 7f7bae7fc640 1 -- 172.21.15.39:0/1599551615 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7bc0011cf0 con 0x5612dec2b8a0 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.266+0000 7f7bae7fc640 10 client.25967 handle_command_reply: tid=0 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.266+0000 7f7bcfa50740 1 client.25967 shutdown 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.266+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 msgr2=0x5612dec189e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.266+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b8660 tx=0x7f7bb80bbe30 comp rx=0 tx=0).stop 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 shutdown_connections 2024-09-12T02:01:15.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec2b8a0 0x5612dec2dcc0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec19460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec18f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bae7fc640 0 client.25967 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1599551615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec10850 0x5612dec189e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 >> 172.21.15.39:0/1599551615 conn(0x5612dec0cde0 msgr2=0x5612dec12b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 shutdown_connections 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1599551615 wait complete. 2024-09-12T02:01:15.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.267+0000 7f7bcfa50740 20 client.25967 trim_cache size 0 max 16384 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.285+0000 7f7bcfa50740 1 Processor -- start 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.285+0000 7f7bcfa50740 1 -- start start 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 0x5612dec335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec33b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec1ba30 0x5612dec15c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81afd90 con 0x5612dec10850 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81ad600 con 0x5612dec1ba30 2024-09-12T02:01:15.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81ab470 con 0x5612dec11170 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 0x5612dec335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec33b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 0x5612dec335e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57210/0 (socket says 172.21.15.39:57210) 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc6ffd640 1 -- 172.21.15.39:0/1806433693 learned_addr learned my addr 172.21.15.39:0/1806433693 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec1ba30 0x5612dec15c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 -- 172.21.15.39:0/1806433693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec1ba30 msgr2=0x5612dec15c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec1ba30 0x5612dec15c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 -- 172.21.15.39:0/1806433693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 msgr2=0x5612dec335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 0x5612dec335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.286+0000 7f7bc67fc640 1 -- 172.21.15.39:0/1806433693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612dec0da70 con 0x5612dec11170 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.287+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec33b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5612dec18270 tx=0x7f7bb0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56d3b2c56deae3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.287+0000 7f7bbcff9640 1 -- 172.21.15.39:0/1806433693 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0004230 con 0x5612dec11170 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.287+0000 7f7bbcff9640 1 -- 172.21.15.39:0/1806433693 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb00043d0 con 0x5612dec11170 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.287+0000 7f7bbcff9640 1 -- 172.21.15.39:0/1806433693 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00047a0 con 0x5612dec11170 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1806433693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 msgr2=0x5612dec33b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec33b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5612dec18270 tx=0x7f7bb0005f90 comp rx=0 tx=0).stop 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1806433693 shutdown_connections 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec1ba30 0x5612dec15c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec11170 0x5612dec33b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/1806433693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec10850 0x5612dec335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1806433693 >> 172.21.15.39:0/1806433693 conn(0x5612dec0cde0 msgr2=0x5612dec191c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1806433693 shutdown_connections 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- 172.21.15.39:0/1806433693 wait complete. 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 -- start start 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.288+0000 7f7bcfa50740 1 Processor -- start 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec1ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81abac0 con 0x5612dec1ba30 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81acf30 con 0x5612dec11170 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc81ac190 con 0x5612dec10850 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bcfa50740 10 client.0 _ll_register_callbacks cb 0x7f7bb8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec1ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57218/0 (socket says 172.21.15.39:57218) 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 -- 172.21.15.39:0/2243592623 learned_addr learned my addr 172.21.15.39:0/2243592623 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc67fc640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 -- 172.21.15.39:0/2243592623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 msgr2=0x5612dec1ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec1ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 -- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 msgr2=0x5612dec204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 -- 172.21.15.39:0/2243592623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612dec8fc30 con 0x5612dec1ba30 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec1ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bc77fe640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0023040 tx=0x7f7bc001fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c85d6681c1dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.289+0000 7f7bae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc003d060 con 0x5612dec1ba30 2024-09-12T02:01:15.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f7bc001fd00 con 0x5612dec1ba30 2024-09-12T02:01:15.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb00043d0 con 0x5612dec1ba30 2024-09-12T02:01:15.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7bc001a040 con 0x5612dec1ba30 2024-09-12T02:01:15.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bcfa50740 10 client.16419 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:15.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5612dec96fc0 con 0x5612dec1ba30 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.290+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb00043d0 con 0x5612dec1ba30 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7bc002d870 con 0x5612dec1ba30 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 10 client.16419 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 10 client.16419 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 20 client.16419 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec97490 0x5612dec99880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 4 client.16419 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}] 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.15, "await_for": 45.0}) -- 0x5612deb82890 con 0x5612dec97490 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.291+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec97490 0x5612dec99880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:15.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.292+0000 7f7bae7fc640 10 client.16419 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:15.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:15.292+0000 7f7bc6ffd640 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec97490 0x5612dec99880 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f438aecf99dc0d1 server_cookie=eb404a42e69983d0 in_seq=0 out_seq=0 2024-09-12T02:01:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:14 smithi044 ceph-mon[35259]: pgmap v468: 97 pgs: 97 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 170 KiB/s wr, 28 op/s 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.323+0000 7f7bae7fc640 1 -- 172.21.15.39:0/2243592623 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5612deb82890 con 0x5612dec97490 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.323+0000 7f7bae7fc640 10 client.16419 handle_command_reply: tid=0 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.323+0000 7f7bcfa50740 1 client.16419 shutdown 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.323+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 msgr2=0x5612dec8f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.323+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0023040 tx=0x7f7bc001fa90 comp rx=0 tx=0).stop 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 shutdown_connections 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5612dec97490 0x5612dec99880 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5612dec1ba30 0x5612dec8f5f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5612dec11170 0x5612dec204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 --2- 172.21.15.39:0/2243592623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612dec10850 0x5612dec1ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bae7fc640 0 client.16419 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 >> 172.21.15.39:0/2243592623 conn(0x5612dec0cde0 msgr2=0x5612dec122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 shutdown_connections 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 1 -- 172.21.15.39:0/2243592623 wait complete. 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcfa50740 20 client.16419 trim_cache size 0 max 16384 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 31, 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 18, 2024-09-12T02:01:16.325 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "202ece11": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 18, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 140.2, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:16.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "QUIESCED", 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:16.327 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 msgr2=0x7f7bb40a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 0x7f7bb40a5190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0011cc0 tx=0x7f7bc00118d0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 msgr2=0x7f7bc81985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.324+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bb802ae00 tx=0x7f7bb8031e40 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 shutdown_connections 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bc81082e0 0x7f7bc819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bc8103760 0x7f7bc8198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f7bb40a2cd0 0x7f7bb40a5190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 --2- 172.21.15.39:0/3390286456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8102db0 0x7f7bc81985d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 >> 172.21.15.39:0/3390286456 conn(0x7f7bc80fc7d0 msgr2=0x7f7bc8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:16.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 shutdown_connections 2024-09-12T02:01:16.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:16.325+0000 7f7bcd677640 1 -- 172.21.15.39:0/3390286456 wait complete. 2024-09-12T02:01:17.033 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '202ece11', quiesce took 4.4 seconds. Will release after: 15.749999999999998 2024-09-12T02:01:17.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:16 smithi172 ceph-mon[35073]: pgmap v469: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 623 KiB/s wr, 104 op/s 2024-09-12T02:01:17.330 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:16 smithi039 ceph-mon[31204]: pgmap v469: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 623 KiB/s wr, 104 op/s 2024-09-12T02:01:17.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:16 smithi044 ceph-mon[35259]: pgmap v469: 97 pgs: 97 active+clean; 54 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 623 KiB/s wr, 104 op/s 2024-09-12T02:01:19.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:18 smithi172 ceph-mon[35073]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 KiB/s wr, 130 op/s 2024-09-12T02:01:19.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:18 smithi039 ceph-mon[31204]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 KiB/s wr, 130 op/s 2024-09-12T02:01:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:18 smithi044 ceph-mon[35259]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 798 KiB/s wr, 130 op/s 2024-09-12T02:01:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:20 smithi172 ceph-mon[35073]: pgmap v471: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2024-09-12T02:01:21.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:20 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:21.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:20 smithi039 ceph-mon[31204]: pgmap v471: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2024-09-12T02:01:21.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:20 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:21.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:20 smithi044 ceph-mon[35259]: pgmap v471: 97 pgs: 97 active+clean; 58 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 205 op/s 2024-09-12T02:01:21.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:20 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:01:22.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:22.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:22.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:21 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:01:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:21 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:01:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:01:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:01:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:21 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:01:23.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:22 smithi172 ceph-mon[35073]: pgmap v472: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:23.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:22 smithi039 ceph-mon[31204]: pgmap v472: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:23.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:22 smithi044 ceph-mon[35259]: pgmap v472: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:25.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:24 smithi172 ceph-mon[35073]: pgmap v473: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:25.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:24 smithi039 ceph-mon[31204]: pgmap v473: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:25.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:24 smithi044 ceph-mon[35259]: pgmap v473: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.2 MiB/s wr, 220 op/s 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 -- 172.21.15.39:0/102049630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 msgr2=0x7fae3c109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 --2- 172.21.15.39:0/102049630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c109cc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fae34009ca0 tx=0x7fae3402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 -- 172.21.15.39:0/102049630 shutdown_connections 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 --2- 172.21.15.39:0/102049630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c109cc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 --2- 172.21.15.39:0/102049630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c104fa0 0x7fae3c107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 --2- 172.21.15.39:0/102049630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c102670 0x7fae3c104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 -- 172.21.15.39:0/102049630 >> 172.21.15.39:0/102049630 conn(0x7fae3c0fc1b0 msgr2=0x7fae3c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 -- 172.21.15.39:0/102049630 shutdown_connections 2024-09-12T02:01:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.400+0000 7fae42f96640 1 -- 172.21.15.39:0/102049630 wait complete. 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 Processor -- start 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 -- start start 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 0x7fae3c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c104fa0 0x7fae3c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10d810 con 0x7fae3c1078d0 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10d690 con 0x7fae3c104fa0 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae42f96640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c10d990 con 0x7fae3c102670 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40462/0 (socket says 172.21.15.39:40462) 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 -- 172.21.15.39:0/1622608656 learned_addr learned my addr 172.21.15.39:0/1622608656 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae3bfff640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c104fa0 0x7fae3c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae40d32640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 0x7fae3c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 -- 172.21.15.39:0/1622608656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 msgr2=0x7fae3c197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 0x7fae3c197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 -- 172.21.15.39:0/1622608656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c104fa0 msgr2=0x7fae3c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c104fa0 0x7fae3c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae41533640 1 -- 172.21.15.39:0/1622608656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c19f9e0 con 0x7fae3c1078d0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.401+0000 7fae40d32640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 0x7fae3c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae41533640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fae3402f540 tx=0x7fae34031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae39ffb640 1 -- 172.21.15.39:0/1622608656 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34003c30 con 0x7fae3c1078d0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae39ffb640 1 -- 172.21.15.39:0/1622608656 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae34003dd0 con 0x7fae3c1078d0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c19fc70 con 0x7fae3c1078d0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae39ffb640 1 -- 172.21.15.39:0/1622608656 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3402fd90 con 0x7fae3c1078d0 2024-09-12T02:01:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.402+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c1a01c0 con 0x7fae3c1078d0 2024-09-12T02:01:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.404+0000 7fae39ffb640 1 -- 172.21.15.39:0/1622608656 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae34004050 con 0x7fae3c1078d0 2024-09-12T02:01:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 Processor -- start 2024-09-12T02:01:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 -- start start 2024-09-12T02:01:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae39ffb640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 0x7fae240a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560dfa01c2f0 con 0x560dfa0be370 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560df9fc4270 con 0x560dfa0b89a0 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae45e08740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560dfa0182b0 con 0x560dfa0b92e0 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae40d32640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 0x7fae240a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40474/0 (socket says 172.21.15.39:40474) 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae41533640 1 -- 172.21.15.39:0/232886500 learned_addr learned my addr 172.21.15.39:0/232886500 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae39ffb640 1 -- 172.21.15.39:0/1622608656 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fae340f01c0 con 0x7fae3c1078d0 2024-09-12T02:01:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.405+0000 7fae3bfff640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae3bfff640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 -- 172.21.15.39:0/232886500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 msgr2=0x560dfa0bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 -- 172.21.15.39:0/232886500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 msgr2=0x560dfa0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 -- 172.21.15.39:0/232886500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df9fc3340 con 0x560dfa0be370 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae3bfff640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae40d32640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 0x7fae240a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009c20 tx=0x7fae2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae41533640 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fae340c5230 tx=0x7fae3402f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b3cde35e5806df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae22ffd640 1 -- 172.21.15.39:0/232886500 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340bc630 con 0x560dfa0be370 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae22ffd640 1 -- 172.21.15.39:0/232886500 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae34036070 con 0x560dfa0be370 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.406+0000 7fae22ffd640 1 -- 172.21.15.39:0/232886500 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340cf630 con 0x560dfa0be370 2024-09-12T02:01:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- 172.21.15.39:0/232886500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 msgr2=0x560dfa0c0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fae340c5230 tx=0x7fae3402f7f0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- 172.21.15.39:0/232886500 shutdown_connections 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c0830 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 --2- 172.21.15.39:0/232886500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- 172.21.15.39:0/232886500 >> 172.21.15.39:0/232886500 conn(0x560dfa0b4010 msgr2=0x560dfa0b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- 172.21.15.39:0/232886500 shutdown_connections 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- 172.21.15.39:0/232886500 wait complete. 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 -- start start 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.407+0000 7fae45e08740 1 Processor -- start 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.418 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560dfa01c2f0 con 0x560dfa0be370 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560df9fa5290 con 0x560dfa0b89a0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560dfa0c1100 con 0x560dfa0b92e0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae45e08740 10 client.0 _ll_register_callbacks cb 0x560df9fd6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40482/0 (socket says 172.21.15.39:40482) 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 -- 172.21.15.39:0/668555446 learned_addr learned my addr 172.21.15.39:0/668555446 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae3bfff640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae40d32640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 -- 172.21.15.39:0/668555446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 msgr2=0x560dfa0c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 -- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 msgr2=0x560dfa0c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.419 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 -- 172.21.15.39:0/668555446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df9d2f210 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae41533640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fae340b8f50 tx=0x7fae3402f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8524ae944219c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.408+0000 7fae1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae340cf810 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fae340badf0 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae34036070 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae340cf9f0 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 10 client.16431 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560df9dfb620 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae34036070 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fae340cfbd0 con 0x560dfa0be370 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 10 client.16431 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 20 client.16431 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa0ce280 0x560dfa0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 4 client.16431 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.409+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dfa029a20 con 0x560dfa0ce280 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.410+0000 7fae40d32640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa0ce280 0x560dfa0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.410+0000 7fae1bfff640 10 client.16431 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.410+0000 7fae40d32640 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa0ce280 0x560dfa0d0690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc77a2e2532f25e server_cookie=16fcf8c3186c0a99 in_seq=0 out_seq=0 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae1bfff640 1 -- 172.21.15.39:0/668555446 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560dfa029a20 con 0x560dfa0ce280 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae1bfff640 10 client.16431 handle_command_reply: tid=0 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 client.16431 shutdown 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 msgr2=0x560dfa0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fae340b8f50 tx=0x7fae3402f610 comp rx=0 tx=0).stop 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 shutdown_connections 2024-09-12T02:01:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa0ce280 0x560dfa0d0690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0be370 0x560dfa0c9cb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b92e0 0x560dfa0c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae1bfff640 0 client.16431 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 --2- 172.21.15.39:0/668555446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 >> 172.21.15.39:0/668555446 conn(0x560dfa0b4010 msgr2=0x560dfa0b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 shutdown_connections 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 1 -- 172.21.15.39:0/668555446 wait complete. 2024-09-12T02:01:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.411+0000 7fae45e08740 20 client.16431 trim_cache size 0 max 16384 2024-09-12T02:01:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 Processor -- start 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 -- start start 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b89a0 0x560dfa0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0be370 0x560dfa0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1ab760 con 0x560dfa0b92e0 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1a8fd0 con 0x560dfa0be370 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae45e08740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1a6e20 con 0x560dfa0b89a0 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40492/0 (socket says 172.21.15.39:40492) 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 -- 172.21.15.39:0/2914575447 learned_addr learned my addr 172.21.15.39:0/2914575447 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae41533640 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0be370 0x560dfa0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae40d32640 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b89a0 0x560dfa0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 -- 172.21.15.39:0/2914575447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b89a0 msgr2=0x560dfa0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b89a0 0x560dfa0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 -- 172.21.15.39:0/2914575447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0be370 msgr2=0x560dfa0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0be370 0x560dfa0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.426+0000 7fae3bfff640 1 -- 172.21.15.39:0/2914575447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dfa0b97c0 con 0x560dfa0b92e0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae3bfff640 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fae30004280 tx=0x7fae30005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e74520f139f70f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae227fc640 1 -- 172.21.15.39:0/2914575447 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30005020 con 0x560dfa0b92e0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae227fc640 1 -- 172.21.15.39:0/2914575447 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae300047a0 con 0x560dfa0b92e0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae227fc640 1 -- 172.21.15.39:0/2914575447 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30012720 con 0x560dfa0b92e0 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae45e08740 1 -- 172.21.15.39:0/2914575447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 msgr2=0x560dfa0c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae45e08740 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fae30004280 tx=0x7fae30005c90 comp rx=0 tx=0).stop 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.427+0000 7fae45e08740 1 -- 172.21.15.39:0/2914575447 shutdown_connections 2024-09-12T02:01:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0be370 0x560dfa0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c9c70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- 172.21.15.39:0/2914575447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0b89a0 0x560dfa0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- 172.21.15.39:0/2914575447 >> 172.21.15.39:0/2914575447 conn(0x560dfa0b4010 msgr2=0x560dfa0c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- 172.21.15.39:0/2914575447 shutdown_connections 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- 172.21.15.39:0/2914575447 wait complete. 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- start start 2024-09-12T02:01:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 Processor -- start 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0be370 0x560dfa0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1a7490 con 0x560dfa0b92e0 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1a8900 con 0x560dfa0b89a0 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c1a7b60 con 0x560dfa0be370 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae45e08740 10 client.0 _ll_register_callbacks cb 0x7fae3000b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.428+0000 7fae3bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40502/0 (socket says 172.21.15.39:40502) 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 -- 172.21.15.39:0/1341971399 learned_addr learned my addr 172.21.15.39:0/1341971399 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae40d32640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 -- 172.21.15.39:0/1341971399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0be370 msgr2=0x560dfa0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae41533640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0be370 0x560dfa0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0be370 0x560dfa0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 -- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 msgr2=0x560dfa0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 -- 172.21.15.39:0/1341971399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dfa0c8cb0 con 0x560dfa0b92e0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae3bfff640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fae3001f040 tx=0x7fae3000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dfa996a471b301 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3002d020 con 0x560dfa0b92e0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fae30004b50 con 0x560dfa0b92e0 2024-09-12T02:01:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae300047a0 con 0x560dfa0b92e0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae30005000 con 0x560dfa0b92e0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae45e08740 10 client.16437 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.429+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560dfa0c9fc0 con 0x560dfa0b92e0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae300047a0 con 0x560dfa0b92e0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fae30029480 con 0x560dfa0b92e0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 20 client.16437 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa139690 0x560dfa13bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 4 client.16437 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560dfa023d70 con 0x560dfa139690 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.430+0000 7fae40d32640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa139690 0x560dfa13bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.431+0000 7fae40d32640 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa139690 0x560dfa13bab0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de78ecbd301cdbf8 server_cookie=a8b16efb8f17816d in_seq=0 out_seq=0 2024-09-12T02:01:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.431+0000 7fae1bfff640 10 client.16437 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.450+0000 7fae1bfff640 1 -- 172.21.15.39:0/1341971399 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560dfa023d70 con 0x560dfa139690 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.450+0000 7fae1bfff640 10 client.16437 handle_command_reply: tid=0 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.450+0000 7fae45e08740 1 client.16437 shutdown 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 msgr2=0x560dfa0c7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fae3001f040 tx=0x7fae3000b870 comp rx=0 tx=0).stop 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 shutdown_connections 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560dfa139690 0x560dfa13bab0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560dfa0be370 0x560dfa0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae1bfff640 0 client.16437 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560dfa0b92e0 0x560dfa0c7690 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 --2- 172.21.15.39:0/1341971399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560dfa0b89a0 0x560dfa0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 >> 172.21.15.39:0/1341971399 conn(0x560dfa0b4010 msgr2=0x560dfa0b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 shutdown_connections 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 1 -- 172.21.15.39:0/1341971399 wait complete. 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.451+0000 7fae45e08740 20 client.16437 trim_cache size 0 max 16384 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:01:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:01:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 msgr2=0x7fae240a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 0x7fae240a5170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009c20 tx=0x7fae2c005f90 comp rx=0 tx=0).stop 2024-09-12T02:01:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 msgr2=0x7fae3c19f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fae3402f540 tx=0x7fae34031ee0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 shutdown_connections 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae3c1078d0 0x7fae3c19f370 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae3c104fa0 0x7fae3c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fae240a2cb0 0x7fae240a5170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 --2- 172.21.15.39:0/1622608656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c102670 0x7fae3c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 >> 172.21.15.39:0/1622608656 conn(0x7fae3c0fc1b0 msgr2=0x7fae3c102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 shutdown_connections 2024-09-12T02:01:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:26.452+0000 7fae42f96640 1 -- 172.21.15.39:0/1622608656 wait complete. 2024-09-12T02:01:27.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:26 smithi172 ceph-mon[35073]: pgmap v474: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.1 MiB/s wr, 200 op/s 2024-09-12T02:01:27.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:26 smithi039 ceph-mon[31204]: pgmap v474: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.1 MiB/s wr, 200 op/s 2024-09-12T02:01:27.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:26 smithi044 ceph-mon[35259]: pgmap v474: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.1 MiB/s wr, 200 op/s 2024-09-12T02:01:29.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:28 smithi172 ceph-mon[35073]: pgmap v475: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 652 KiB/s wr, 124 op/s 2024-09-12T02:01:29.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:28 smithi039 ceph-mon[31204]: pgmap v475: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 652 KiB/s wr, 124 op/s 2024-09-12T02:01:29.477 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:28 smithi044 ceph-mon[35259]: pgmap v475: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 652 KiB/s wr, 124 op/s 2024-09-12T02:01:31.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:30 smithi172 ceph-mon[35073]: pgmap v476: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 477 KiB/s wr, 98 op/s 2024-09-12T02:01:31.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:30 smithi039 ceph-mon[31204]: pgmap v476: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 477 KiB/s wr, 98 op/s 2024-09-12T02:01:31.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:30 smithi044 ceph-mon[35259]: pgmap v476: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 477 KiB/s wr, 98 op/s 2024-09-12T02:01:32.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:01:33.056 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:33.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:32 smithi039 ceph-mon[31204]: pgmap v477: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 91 KiB/s wr, 25 op/s 2024-09-12T02:01:33.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:32 smithi172 ceph-mon[35073]: pgmap v477: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 91 KiB/s wr, 25 op/s 2024-09-12T02:01:33.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:32 smithi044 ceph-mon[35259]: pgmap v477: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 91 KiB/s wr, 25 op/s 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 -- 172.21.15.39:0/894349041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324106f10 msgr2=0x7f032410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 --2- 172.21.15.39:0/894349041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324106f10 0x7f032410ea90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f031c009ca0 tx=0x7f031c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 -- 172.21.15.39:0/894349041 shutdown_connections 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 --2- 172.21.15.39:0/894349041 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324106f10 0x7f032410ea90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 --2- 172.21.15.39:0/894349041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324102790 0x7f03241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 --2- 172.21.15.39:0/894349041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 0x7f03241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 -- 172.21.15.39:0/894349041 >> 172.21.15.39:0/894349041 conn(0x7f03240fd8c0 msgr2=0x7f03240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 -- 172.21.15.39:0/894349041 shutdown_connections 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.551+0000 7f032c211640 1 -- 172.21.15.39:0/894349041 wait complete. 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 Processor -- start 2024-09-12T02:01:33.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 -- start start 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 0x7f0324198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 0x7f032419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0324111f90 con 0x7f0324102790 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0324111e10 con 0x7f0324101de0 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f032c211640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0324112110 con 0x7f0324106f10 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f03297ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f03297ac640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54706/0 (socket says 172.21.15.39:54706) 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f03297ac640 1 -- 172.21.15.39:0/3653190682 learned_addr learned my addr 172.21.15.39:0/3653190682 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.552+0000 7f0329fad640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 0x7f0324198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f032a7ae640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 0x7f032419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:33.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 -- 172.21.15.39:0/3653190682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 msgr2=0x7f032419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 0x7f032419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 -- 172.21.15.39:0/3653190682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 msgr2=0x7f0324198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 0x7f0324198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 -- 172.21.15.39:0/3653190682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032419d420 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f032a7ae640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 0x7f032419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f03297ac640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f031400b4a0 tx=0x7f031400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314014070 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0314010af0 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032419d710 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314017d10 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.553+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03241a4ff0 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.554+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03241021c0 con 0x7f0324102790 2024-09-12T02:01:33.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.555+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0314017070 con 0x7f0324102790 2024-09-12T02:01:33.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.556+0000 7f031affd640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 0x7f03100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:33.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.556+0000 7f0329fad640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 0x7f03100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:33.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.556+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f03140ce3c0 con 0x7f0324102790 2024-09-12T02:01:33.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.557+0000 7f0329fad640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 0x7f03100a5040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0320005d00 tx=0x7f032000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:33.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.560+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f031409b310 con 0x7f0324102790 2024-09-12T02:01:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.771+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f032402d7c0 con 0x7f0324102790 2024-09-12T02:01:33.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.772+0000 7f031affd640 1 -- 172.21.15.39:0/3653190682 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11913 (secure 0 0 0) 0x7f031409ac10 con 0x7f0324102790 2024-09-12T02:01:33.772 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:01:33.772 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":31,"btime":"2024-09-12T02:00:47:877694+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:00:47.877682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:01:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 31 2024-09-12T02:01:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 msgr2=0x7f03100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 0x7f03100a5040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0320005d00 tx=0x7f032000b410 comp rx=0 tx=0).stop 2024-09-12T02:01:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 msgr2=0x7f03241989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f031400b4a0 tx=0x7f031400b960 comp rx=0 tx=0).stop 2024-09-12T02:01:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 shutdown_connections 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f03100a2b80 0x7f03100a5040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0324106f10 0x7f032419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0324102790 0x7f03241989b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 --2- 172.21.15.39:0/3653190682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0324101de0 0x7f0324198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 >> 172.21.15.39:0/3653190682 conn(0x7f03240fd8c0 msgr2=0x7f03240fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 shutdown_connections 2024-09-12T02:01:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:33.774+0000 7f032c211640 1 -- 172.21.15.39:0/3653190682 wait complete. 2024-09-12T02:01:34.065 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:33 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3653190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:34.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:33 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3653190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:34.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:33 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3653190682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:01:34.611 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --set-id 202ece11 --release --await' 2024-09-12T02:01:34.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --set-id 202ece11 --release --await 2024-09-12T02:01:34.879 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:01:35.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:34 smithi172 ceph-mon[35073]: pgmap v478: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T02:01:35.280 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:34 smithi039 ceph-mon[31204]: pgmap v478: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T02:01:35.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- 172.21.15.39:0/2266200142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658074590 msgr2=0x7f7658074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 --2- 172.21.15.39:0/2266200142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658074590 0x7f7658074970 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7654009900 tx=0x7f765402a480 comp rx=0 tx=0).stop 2024-09-12T02:01:35.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- 172.21.15.39:0/2266200142 shutdown_connections 2024-09-12T02:01:35.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 --2- 172.21.15.39:0/2266200142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658112b90 0x7f7658114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 --2- 172.21.15.39:0/2266200142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 0x7f7658112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 --2- 172.21.15.39:0/2266200142 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658074590 0x7f7658074970 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- 172.21.15.39:0/2266200142 >> 172.21.15.39:0/2266200142 conn(0x7f76580fd8c0 msgr2=0x7f76580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- 172.21.15.39:0/2266200142 shutdown_connections 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- 172.21.15.39:0/2266200142 wait complete. 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 Processor -- start 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.371+0000 7f765fbae640 1 -- start start 2024-09-12T02:01:35.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658074590 0x7f76581a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 0x7f76581a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7658118610 con 0x7f7658112b90 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7658118490 con 0x7f7658074590 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7658118790 con 0x7f7658074eb0 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54732/0 (socket says 172.21.15.39:54732) 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 -- 172.21.15.39:0/1424503781 learned_addr learned my addr 172.21.15.39:0/1424503781 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765d94a640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658074590 0x7f76581a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765d149640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 0x7f76581a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 -- 172.21.15.39:0/1424503781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 msgr2=0x7f76581a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 0x7f76581a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 -- 172.21.15.39:0/1424503781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658074590 msgr2=0x7f76581a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658074590 0x7f76581a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 -- 172.21.15.39:0/1424503781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765819f070 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765e14b640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9d0 tx=0x7f765000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f764affd640 1 -- 172.21.15.39:0/1424503781 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000cd80 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765819f360 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f764affd640 1 -- 172.21.15.39:0/1424503781 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650005020 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.372+0000 7f764affd640 1 -- 172.21.15.39:0/1424503781 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76500116d0 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.373+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76581ab650 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f764affd640 1 -- 172.21.15.39:0/1424503781 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f76500051d0 con 0x7f7658112b90 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 Processor -- start 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 -- start start 2024-09-12T02:01:35.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57f9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5591a5751620 con 0x5591a57ec060 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5591a56f8e50 con 0x5591a57f7240 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f7661f87740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591a574d5e0 con 0x5591a57ec980 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54738/0 (socket says 172.21.15.39:54738) 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.375+0000 7f765d149640 1 -- 172.21.15.39:0/1707632599 learned_addr learned my addr 172.21.15.39:0/1707632599 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d94a640 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f764affd640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 0x7f76440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 -- 172.21.15.39:0/1707632599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 msgr2=0x5591a57f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 -- 172.21.15.39:0/1707632599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 msgr2=0x5591a57f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765e14b640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 0x7f76440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 -- 172.21.15.39:0/1707632599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a56e9d40 con 0x5591a57ec060 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f764affd640 1 -- 172.21.15.39:0/1424503781 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f76500cf620 con 0x7f7658112b90 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f765d149640 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f764c006e10 tx=0x7f764c00b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9963076403a156f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f7643fff640 1 -- 172.21.15.39:0/1707632599 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c014790 con 0x5591a57ec060 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f7643fff640 1 -- 172.21.15.39:0/1707632599 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c010040 con 0x5591a57ec060 2024-09-12T02:01:35.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.376+0000 7f7643fff640 1 -- 172.21.15.39:0/1707632599 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c018b30 con 0x5591a57ec060 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- 172.21.15.39:0/1707632599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 msgr2=0x5591a57ec440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f764c006e10 tx=0x7f764c00b1c0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f765e14b640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 0x7f76440a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76500982f0 tx=0x7f7650066fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- 172.21.15.39:0/1707632599 shutdown_connections 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 --2- 172.21.15.39:0/1707632599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ec440 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- 172.21.15.39:0/1707632599 >> 172.21.15.39:0/1707632599 conn(0x5591a57e85f0 msgr2=0x5591a57e89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- 172.21.15.39:0/1707632599 shutdown_connections 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- 172.21.15.39:0/1707632599 wait complete. 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.377+0000 7f7661f87740 1 -- start start 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 Processor -- start 2024-09-12T02:01:35.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57f7240 0x5591a57f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5591a57f9e10 con 0x5591a57ec060 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5591a56d9f10 con 0x5591a57ec980 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591a57f9f90 con 0x5591a57f7240 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f7661f87740 10 client.0 _ll_register_callbacks cb 0x5591a56fddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54740/0 (socket says 172.21.15.39:54740) 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 -- 172.21.15.39:0/3536747374 learned_addr learned my addr 172.21.15.39:0/3536747374 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57f7240 0x5591a57f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d94a640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 -- 172.21.15.39:0/3536747374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57f7240 msgr2=0x5591a57f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57f7240 0x5591a57f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 -- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 msgr2=0x5591a57f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d149640 1 -- 172.21.15.39:0/3536747374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a5460580 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.378+0000 7f765d94a640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f765d149640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f764c007fd0 tx=0x7f764c018810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e8324b4edb888d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c02c060 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f764c014590 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764c010040 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f764c014790 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f7661f87740 10 client.16455 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5591a552a960 con 0x5591a57ec060 2024-09-12T02:01:35.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c010040 con 0x5591a57ec060 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f764c019960 con 0x5591a57ec060 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f7661f87740 10 client.16455 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.379+0000 7f7661f87740 10 client.16455 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f7661f87740 20 client.16455 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5806db0 0x5591a58091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f7661f87740 4 client.16455 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a575eb90 con 0x5591a5806db0 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f765d94a640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5806db0 0x5591a58091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f765d94a640 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5806db0 0x5591a58091a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d875df8d637b75ed server_cookie=9d1665485e4fcd22 in_seq=0 out_seq=0 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.380+0000 7f76417fa640 10 client.16455 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f76417fa640 1 -- 172.21.15.39:0/3536747374 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591a575eb90 con 0x5591a5806db0 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f76417fa640 10 client.16455 handle_command_reply: tid=0 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 client.16455 shutdown 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 msgr2=0x5591a57f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f764c007fd0 tx=0x7f764c018810 comp rx=0 tx=0).stop 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 shutdown_connections 2024-09-12T02:01:35.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5806db0 0x5591a58091a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57f7240 0x5591a57f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f76417fa640 0 client.16455 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 --2- 172.21.15.39:0/3536747374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57f4190 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 >> 172.21.15.39:0/3536747374 conn(0x5591a57e85f0 msgr2=0x5591a57ee320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 shutdown_connections 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.381+0000 7f7661f87740 1 -- 172.21.15.39:0/3536747374 wait complete. 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.382+0000 7f7661f87740 20 client.16455 trim_cache size 0 max 16384 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.398+0000 7f7661f87740 1 Processor -- start 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.398+0000 7f7661f87740 1 -- start start 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec060 0x5591a57e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b6520 con 0x5591a57f7240 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b3d90 con 0x5591a57ec980 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f7661f87740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b1be0 con 0x5591a57ec060 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54750/0 (socket says 172.21.15.39:54750) 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 -- 172.21.15.39:0/4265855613 learned_addr learned my addr 172.21.15.39:0/4265855613 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d94a640 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 -- 172.21.15.39:0/4265855613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec060 msgr2=0x5591a57e89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec060 0x5591a57e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 -- 172.21.15.39:0/4265855613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 msgr2=0x5591a57f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 -- 172.21.15.39:0/4265855613 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a57f60d0 con 0x5591a57f7240 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d94a640 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f765d149640 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b200 tx=0x7f764c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb031896a486ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.399+0000 7f76437fe640 1 -- 172.21.15.39:0/4265855613 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c037070 con 0x5591a57f7240 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f76437fe640 1 -- 172.21.15.39:0/4265855613 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c00b310 con 0x5591a57f7240 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f76437fe640 1 -- 172.21.15.39:0/4265855613 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c02c070 con 0x5591a57f7240 2024-09-12T02:01:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 -- 172.21.15.39:0/4265855613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 msgr2=0x5591a57f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b200 tx=0x7f764c0047d0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 -- 172.21.15.39:0/4265855613 shutdown_connections 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57f7240 0x5591a57f4da0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57ec980 0x5591a57f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 --2- 172.21.15.39:0/4265855613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec060 0x5591a57e89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 -- 172.21.15.39:0/4265855613 >> 172.21.15.39:0/4265855613 conn(0x5591a57e85f0 msgr2=0x5591a57f4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 -- 172.21.15.39:0/4265855613 shutdown_connections 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.400+0000 7f7661f87740 1 -- 172.21.15.39:0/4265855613 wait complete. 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 -- start start 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 Processor -- start 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57fc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b2250 con 0x5591a57ec060 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b36c0 con 0x5591a57f7240 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76581b2920 con 0x5591a57ec980 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f7661f87740 10 client.0 _ll_register_callbacks cb 0x7f764c0164a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f765d149640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54760/0 (socket says 172.21.15.39:54760) 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.401+0000 7f765d149640 1 -- 172.21.15.39:0/1356221846 learned_addr learned my addr 172.21.15.39:0/1356221846 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d94a640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 -- 172.21.15.39:0/1356221846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 msgr2=0x5591a57ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57ff6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 -- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 msgr2=0x5591a57fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57fc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 -- 172.21.15.39:0/1356221846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a57ef010 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f765d149640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f764c016570 tx=0x7f764c01af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af8b512b08e84d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f76417fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c040060 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f764c005bd0 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764c00b310 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f764c02c030 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f7661f87740 10 client.16461 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5591a5871cc0 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.402+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c00b310 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f764c010070 con 0x5591a57ec060 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 10 client.16461 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 10 client.16461 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:01:35.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 20 client.16461 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5872320 0x5591a5874710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 4 client.16461 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "202ece11", "release": true, "await": true}] 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "set_id": "202ece11", "release": true, "await": true}) -- 0x5591a57590a0 con 0x5591a5872320 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f765d94a640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5872320 0x5591a5874710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f765d94a640 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5872320 0x5591a5874710 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=936975ac13b56a78 server_cookie=ef05ae29ffc79d74 in_seq=0 out_seq=0 2024-09-12T02:01:35.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.403+0000 7f76417fa640 10 client.16461 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:35.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:34 smithi044 ceph-mon[35259]: pgmap v478: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T02:01:35.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.522+0000 7f76417fa640 1 -- 172.21.15.39:0/1356221846 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5591a57590a0 con 0x5591a5872320 2024-09-12T02:01:35.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.522+0000 7f76417fa640 10 client.16461 handle_command_reply: tid=0 2024-09-12T02:01:35.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 client.16461 shutdown 2024-09-12T02:01:35.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 msgr2=0x5591a57ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f764c016570 tx=0x7f764c01af80 comp rx=0 tx=0).stop 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 shutdown_connections 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5591a5872320 0x5591a5874710 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591a57f7240 0x5591a57fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591a57ec980 0x5591a57ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f76417fa640 0 client.16461 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 --2- 172.21.15.39:0/1356221846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5591a57ec060 0x5591a57ff1b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 >> 172.21.15.39:0/1356221846 conn(0x5591a57e85f0 msgr2=0x5591a57f4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 shutdown_connections 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 1 -- 172.21.15.39:0/1356221846 wait complete. 2024-09-12T02:01:35.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.523+0000 7f7661f87740 20 client.16461 trim_cache size 0 max 16384 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 31, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 20, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": { 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "202ece11": { 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "version": 20, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "age_ref": 0.0, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:01:35.525 INFO:teuthology.orchestra.run.smithi039.stdout: "timeout": 90.0, 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "expiration": 140.2, 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "members": { 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "file:/": { 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "excluded": false, 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "state": { 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RELEASED", 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: "age": 0.0 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:35.526 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:35.527 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:35.527 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:01:35.527 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:01:35.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 msgr2=0x7f76440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 0x7f76440a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76500982f0 tx=0x7f7650066fb0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 msgr2=0x7f765819e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9d0 tx=0x7f765000ee90 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 shutdown_connections 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7658112b90 0x7f765819e940 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f76440a2b80 0x7f76440a5040 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7658074eb0 0x7f76581a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 --2- 172.21.15.39:0/1424503781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7658074590 0x7f76581a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 >> 172.21.15.39:0/1424503781 conn(0x7f76580fd8c0 msgr2=0x7f76580ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 shutdown_connections 2024-09-12T02:01:35.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:01:35.524+0000 7f765fbae640 1 -- 172.21.15.39:0/1424503781 wait complete. 2024-09-12T02:01:35.543 INFO:tasks.workunit.client.0.smithi039.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-12T02:01:35.543 INFO:tasks.workunit.client.0.smithi039.stdout:All 50000 operations completed A-OK! 2024-09-12T02:01:35.547 INFO:tasks.workunit.client.0.smithi039.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-12T02:01:35.550 INFO:tasks.workunit.client.0.smithi039.stdout:Seed set to 1 2024-09-12T02:01:36.581 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '202ece11', total seconds elapsed: 23.9 2024-09-12T02:01:36.745 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-12T02:01:36.746 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-12T02:01:36.749 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-12T02:01:36.749 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-12T02:01:36.749 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support clone range, disabling! 2024-09-12T02:01:36.753 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-12T02:01:36.757 INFO:tasks.workunit.client.0.smithi039.stderr:main: filesystem does not support exchange range, disabling! 2024-09-12T02:01:36.757 INFO:tasks.workunit.client.0.smithi039.stdout:skipping zero size read 2024-09-12T02:01:36.770 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x1c37b90 2024-09-12T02:01:36.778 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x5bd330d 2024-09-12T02:01:36.794 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x637bf99 2024-09-12T02:01:36.963 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x63d9b9c 2024-09-12T02:01:37.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:36 smithi172 ceph-mon[35073]: pgmap v479: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-12T02:01:37.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:36 smithi039 ceph-mon[31204]: pgmap v479: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-12T02:01:37.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:36 smithi044 ceph-mon[35259]: pgmap v479: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-12T02:01:39.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:38 smithi172 ceph-mon[35073]: pgmap v480: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-12T02:01:39.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:38 smithi039 ceph-mon[31204]: pgmap v480: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-12T02:01:39.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:38 smithi044 ceph-mon[35259]: pgmap v480: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 -- 172.21.15.39:0/1965630497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec102630 msgr2=0x7f9fec104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1965630497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec102630 0x7f9fec104a20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009900 tx=0x7f9fe002a410 comp rx=0 tx=0).stop 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 -- 172.21.15.39:0/1965630497 shutdown_connections 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1965630497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec107890 0x7f9fec109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1965630497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec104f60 0x7f9fec107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1965630497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec102630 0x7f9fec104a20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 -- 172.21.15.39:0/1965630497 >> 172.21.15.39:0/1965630497 conn(0x7f9fec0fc1b0 msgr2=0x7f9fec0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 -- 172.21.15.39:0/1965630497 shutdown_connections 2024-09-12T02:01:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.563+0000 7f9ff308d640 1 -- 172.21.15.39:0/1965630497 wait complete. 2024-09-12T02:01:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.564+0000 7f9ff308d640 1 Processor -- start 2024-09-12T02:01:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.564+0000 7f9ff308d640 1 -- start start 2024-09-12T02:01:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 0x7f9fec197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 0x7f9fec198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10d880 con 0x7f9fec107890 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10d700 con 0x7f9fec102630 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff308d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10da00 con 0x7f9fec104f60 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff162a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 0x7f9fec197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 0x7f9fec198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff162a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54782/0 (socket says 172.21.15.39:54782) 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 0x7f9fec197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:34934/0 (socket says 172.21.15.39:34934) 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff162a640 1 -- 172.21.15.39:0/1482643648 learned_addr learned my addr 172.21.15.39:0/1482643648 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 -- 172.21.15.39:0/1482643648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 msgr2=0x7f9fec197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 0x7f9fec197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 -- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 msgr2=0x7f9fec19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 -- 172.21.15.39:0/1482643648 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec19fa40 con 0x7f9fec104f60 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9ff162a640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.565+0000 7f9febfff640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 0x7f9fec198360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e9c0 tx=0x7f9fd800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.566+0000 7f9fe9ffb640 1 -- 172.21.15.39:0/1482643648 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800ccc0 con 0x7f9fec104f60 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.566+0000 7f9fe9ffb640 1 -- 172.21.15.39:0/1482643648 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd8010910 con 0x7f9fec104f60 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.566+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec19fd30 con 0x7f9fec104f60 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.566+0000 7f9fe9ffb640 1 -- 172.21.15.39:0/1482643648 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80188c0 con 0x7f9fec104f60 2024-09-12T02:01:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.566+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec1a0270 con 0x7f9fec104f60 2024-09-12T02:01:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.568+0000 7f9fe9ffb640 1 -- 172.21.15.39:0/1482643648 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9fd8010ac0 con 0x7f9fec104f60 2024-09-12T02:01:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 Processor -- start 2024-09-12T02:01:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 -- start start 2024-09-12T02:01:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c119a0 0x560262c11da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c19830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560262b752f0 con 0x560262c119a0 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560262b1d270 con 0x560262c122e0 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560262b712b0 con 0x560262c17370 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:34942/0 (socket says 172.21.15.39:34942) 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2166504197 learned_addr learned my addr 172.21.15.39:0/2166504197 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9ff162a640 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c119a0 0x560262c11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.569+0000 7f9febfff640 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c19830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2166504197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 msgr2=0x560262c19830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c19830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2166504197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c119a0 msgr2=0x560262c11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c119a0 0x560262c11da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9fe9ffb640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 0x7f9fdc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2166504197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560262b1c340 con 0x560262c122e0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff162a640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 0x7f9fdc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9fe9ffb640 1 -- 172.21.15.39:0/1482643648 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9fd80cf2f0 con 0x7f9fec104f60 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0000c00 tx=0x7f9fe0004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e00c62431a5517 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9fd6ffd640 1 -- 172.21.15.39:0/2166504197 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0035040 con 0x560262c122e0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9fd6ffd640 1 -- 172.21.15.39:0/2166504197 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0004430 con 0x560262c122e0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.570+0000 7f9fd6ffd640 1 -- 172.21.15.39:0/2166504197 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00316b0 con 0x560262c122e0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2166504197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 msgr2=0x560262c16da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff162a640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 0x7f9fdc0a5170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4003ed0 tx=0x7f9fe4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0000c00 tx=0x7f9fe0004040 comp rx=0 tx=0).stop 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2166504197 shutdown_connections 2024-09-12T02:01:39.574 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c19830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c16da0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2166504197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c119a0 0x560262c11da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2166504197 >> 172.21.15.39:0/2166504197 conn(0x560262c0d010 msgr2=0x560262c0d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2166504197 shutdown_connections 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2166504197 wait complete. 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.571+0000 7f9ff5e27740 1 -- start start 2024-09-12T02:01:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 Processor -- start 2024-09-12T02:01:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c1c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c23100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x560262c1a2e0 con 0x560262c122e0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560262afe290 con 0x560262c119a0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560262c1a460 con 0x560262c17370 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff5e27740 10 client.0 _ll_register_callbacks cb 0x560262b2f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9febfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c1c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff0e29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:34956/0 (socket says 172.21.15.39:34956) 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2695142492 learned_addr learned my addr 172.21.15.39:0/2695142492 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.572+0000 7f9ff162a640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c23100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2695142492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 msgr2=0x560262c23100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c23100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2695142492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 msgr2=0x560262c1c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c1c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 -- 172.21.15.39:0/2695142492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560262888210 con 0x560262c119a0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9febfff640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c1c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0031440 tx=0x7f9fe0005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d23c26818fe166 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9fcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0035070 con 0x560262c119a0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9fe00318c0 con 0x560262c119a0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe0004430 con 0x560262c119a0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9fe0031ac0 con 0x560262c119a0 2024-09-12T02:01:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff5e27740 10 client.26021 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.573+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560262954620 con 0x560262c119a0 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0004430 con 0x560262c119a0 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9fe0004d40 con 0x560262c119a0 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 10 client.26021 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 20 client.26021 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c27400 0x560262c297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 4 client.26021 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.574+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560262b82a20 con 0x560262c27400 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.575+0000 7f9febfff640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c27400 0x560262c297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.575+0000 7f9febfff640 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c27400 0x560262c297f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a87d22fcc06d47 server_cookie=35684fcad0fcabc3 in_seq=0 out_seq=0 2024-09-12T02:01:39.580 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.575+0000 7f9fcbfff640 10 client.26021 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.578+0000 7f9fcbfff640 1 -- 172.21.15.39:0/2695142492 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560262b82a20 con 0x560262c27400 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.578+0000 7f9fcbfff640 10 client.26021 handle_command_reply: tid=0 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.578+0000 7f9ff5e27740 1 client.26021 shutdown 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 msgr2=0x560262c1bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0031440 tx=0x7f9fe0005e70 comp rx=0 tx=0).stop 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 shutdown_connections 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c27400 0x560262c297f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c17370 0x560262c23100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c1c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9fcbfff640 0 client.26021 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/2695142492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c119a0 0x560262c1bbf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 >> 172.21.15.39:0/2695142492 conn(0x560262c0d010 msgr2=0x560262c0e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 shutdown_connections 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 1 -- 172.21.15.39:0/2695142492 wait complete. 2024-09-12T02:01:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.579+0000 7f9ff5e27740 20 client.26021 trim_cache size 0 max 16384 2024-09-12T02:01:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.598+0000 7f9ff5e27740 1 Processor -- start 2024-09-12T02:01:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.598+0000 7f9ff5e27740 1 -- start start 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c1c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 0x560262c2e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a95e0 con 0x560262c17370 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a6e50 con 0x560262c122e0 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a4ca0 con 0x560262c119a0 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff162a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 0x560262c2e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff162a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 0x560262c2e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54810/0 (socket says 172.21.15.39:54810) 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff162a640 1 -- 172.21.15.39:0/4213193051 learned_addr learned my addr 172.21.15.39:0/4213193051 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c1c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 -- 172.21.15.39:0/4213193051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 msgr2=0x560262c1c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c1c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 -- 172.21.15.39:0/4213193051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 msgr2=0x560262c2e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 0x560262c2e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9febfff640 1 -- 172.21.15.39:0/4213193051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560262c115e0 con 0x560262c122e0 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.599+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9febfff640 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c230c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80cce50 tx=0x7f9fd800efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c51f3d9df7c9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9fd67fc640 1 -- 172.21.15.39:0/4213193051 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd809ff10 con 0x560262c122e0 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9fd67fc640 1 -- 172.21.15.39:0/4213193051 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80a47d0 con 0x560262c122e0 2024-09-12T02:01:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9fd67fc640 1 -- 172.21.15.39:0/4213193051 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd809b2c0 con 0x560262c122e0 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9ff5e27740 1 -- 172.21.15.39:0/4213193051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 msgr2=0x560262c230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.600+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c230c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80cce50 tx=0x7f9fd800efb0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 -- 172.21.15.39:0/4213193051 shutdown_connections 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c17370 0x560262c2e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c122e0 0x560262c230c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/4213193051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 -- 172.21.15.39:0/4213193051 >> 172.21.15.39:0/4213193051 conn(0x560262c0d010 msgr2=0x560262c0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 -- 172.21.15.39:0/4213193051 shutdown_connections 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 -- 172.21.15.39:0/4213193051 wait complete. 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 -- start start 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.601+0000 7f9ff5e27740 1 Processor -- start 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c20a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c17370 0x560262c21e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a5310 con 0x560262c122e0 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a6780 con 0x560262c17370 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1a59e0 con 0x560262c119a0 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff5e27740 10 client.0 _ll_register_callbacks cb 0x7f9fe0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54818/0 (socket says 172.21.15.39:54818) 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff162a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c17370 0x560262c21e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 -- 172.21.15.39:0/3446666110 learned_addr learned my addr 172.21.15.39:0/3446666110 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 -- 172.21.15.39:0/3446666110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 msgr2=0x560262c20a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c20a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 -- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c17370 msgr2=0x560262c21e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c17370 0x560262c21e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 -- 172.21.15.39:0/3446666110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560262c224a0 con 0x560262c122e0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9febfff640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c6a0 tx=0x7f9fd809ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42c635a2baf8233 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.602+0000 7f9fcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8099f10 con 0x560262c122e0 2024-09-12T02:01:39.607 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f9fd8010430 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd80a47d0 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9fd8010630 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9ff5e27740 10 client.16479 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560262c9a9a0 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.603+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80a47d0 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9fd809ac60 con 0x560262c122e0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 10 client.16479 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 20 client.16479 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c9b3b0 0x560262c9d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 4 client.16479 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560262b7cd70 con 0x560262c9b3b0 2024-09-12T02:01:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c9b3b0 0x560262c9d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9fcbfff640 10 client.16479 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.604+0000 7f9ff0e29640 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c9b3b0 0x560262c9d7d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f570644f7852fe server_cookie=8e3793018c4ca05b in_seq=0 out_seq=0 2024-09-12T02:01:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9fcbfff640 1 -- 172.21.15.39:0/3446666110 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560262b7cd70 con 0x560262c9b3b0 2024-09-12T02:01:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9fcbfff640 10 client.16479 handle_command_reply: tid=0 2024-09-12T02:01:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 client.16479 shutdown 2024-09-12T02:01:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 msgr2=0x560262c20f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c6a0 tx=0x7f9fd809ff10 comp rx=0 tx=0).stop 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 shutdown_connections 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x560262c9b3b0 0x560262c9d7d0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560262c17370 0x560262c21e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x560262c122e0 0x560262c20f40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 --2- 172.21.15.39:0/3446666110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560262c119a0 0x560262c20a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 >> 172.21.15.39:0/3446666110 conn(0x560262c0d010 msgr2=0x560262c0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9fcbfff640 0 client.16479 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 shutdown_connections 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.616+0000 7f9ff5e27740 1 -- 172.21.15.39:0/3446666110 wait complete. 2024-09-12T02:01:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.617+0000 7f9ff5e27740 20 client.16479 trim_cache size 0 max 16384 2024-09-12T02:01:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:01:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:01:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:01:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:01:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.617+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 msgr2=0x7f9fdc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.617+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 0x7f9fdc0a5170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4003ed0 tx=0x7f9fe4009500 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.617+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 msgr2=0x7f9fec198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.617+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 0x7f9fec198360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e9c0 tx=0x7f9fd800ee80 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 shutdown_connections 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fec107890 0x7f9fec19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f9fdc0a2cb0 0x7f9fdc0a5170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fec104f60 0x7f9fec198360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 --2- 172.21.15.39:0/1482643648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fec102630 0x7f9fec197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 >> 172.21.15.39:0/1482643648 conn(0x7f9fec0fc1b0 msgr2=0x7f9fec102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 shutdown_connections 2024-09-12T02:01:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:39.618+0000 7f9ff308d640 1 -- 172.21.15.39:0/1482643648 wait complete. 2024-09-12T02:01:41.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:41 smithi172 ceph-mon[35073]: pgmap v481: 97 pgs: 97 active+clean; 61 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 207 KiB/s wr, 81 op/s 2024-09-12T02:01:41.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:41 smithi039 ceph-mon[31204]: pgmap v481: 97 pgs: 97 active+clean; 61 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 207 KiB/s wr, 81 op/s 2024-09-12T02:01:41.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:41 smithi044 ceph-mon[35259]: pgmap v481: 97 pgs: 97 active+clean; 61 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 207 KiB/s wr, 81 op/s 2024-09-12T02:01:43.253 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:43 smithi172 ceph-mon[35073]: pgmap v482: 97 pgs: 97 active+clean; 60 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 353 KiB/s wr, 143 op/s 2024-09-12T02:01:43.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:43 smithi039 ceph-mon[31204]: pgmap v482: 97 pgs: 97 active+clean; 60 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 353 KiB/s wr, 143 op/s 2024-09-12T02:01:43.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:43 smithi044 ceph-mon[35259]: pgmap v482: 97 pgs: 97 active+clean; 60 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 353 KiB/s wr, 143 op/s 2024-09-12T02:01:45.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:45 smithi039 ceph-mon[31204]: pgmap v483: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.1 MiB/s wr, 455 op/s 2024-09-12T02:01:45.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:45 smithi044 ceph-mon[35259]: pgmap v483: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.1 MiB/s wr, 455 op/s 2024-09-12T02:01:45.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:45 smithi172 ceph-mon[35073]: pgmap v483: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.1 MiB/s wr, 455 op/s 2024-09-12T02:01:46.607 INFO:tasks.workunit.client.0.smithi039.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-12T02:01:47.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:47 smithi039 ceph-mon[31204]: pgmap v484: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 582 op/s 2024-09-12T02:01:47.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:47 smithi044 ceph-mon[35259]: pgmap v484: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 582 op/s 2024-09-12T02:01:47.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:47 smithi172 ceph-mon[35073]: pgmap v484: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 582 op/s 2024-09-12T02:01:49.304 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:49 smithi172 ceph-mon[35073]: pgmap v485: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 775 op/s 2024-09-12T02:01:49.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:49 smithi039 ceph-mon[31204]: pgmap v485: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 775 op/s 2024-09-12T02:01:49.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:49 smithi044 ceph-mon[35259]: pgmap v485: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 775 op/s 2024-09-12T02:01:51.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:51 smithi039 ceph-mon[31204]: pgmap v486: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.00k op/s 2024-09-12T02:01:51.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:51 smithi044 ceph-mon[35259]: pgmap v486: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.00k op/s 2024-09-12T02:01:51.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:51 smithi172 ceph-mon[35073]: pgmap v486: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.00k op/s 2024-09-12T02:01:52.631 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x63e5d2a 2024-09-12T02:01:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1243380996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 msgr2=0x7f41bc102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1243380996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc102100 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009900 tx=0x7f41a402a480 comp rx=0 tx=0).stop 2024-09-12T02:01:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1243380996 shutdown_connections 2024-09-12T02:01:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1243380996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1243380996 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc102100 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1243380996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1243380996 >> 172.21.15.39:0/1243380996 conn(0x7f41bc0fb930 msgr2=0x7f41bc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1243380996 shutdown_connections 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.725+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1243380996 wait complete. 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 Processor -- start 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 -- start start 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10d830 con 0x7f41bc101c80 2024-09-12T02:01:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10d6b0 con 0x7f41bc100f70 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41c0c7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc10d9b0 con 0x7f41bc102640 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45394/0 (socket says 172.21.15.39:45394) 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41b9d9b640 1 -- 172.21.15.39:0/1251018053 learned_addr learned my addr 172.21.15.39:0/1251018053 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.726+0000 7f41bad9d640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 -- 172.21.15.39:0/1251018053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 msgr2=0x7f41bc19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 -- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 msgr2=0x7f41bc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 -- 172.21.15.39:0/1251018053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc19fa00 con 0x7f41bc100f70 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41bad9d640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc197de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41bc069410 tx=0x7f41ac00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41b37fe640 1 -- 172.21.15.39:0/1251018053 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac017070 con 0x7f41bc100f70 2024-09-12T02:01:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc19fcf0 con 0x7f41bc100f70 2024-09-12T02:01:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41b37fe640 1 -- 172.21.15.39:0/1251018053 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41ac009c30 con 0x7f41bc100f70 2024-09-12T02:01:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41b37fe640 1 -- 172.21.15.39:0/1251018053 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00f620 con 0x7f41bc100f70 2024-09-12T02:01:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.727+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc1a01c0 con 0x7f41bc100f70 2024-09-12T02:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 Processor -- start 2024-09-12T02:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 -- start start 2024-09-12T02:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41b37fe640 1 -- 172.21.15.39:0/1251018053 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f41ac01a070 con 0x7f41bc100f70 2024-09-12T02:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 0x5620d181c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 0x5620d1823c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5620d177b2f0 con 0x5620d181bdb0 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5620d1723270 con 0x5620d181c6f0 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.730+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620d17772b0 con 0x5620d1821780 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41bad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 0x5620d181c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41bad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 0x5620d181c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45396/0 (socket says 172.21.15.39:45396) 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59746/0 (socket says 172.21.15.39:59746) 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41bad9d640 1 -- 172.21.15.39:0/1428857035 learned_addr learned my addr 172.21.15.39:0/1428857035 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 0x5620d1823c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 -- 172.21.15.39:0/1428857035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 msgr2=0x5620d1823c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 0x5620d1823c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 -- 172.21.15.39:0/1428857035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 msgr2=0x5620d181c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 0x5620d181c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 -- 172.21.15.39:0/1428857035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d1722340 con 0x5620d181c6f0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 0x5620d1823c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0cc480 tx=0x7f41ac0d4bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf8248b9071a698 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b0ff9640 1 -- 172.21.15.39:0/1428857035 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0d6a70 con 0x5620d181c6f0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b0ff9640 1 -- 172.21.15.39:0/1428857035 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41ac0da070 con 0x5620d181c6f0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b37fe640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 0x7f41a80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.731+0000 7f41b0ff9640 1 -- 172.21.15.39:0/1428857035 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0dda50 con 0x5620d181c6f0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41bad9d640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 0x7f41a80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41b37fe640 1 -- 172.21.15.39:0/1251018053 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f41ac0ce9a0 con 0x7f41bc100f70 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41bad9d640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 0x7f41a80a50f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009fd0 tx=0x7f41b4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1428857035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 msgr2=0x5620d18211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0cc480 tx=0x7f41ac0d4bb0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1428857035 shutdown_connections 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d1821780 0x5620d1823c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d18211b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1428857035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181bdb0 0x5620d181c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1428857035 >> 172.21.15.39:0/1428857035 conn(0x5620d1813010 msgr2=0x5620d1813410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1428857035 shutdown_connections 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.732+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1428857035 wait complete. 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 -- start start 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 Processor -- start 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d181f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1820330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5620d1817880 con 0x5620d181c6f0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5620d1704290 con 0x5620d1821780 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620d1817a00 con 0x5620d181bdb0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41c3a1a740 10 client.0 _ll_register_callbacks cb 0x5620d1735140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:39898/0 (socket says 172.21.15.39:39898) 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d181f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41ba59c640 1 -- 172.21.15.39:0/2934530853 learned_addr learned my addr 172.21.15.39:0/2934530853 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.733+0000 7f41bad9d640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1820330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 -- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 msgr2=0x5620d1820330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1820330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 -- 172.21.15.39:0/2934530853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 msgr2=0x5620d181f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d181f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 -- 172.21.15.39:0/2934530853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d148e210 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41ba59c640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41ac09af10 tx=0x7f41ac0d4fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50901ae1876a82eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0974b0 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f41ac097880 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41ac0da070 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f41ac0b4050 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41c3a1a740 10 client.25864 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5620d155a620 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.734+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41ac0da070 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f41ac0bb0b0 con 0x5620d181bdb0 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 10 client.25864 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 10 client.25864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 20 client.25864 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d182d490 0x5620d182f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 4 client.25864 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d1788a20 con 0x5620d182d490 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d182d490 0x5620d182f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d182d490 0x5620d182f880 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5d5a2e5e21f9031 server_cookie=7ebbd00ebdc6f11 in_seq=0 out_seq=0 2024-09-12T02:01:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.735+0000 7f41a1ffb640 10 client.25864 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41a1ffb640 1 -- 172.21.15.39:0/2934530853 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620d1788a20 con 0x5620d182d490 2024-09-12T02:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41a1ffb640 10 client.25864 handle_command_reply: tid=0 2024-09-12T02:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 client.25864 shutdown 2024-09-12T02:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 msgr2=0x5620d181ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f41ac09af10 tx=0x7f41ac0d4fb0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 shutdown_connections 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d182d490 0x5620d182f880 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1820330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d181f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41a1ffb640 0 client.25864 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/2934530853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d181ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 >> 172.21.15.39:0/2934530853 conn(0x5620d1813010 msgr2=0x5620d1814820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 shutdown_connections 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 1 -- 172.21.15.39:0/2934530853 wait complete. 2024-09-12T02:01:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.736+0000 7f41c3a1a740 20 client.25864 trim_cache size 0 max 16384 2024-09-12T02:01:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 Processor -- start 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 -- start start 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1814400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 0x5620d1834030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a9620 con 0x5620d1821780 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a6e90 con 0x5620d181c6f0 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a4ce0 con 0x5620d181bdb0 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41bad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 0x5620d1834030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1814400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59768/0 (socket says 172.21.15.39:59768) 2024-09-12T02:01:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 -- 172.21.15.39:0/1251221760 learned_addr learned my addr 172.21.15.39:0/1251221760 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 -- 172.21.15.39:0/1251221760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 msgr2=0x5620d1814400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1814400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 -- 172.21.15.39:0/1251221760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 msgr2=0x5620d1834030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 0x5620d1834030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41b9d9b640 1 -- 172.21.15.39:0/1251221760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d182fbf0 con 0x5620d181c6f0 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41ba59c640 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1814400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.753+0000 7f41bad9d640 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 0x5620d1834030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.754+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009230 tx=0x7f41a4031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf74c60399181abc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.754+0000 7f41a3fff640 1 -- 172.21.15.39:0/1251221760 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4035040 con 0x5620d181c6f0 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.754+0000 7f41a3fff640 1 -- 172.21.15.39:0/1251221760 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41a4005520 con 0x5620d181c6f0 2024-09-12T02:01:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.754+0000 7f41a3fff640 1 -- 172.21.15.39:0/1251221760 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4004e30 con 0x5620d181c6f0 2024-09-12T02:01:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1251221760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 msgr2=0x5620d1814940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009230 tx=0x7f41a4031b60 comp rx=0 tx=0).stop 2024-09-12T02:01:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1251221760 shutdown_connections 2024-09-12T02:01:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d1821780 0x5620d1834030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d181c6f0 0x5620d1814940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/1251221760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1814400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1251221760 >> 172.21.15.39:0/1251221760 conn(0x5620d1813010 msgr2=0x5620d18121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.755+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1251221760 shutdown_connections 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.756+0000 7f41c3a1a740 1 -- 172.21.15.39:0/1251221760 wait complete. 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.756+0000 7f41c3a1a740 1 -- start start 2024-09-12T02:01:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 Processor -- start 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1827a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1828fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a5350 con 0x5620d181c6f0 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a67c0 con 0x5620d1821780 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc1a5a20 con 0x5620d181bdb0 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.757+0000 7f41c3a1a740 10 client.0 _ll_register_callbacks cb 0x7f41b4009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:01:52.761 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45426/0 (socket says 172.21.15.39:45426) 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41b9d9b640 1 -- 172.21.15.39:0/696235517 learned_addr learned my addr 172.21.15.39:0/696235517 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1827a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41bad9d640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1828fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 -- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 msgr2=0x5620d1828fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1828fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 -- 172.21.15.39:0/696235517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 msgr2=0x5620d1827fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 -- 172.21.15.39:0/696235517 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d18295f0 con 0x5620d181bdb0 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41bad9d640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1828fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:01:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41ba59c640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1827a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41ac097670 tx=0x7f41ac099720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f796e2dbc7bc53c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.758+0000 7f41a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0b8060 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f41ac0a3bf0 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41a4005520 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f41ac09ab70 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 10 client.25870 fetch_fsmap learned FSMap version 31 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5620d18a9110 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41a4005520 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f41ac09b470 con 0x5620d181bdb0 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 10 client.25870 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 20 client.25870 populate_metadata read hostname 'smithi039' 2024-09-12T02:01:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d18a98d0 0x5620d18abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 4 client.25870 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.759+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620d1782d70 con 0x5620d18a98d0 2024-09-12T02:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.760+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d18a98d0 0x5620d18abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.760+0000 7f41b9d9b640 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d18a98d0 0x5620d18abcf0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f95244072d5767 server_cookie=6153dd420c786728 in_seq=0 out_seq=0 2024-09-12T02:01:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.760+0000 7f41a1ffb640 10 client.25870 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41a1ffb640 1 -- 172.21.15.39:0/696235517 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620d1782d70 con 0x5620d18a98d0 2024-09-12T02:01:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41a1ffb640 10 client.25870 handle_command_reply: tid=0 2024-09-12T02:01:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 client.25870 shutdown 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 msgr2=0x5620d1827a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1827a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41ac097670 tx=0x7f41ac099720 comp rx=0 tx=0).stop 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 shutdown_connections 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5620d18a98d0 0x5620d18abcf0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620d1821780 0x5620d1828fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5620d181c6f0 0x5620d1827fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 --2- 172.21.15.39:0/696235517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620d181bdb0 0x5620d1827a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 >> 172.21.15.39:0/696235517 conn(0x5620d1813010 msgr2=0x5620d18133f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41a1ffb640 0 client.25870 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 shutdown_connections 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 1 -- 172.21.15.39:0/696235517 wait complete. 2024-09-12T02:01:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.774+0000 7f41c3a1a740 20 client.25870 trim_cache size 0 max 16384 2024-09-12T02:01:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:01:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:01:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:01:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 msgr2=0x7f41a80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 0x7f41a80a50f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009fd0 tx=0x7f41b4009500 comp rx=0 tx=0).stop 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 msgr2=0x7f41bc197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc197de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41bc069410 tx=0x7f41ac00dde0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 shutdown_connections 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f41a80a2c30 0x7f41a80a50f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41bc102640 0x7f41bc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41bc101c80 0x7f41bc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 --2- 172.21.15.39:0/1251018053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41bc100f70 0x7f41bc197de0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:01:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 >> 172.21.15.39:0/1251018053 conn(0x7f41bc0fb930 msgr2=0x7f41bc104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:01:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 shutdown_connections 2024-09-12T02:01:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:01:52.775+0000 7f41c0c7b640 1 -- 172.21.15.39:0/1251018053 wait complete. 2024-09-12T02:01:53.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:53 smithi039 ceph-mon[31204]: pgmap v487: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 1.02k op/s 2024-09-12T02:01:53.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:53 smithi044 ceph-mon[35259]: pgmap v487: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 1.02k op/s 2024-09-12T02:01:53.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:53 smithi172 ceph-mon[35073]: pgmap v487: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.6 MiB/s wr, 1.02k op/s 2024-09-12T02:01:54.875 INFO:tasks.workunit.client.0.smithi039.stdout:truncating to largest ever: 0x63e9b52 2024-09-12T02:01:55.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:55 smithi039 ceph-mon[31204]: pgmap v488: 97 pgs: 97 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.27k op/s 2024-09-12T02:01:55.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:55 smithi044 ceph-mon[35259]: pgmap v488: 97 pgs: 97 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.27k op/s 2024-09-12T02:01:55.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:55 smithi172 ceph-mon[35073]: pgmap v488: 97 pgs: 97 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.3 MiB/s wr, 1.27k op/s 2024-09-12T02:01:56.654 INFO:tasks.workunit.client.0.smithi039.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-12T02:01:57.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:57 smithi039 ceph-mon[31204]: pgmap v489: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:01:57.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:57 smithi044 ceph-mon[35259]: pgmap v489: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:01:57.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:57 smithi172 ceph-mon[35073]: pgmap v489: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:01:58.355 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x63ed6b9 2024-09-12T02:01:59.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:01:59 smithi039 ceph-mon[31204]: pgmap v490: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:01:59.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:01:59 smithi044 ceph-mon[35259]: pgmap v490: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:01:59.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:01:59 smithi172 ceph-mon[35073]: pgmap v490: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:02:01.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:01 smithi039 ceph-mon[31204]: pgmap v491: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 1.18k op/s 2024-09-12T02:02:01.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:01 smithi044 ceph-mon[35259]: pgmap v491: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 1.18k op/s 2024-09-12T02:02:01.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:01 smithi172 ceph-mon[35073]: pgmap v491: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.1 MiB/s wr, 1.18k op/s 2024-09-12T02:02:03.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:03 smithi039 ceph-mon[31204]: pgmap v492: 97 pgs: 97 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 1.03k op/s 2024-09-12T02:02:03.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:03 smithi044 ceph-mon[35259]: pgmap v492: 97 pgs: 97 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 1.03k op/s 2024-09-12T02:02:03.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:03 smithi172 ceph-mon[35073]: pgmap v492: 97 pgs: 97 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.6 MiB/s wr, 1.03k op/s 2024-09-12T02:02:05.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:05 smithi039 ceph-mon[31204]: pgmap v493: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.24k op/s 2024-09-12T02:02:05.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:05 smithi044 ceph-mon[35259]: pgmap v493: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.24k op/s 2024-09-12T02:02:05.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:05 smithi172 ceph-mon[35073]: pgmap v493: 97 pgs: 97 active+clean; 65 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 1.24k op/s 2024-09-12T02:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 -- 172.21.15.39:0/236110118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102600 msgr2=0x7ff95c108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 --2- 172.21.15.39:0/236110118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102600 0x7ff95c108e90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ca0 tx=0x7ff95402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 -- 172.21.15.39:0/236110118 shutdown_connections 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 --2- 172.21.15.39:0/236110118 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c102600 0x7ff95c108e90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 --2- 172.21.15.39:0/236110118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c101c40 0x7ff95c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 --2- 172.21.15.39:0/236110118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 0x7ff95c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 -- 172.21.15.39:0/236110118 >> 172.21.15.39:0/236110118 conn(0x7ff95c0fc1b0 msgr2=0x7ff95c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 -- 172.21.15.39:0/236110118 shutdown_connections 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 -- 172.21.15.39:0/236110118 wait complete. 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.886+0000 7ff96131f640 1 Processor -- start 2024-09-12T02:02:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 -- start start 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 0x7ff95c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 0x7ff95c19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c10c6d0 con 0x7ff95c101c40 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c10c550 con 0x7ff95c102600 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff96131f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c10c850 con 0x7ff95c100a50 2024-09-12T02:02:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45554/0 (socket says 172.21.15.39:45554) 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 -- 172.21.15.39:0/539588307 learned_addr learned my addr 172.21.15.39:0/539588307 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 0x7ff95c19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95affd640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 0x7ff95c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 -- 172.21.15.39:0/539588307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 msgr2=0x7ff95c197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 0x7ff95c197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 -- 172.21.15.39:0/539588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 msgr2=0x7ff95c19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 0x7ff95c19f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95a7fc640 1 -- 172.21.15.39:0/539588307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95c19f9e0 con 0x7ff95c101c40 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.887+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 0x7ff95c19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff95000e9f0 tx=0x7ff95000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff943fff640 1 -- 172.21.15.39:0/539588307 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95000cd80 con 0x7ff95c101c40 2024-09-12T02:02:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95c102ec0 con 0x7ff95c101c40 2024-09-12T02:02:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95c103460 con 0x7ff95c101c40 2024-09-12T02:02:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff943fff640 1 -- 172.21.15.39:0/539588307 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff950010910 con 0x7ff95c101c40 2024-09-12T02:02:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.888+0000 7ff943fff640 1 -- 172.21.15.39:0/539588307 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950018980 con 0x7ff95c101c40 2024-09-12T02:02:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.890+0000 7ff943fff640 1 -- 172.21.15.39:0/539588307 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff950018b20 con 0x7ff95c101c40 2024-09-12T02:02:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 Processor -- start 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 -- start start 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717c2e0 0x5590c7180da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 0x5590c7183830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5590c70df2f0 con 0x5590c717c2e0 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590c7087270 con 0x5590c7181370 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff9640b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5590c70db2b0 con 0x5590c717b9a0 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:47194/0 (socket says 172.21.15.39:47194) 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff95b7fe640 1 -- 172.21.15.39:0/386048165 learned_addr learned my addr 172.21.15.39:0/386048165 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 0x5590c7183830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff95affd640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717c2e0 0x5590c7180da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.891+0000 7ff943fff640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 0x7ff9440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 -- 172.21.15.39:0/386048165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 msgr2=0x5590c7183830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 0x5590c7183830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 -- 172.21.15.39:0/386048165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717c2e0 msgr2=0x5590c7180da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717c2e0 0x5590c7180da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 -- 172.21.15.39:0/386048165 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c7086340 con 0x5590c717b9a0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 0x5590c7183830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff943fff640 1 -- 172.21.15.39:0/539588307 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff9500cf440 con 0x7ff95c101c40 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 0x7ff9440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ca0 tx=0x7ff9540093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbc443c8f596e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 0x7ff9440a50f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff954031a40 tx=0x7ff95404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.892+0000 7ff9417fa640 1 -- 172.21.15.39:0/386048165 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954046040 con 0x5590c717b9a0 2024-09-12T02:02:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.893+0000 7ff9417fa640 1 -- 172.21.15.39:0/386048165 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff954050020 con 0x5590c717b9a0 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.893+0000 7ff9417fa640 1 -- 172.21.15.39:0/386048165 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954030a60 con 0x5590c717b9a0 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- 172.21.15.39:0/386048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 msgr2=0x5590c717bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ca0 tx=0x7ff9540093b0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- 172.21.15.39:0/386048165 shutdown_connections 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c7181370 0x5590c7183830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717c2e0 0x5590c7180da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 --2- 172.21.15.39:0/386048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c717bda0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- 172.21.15.39:0/386048165 >> 172.21.15.39:0/386048165 conn(0x5590c7177010 msgr2=0x5590c7177410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- 172.21.15.39:0/386048165 shutdown_connections 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- 172.21.15.39:0/386048165 wait complete. 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 -- start start 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.894+0000 7ff9640b4740 1 Processor -- start 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717b9a0 0x5590c7185c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717c2e0 0x5590c7186190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5590c71842e0 con 0x5590c7181370 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590c7068290 con 0x5590c717b9a0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5590c7184460 con 0x5590c717c2e0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45576/0 (socket says 172.21.15.39:45576) 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 -- 172.21.15.39:0/1114870098 learned_addr learned my addr 172.21.15.39:0/1114870098 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717b9a0 0x5590c7185c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff9640b4740 10 client.0 _ll_register_callbacks cb 0x5590c7099140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717c2e0 0x5590c7186190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 -- 172.21.15.39:0/1114870098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717c2e0 msgr2=0x5590c7186190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717c2e0 0x5590c7186190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 -- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717b9a0 msgr2=0x5590c7185c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717b9a0 0x5590c7185c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 -- 172.21.15.39:0/1114870098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c6df2210 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff954005e30 tx=0x7ff95402ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac1bc14df41875b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff93eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954061060 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.895+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff954030bf0 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff954050020 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff954046050 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 10 client.16509 fetch_fsmap learned FSMap version 31 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5590c6ebe620 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff954050020 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff95405b030 con 0x5590c7181370 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 10 client.16509 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:02:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 20 client.16509 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 4 client.16509 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c70eca20 con 0x5590c71914d0 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.896+0000 7ff95affd640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.897+0000 7ff95affd640 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71938f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed09986c6df3688 server_cookie=fe42a450995cc95c in_seq=0 out_seq=0 2024-09-12T02:02:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.897+0000 7ff93eff5640 10 client.16509 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff93eff5640 1 -- 172.21.15.39:0/1114870098 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590c70eca20 con 0x5590c71914d0 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff93eff5640 10 client.16509 handle_command_reply: tid=0 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff9640b4740 1 client.16509 shutdown 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 msgr2=0x5590c718d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff954005e30 tx=0x7ff95402ff90 comp rx=0 tx=0).stop 2024-09-12T02:02:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 shutdown_connections 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.898+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71938f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.899+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c718d1d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.899+0000 7ff93eff5640 0 client.16509 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.899+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717c2e0 0x5590c7186190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.899+0000 7ff9640b4740 1 --2- 172.21.15.39:0/1114870098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717b9a0 0x5590c7185c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.899+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 >> 172.21.15.39:0/1114870098 conn(0x5590c7177010 msgr2=0x5590c7178820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.904+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 shutdown_connections 2024-09-12T02:02:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.904+0000 7ff9640b4740 1 -- 172.21.15.39:0/1114870098 wait complete. 2024-09-12T02:02:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.904+0000 7ff9640b4740 20 client.16509 trim_cache size 0 max 16384 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.921+0000 7ff9640b4740 1 Processor -- start 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.921+0000 7ff9640b4740 1 -- start start 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.921+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c71760b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.921+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff9640b4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a95c0 con 0x5590c7181370 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff9640b4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a6e30 con 0x5590c717c2e0 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff9640b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a4c80 con 0x5590c717b9a0 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c71760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45590/0 (socket says 172.21.15.39:45590) 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 -- 172.21.15.39:0/2204228243 learned_addr learned my addr 172.21.15.39:0/2204228243 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 -- 172.21.15.39:0/2204228243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 msgr2=0x5590c71760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c71760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 -- 172.21.15.39:0/2204228243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 msgr2=0x5590c718d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 -- 172.21.15.39:0/2204228243 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c717b5e0 con 0x5590c7181370 2024-09-12T02:02:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff954009a60 tx=0x7ff954009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fd7adb3927460b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff940ff9640 1 -- 172.21.15.39:0/2204228243 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95406c070 con 0x5590c7181370 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.922+0000 7ff940ff9640 1 -- 172.21.15.39:0/2204228243 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff954050070 con 0x5590c7181370 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.923+0000 7ff940ff9640 1 -- 172.21.15.39:0/2204228243 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954061070 con 0x5590c7181370 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.923+0000 7ff9640b4740 1 -- 172.21.15.39:0/2204228243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 msgr2=0x5590c7198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.923+0000 7ff9640b4740 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff954009a60 tx=0x7ff954009b20 comp rx=0 tx=0).stop 2024-09-12T02:02:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.926+0000 7ff9640b4740 1 -- 172.21.15.39:0/2204228243 shutdown_connections 2024-09-12T02:02:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.926+0000 7ff9640b4740 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c7181370 0x5590c7198190 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.926+0000 7ff9640b4740 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.926+0000 7ff9640b4740 1 --2- 172.21.15.39:0/2204228243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c717b9a0 0x5590c71760b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.926+0000 7ff9640b4740 1 -- 172.21.15.39:0/2204228243 >> 172.21.15.39:0/2204228243 conn(0x5590c7177010 msgr2=0x5590c71759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.927+0000 7ff9640b4740 1 -- 172.21.15.39:0/2204228243 shutdown_connections 2024-09-12T02:02:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.928+0000 7ff9640b4740 1 -- 172.21.15.39:0/2204228243 wait complete. 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.928+0000 7ff9640b4740 1 -- start start 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.928+0000 7ff9640b4740 1 Processor -- start 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 0x5590c718bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a52f0 con 0x5590c717b9a0 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a6760 con 0x5590c717c2e0 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff95c1a59c0 con 0x5590c7181370 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff9640b4740 10 client.0 _ll_register_callbacks cb 0x7ff94c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45606/0 (socket says 172.21.15.39:45606) 2024-09-12T02:02:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 -- 172.21.15.39:0/3122805740 learned_addr learned my addr 172.21.15.39:0/3122805740 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 0x5590c718bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 -- 172.21.15.39:0/3122805740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 msgr2=0x5590c718bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 0x5590c718bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 -- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 msgr2=0x5590c718ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.929+0000 7ff95affd640 1 -- 172.21.15.39:0/3122805740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c718c4b0 con 0x5590c717b9a0 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff95b7fe640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 0x5590c718bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff95affd640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5590c7177e90 tx=0x7ff94c01f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0aebfabbe9bd244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff93eff5640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004230 con 0x5590c717b9a0 2024-09-12T02:02:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff94c0043d0 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff954050070 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff94c010610 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff9640b4740 10 client.16515 fetch_fsmap learned FSMap version 31 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.930+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5590c71fc330 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff954050070 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff94c003b50 con 0x5590c717b9a0 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 10 client.16515 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 20 client.16515 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 4 client.16515 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:02:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590c70e6d70 con 0x5590c71914d0 2024-09-12T02:02:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.931+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.932+0000 7ff93eff5640 10 client.16515 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.932+0000 7ff95a7fc640 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71fee00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2048463950d41be3 server_cookie=b6dbc12ecf63ad58 in_seq=0 out_seq=0 2024-09-12T02:02:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff93eff5640 1 -- 172.21.15.39:0/3122805740 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590c70e6d70 con 0x5590c71914d0 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff93eff5640 10 client.16515 handle_command_reply: tid=0 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 client.16515 shutdown 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 msgr2=0x5590c718a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x5590c7177e90 tx=0x7ff94c01f920 comp rx=0 tx=0).stop 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 shutdown_connections 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x5590c71914d0 0x5590c71fee00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5590c7181370 0x5590c718bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590c717c2e0 0x5590c718ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 --2- 172.21.15.39:0/3122805740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5590c717b9a0 0x5590c718a950 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff93eff5640 0 client.16515 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.943+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 >> 172.21.15.39:0/3122805740 conn(0x5590c7177010 msgr2=0x5590c71786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 shutdown_connections 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff9640b4740 1 -- 172.21.15.39:0/3122805740 wait complete. 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff9640b4740 20 client.16515 trim_cache size 0 max 16384 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:02:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 msgr2=0x7ff9440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 0x7ff9440a50f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff954031a40 tx=0x7ff95404b000 comp rx=0 tx=0).stop 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 msgr2=0x7ff95c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff95000e9f0 tx=0x7ff95000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 shutdown_connections 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95c102600 0x7ff95c19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff95c101c40 0x7ff95c198300 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7ff9440a2c30 0x7ff9440a50f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 --2- 172.21.15.39:0/539588307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff95c100a50 0x7ff95c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 >> 172.21.15.39:0/539588307 conn(0x7ff95c0fc1b0 msgr2=0x7ff95c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 shutdown_connections 2024-09-12T02:02:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:05.944+0000 7ff96131f640 1 -- 172.21.15.39:0/539588307 wait complete. 2024-09-12T02:02:07.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:07 smithi039 ceph-mon[31204]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.05k op/s 2024-09-12T02:02:07.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:07 smithi044 ceph-mon[35259]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.05k op/s 2024-09-12T02:02:07.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:07 smithi172 ceph-mon[35073]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.05k op/s 2024-09-12T02:02:07.625 INFO:tasks.workunit.client.0.smithi039.stdout:copying to largest ever: 0x63ef9ee 2024-09-12T02:02:09.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:09 smithi039 ceph-mon[31204]: pgmap v495: 97 pgs: 97 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-12T02:02:09.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:09 smithi044 ceph-mon[35259]: pgmap v495: 97 pgs: 97 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-12T02:02:09.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:09 smithi172 ceph-mon[35073]: pgmap v495: 97 pgs: 97 active+clean; 62 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-12T02:02:11.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:11 smithi039 ceph-mon[31204]: pgmap v496: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:02:11.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:11 smithi044 ceph-mon[35259]: pgmap v496: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:02:11.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:11 smithi172 ceph-mon[35073]: pgmap v496: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 1.14k op/s 2024-09-12T02:02:13.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:13 smithi039 ceph-mon[31204]: pgmap v497: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 996 op/s 2024-09-12T02:02:13.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:13 smithi044 ceph-mon[35259]: pgmap v497: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 996 op/s 2024-09-12T02:02:13.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:13 smithi172 ceph-mon[35073]: pgmap v497: 97 pgs: 97 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.6 MiB/s wr, 996 op/s 2024-09-12T02:02:15.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:15 smithi039 ceph-mon[31204]: pgmap v498: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.2 MiB/s wr, 1.20k op/s 2024-09-12T02:02:15.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:15 smithi044 ceph-mon[35259]: pgmap v498: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.2 MiB/s wr, 1.20k op/s 2024-09-12T02:02:15.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:15 smithi172 ceph-mon[35073]: pgmap v498: 97 pgs: 97 active+clean; 81 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.2 MiB/s wr, 1.20k op/s 2024-09-12T02:02:17.160 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:17 smithi039 ceph-mon[31204]: pgmap v499: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.01k op/s 2024-09-12T02:02:17.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:17 smithi044 ceph-mon[35259]: pgmap v499: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.01k op/s 2024-09-12T02:02:17.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:17 smithi172 ceph-mon[35073]: pgmap v499: 97 pgs: 97 active+clean; 83 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.01k op/s 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 -- 172.21.15.39:0/641166501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 msgr2=0x7fe004100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/641166501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe004100e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe000009860 tx=0x7fe00002a340 comp rx=0 tx=0).stop 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 -- 172.21.15.39:0/641166501 shutdown_connections 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/641166501 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe004108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/641166501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe0041020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/641166501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe004100e50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 -- 172.21.15.39:0/641166501 >> 172.21.15.39:0/641166501 conn(0x7fe0040fc1b0 msgr2=0x7fe0040fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.055 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 -- 172.21.15.39:0/641166501 shutdown_connections 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 -- 172.21.15.39:0/641166501 wait complete. 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.053+0000 7fe00bf0a640 1 Processor -- start 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 -- start start 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe00419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe00419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe00410c6b0 con 0x7fe004102600 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe00410c530 con 0x7fe004101c40 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00bf0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe00410c830 con 0x7fe004100a50 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe00419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe00419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe00419a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:54238/0 (socket says 172.21.15.39:54238) 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe009ca6640 1 -- 172.21.15.39:0/3797436567 learned_addr learned my addr 172.21.15.39:0/3797436567 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47584/0 (socket says 172.21.15.39:47584) 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 -- 172.21.15.39:0/3797436567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 msgr2=0x7fe00419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe00419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 -- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 msgr2=0x7fe0041a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe0094a5640 1 -- 172.21.15.39:0/3797436567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0041a1c50 con 0x7fe004101c40 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.054+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.055+0000 7fe0094a5640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe00419a570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005fd0 tx=0x7fdff400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.062+0000 7fdffaffd640 1 -- 172.21.15.39:0/3797436567 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff400ccc0 con 0x7fe004101c40 2024-09-12T02:02:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.062+0000 7fdffaffd640 1 -- 172.21.15.39:0/3797436567 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdff40035f0 con 0x7fe004101c40 2024-09-12T02:02:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.062+0000 7fdffaffd640 1 -- 172.21.15.39:0/3797436567 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff400ce60 con 0x7fe004101c40 2024-09-12T02:02:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.062+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0041a1f40 con 0x7fe004101c40 2024-09-12T02:02:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.062+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0041a23b0 con 0x7fe004101c40 2024-09-12T02:02:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.065+0000 7fdffaffd640 1 -- 172.21.15.39:0/3797436567 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdff40037a0 con 0x7fe004101c40 2024-09-12T02:02:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.065+0000 7fe00eca0740 1 Processor -- start 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 -- start start 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a87015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a8701b80 0x55b3a8704040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b3a86572f0 con 0x55b3a86fc1b0 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b3a85ff270 con 0x55b3a86fcaf0 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00eca0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b3a86532b0 con 0x55b3a8701b80 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47590/0 (socket says 172.21.15.39:47590) 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a87015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00a4a7640 1 -- 172.21.15.39:0/732817359 learned_addr learned my addr 172.21.15.39:0/732817359 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fdffaffd640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 0x7fdff00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe0094a5640 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a8701b80 0x55b3a8704040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.066+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 0x7fdff00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 -- 172.21.15.39:0/732817359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a8701b80 msgr2=0x55b3a8704040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a8701b80 0x55b3a8704040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 -- 172.21.15.39:0/732817359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 msgr2=0x55b3a86fc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 -- 172.21.15.39:0/732817359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a85fe340 con 0x55b3a86fcaf0 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fdffaffd640 1 -- 172.21.15.39:0/3797436567 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdff40cf100 con 0x7fe004101c40 2024-09-12T02:02:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe009ca6640 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a87015b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe0000057c0 tx=0x7fe000005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edece1eefe1a6246 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 0x7fdff00a5260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009b80 tx=0x7fdffc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fdfeffff640 1 -- 172.21.15.39:0/732817359 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000037040 con 0x55b3a86fcaf0 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fdfeffff640 1 -- 172.21.15.39:0/732817359 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe000004030 con 0x55b3a86fcaf0 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.067+0000 7fdfeffff640 1 -- 172.21.15.39:0/732817359 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000003a00 con 0x55b3a86fcaf0 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- 172.21.15.39:0/732817359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 msgr2=0x55b3a87015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a87015b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe0000057c0 tx=0x7fe000005d40 comp rx=0 tx=0).stop 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- 172.21.15.39:0/732817359 shutdown_connections 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a8701b80 0x55b3a8704040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a87015b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 --2- 172.21.15.39:0/732817359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a86fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- 172.21.15.39:0/732817359 >> 172.21.15.39:0/732817359 conn(0x55b3a86f7820 msgr2=0x55b3a86f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- 172.21.15.39:0/732817359 shutdown_connections 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- 172.21.15.39:0/732817359 wait complete. 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 -- start start 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.068+0000 7fe00eca0740 1 Processor -- start 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a8706850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a8701b80 0x55b3a870d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55b3a8704af0 con 0x55b3a86fc1b0 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b3a85e0290 con 0x55b3a8701b80 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b3a8704c70 con 0x55b3a86fcaf0 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00eca0740 10 client.0 _ll_register_callbacks cb 0x55b3a8611140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47604/0 (socket says 172.21.15.39:47604) 2024-09-12T02:02:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 -- 172.21.15.39:0/1190649698 learned_addr learned my addr 172.21.15.39:0/1190649698 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe0094a5640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a8706850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a8701b80 0x55b3a870d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 -- 172.21.15.39:0/1190649698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 msgr2=0x55b3a8706850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a8706850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 -- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a8701b80 msgr2=0x55b3a870d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a8701b80 0x55b3a870d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.069+0000 7fe009ca6640 1 -- 172.21.15.39:0/1190649698 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a836a210 con 0x55b3a86fc1b0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe009ca6640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe000005940 tx=0x7fe00002aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574e4b34cd1f3c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000037040 con 0x55b3a86fc1b0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe000005050 con 0x55b3a86fc1b0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe000004030 con 0x55b3a86fc1b0 2024-09-12T02:02:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe000005250 con 0x55b3a86fc1b0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 10 client.16527 fetch_fsmap learned FSMap version 31 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b3a8436620 con 0x55b3a86fc1b0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe000004030 con 0x55b3a86fc1b0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fe000004750 con 0x55b3a86fc1b0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 10 client.16527 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 10 client.16527 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 20 client.16527 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a8711b90 0x55b3a8713fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 4 client.16527 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.070+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3a8664a20 con 0x55b3a8711b90 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.071+0000 7fe0094a5640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a8711b90 0x55b3a8713fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.071+0000 7fdfed7fa640 10 client.16527 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.071+0000 7fe0094a5640 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a8711b90 0x55b3a8713fc0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43601f1ba9b55c28 server_cookie=1ae255d097571ea5 in_seq=0 out_seq=0 2024-09-12T02:02:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fdfed7fa640 1 -- 172.21.15.39:0/1190649698 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3a8664a20 con 0x55b3a8711b90 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fdfed7fa640 10 client.16527 handle_command_reply: tid=0 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 client.16527 shutdown 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 msgr2=0x55b3a8706310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe000005940 tx=0x7fe00002aa60 comp rx=0 tx=0).stop 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 shutdown_connections 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a8711b90 0x55b3a8713fc0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a8701b80 0x55b3a870d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a8706850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fdfed7fa640 0 client.16527 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 --2- 172.21.15.39:0/1190649698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a86fc1b0 0x55b3a8706310 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 >> 172.21.15.39:0/1190649698 conn(0x55b3a86f7820 msgr2=0x55b3a86f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 shutdown_connections 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.072+0000 7fe00eca0740 1 -- 172.21.15.39:0/1190649698 wait complete. 2024-09-12T02:02:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.073+0000 7fe00eca0740 20 client.16527 trim_cache size 0 max 16384 2024-09-12T02:02:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 Processor -- start 2024-09-12T02:02:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 -- start start 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fc1b0 0x55b3a87068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a870d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a96a0 con 0x55b3a8701b80 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a6f10 con 0x55b3a86fc1b0 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00eca0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a4d80 con 0x55b3a86fcaf0 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.091+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47616/0 (socket says 172.21.15.39:47616) 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fc1b0 0x55b3a87068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 -- 172.21.15.39:0/311550649 learned_addr learned my addr 172.21.15.39:0/311550649 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe0094a5640 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a870d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 -- 172.21.15.39:0/311550649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 msgr2=0x55b3a870d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a870d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 -- 172.21.15.39:0/311550649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fc1b0 msgr2=0x55b3a87068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fc1b0 0x55b3a87068e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 -- 172.21.15.39:0/311550649 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a870ed30 con 0x55b3a8701b80 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00fb00 tx=0x7fdffc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1315ed27bcde34b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fdfef7fe640 1 -- 172.21.15.39:0/311550649 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc013dd0 con 0x55b3a8701b80 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fdfef7fe640 1 -- 172.21.15.39:0/311550649 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdffc00ec50 con 0x55b3a8701b80 2024-09-12T02:02:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.092+0000 7fdfef7fe640 1 -- 172.21.15.39:0/311550649 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0057e0 con 0x55b3a8701b80 2024-09-12T02:02:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 -- 172.21.15.39:0/311550649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 msgr2=0x55b3a86ee0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00fb00 tx=0x7fdffc00f3c0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 -- 172.21.15.39:0/311550649 shutdown_connections 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a86ee0b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fcaf0 0x55b3a870d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 --2- 172.21.15.39:0/311550649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fc1b0 0x55b3a87068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 -- 172.21.15.39:0/311550649 >> 172.21.15.39:0/311550649 conn(0x55b3a86f7820 msgr2=0x55b3a86ed9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 -- 172.21.15.39:0/311550649 shutdown_connections 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.093+0000 7fe00eca0740 1 -- 172.21.15.39:0/311550649 wait complete. 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 -- start start 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 Processor -- start 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 0x55b3a870b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a870c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a53d0 con 0x55b3a8701b80 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a6840 con 0x55b3a86fcaf0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041a5aa0 con 0x55b3a86fc1b0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.094+0000 7fe00eca0740 10 client.0 _ll_register_callbacks cb 0x7fdffc009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe009ca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 0x55b3a870b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:57150/0 (socket says 172.21.15.39:57150) 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 -- 172.21.15.39:0/105078887 learned_addr learned my addr 172.21.15.39:0/105078887 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe00a4a7640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a870c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 -- 172.21.15.39:0/105078887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 msgr2=0x55b3a870b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 0x55b3a870b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 -- 172.21.15.39:0/105078887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 msgr2=0x55b3a870c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a870c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 -- 172.21.15.39:0/105078887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a870cd50 con 0x55b3a86fcaf0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe009ca6640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 0x55b3a870b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe0094a5640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000c00 tx=0x7fdff40cf300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a3a57532fc728f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fdfed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff409b970 con 0x55b3a86fcaf0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdff4003af0 con 0x55b3a86fcaf0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdffc00ec50 con 0x55b3a86fcaf0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdff40a45e0 con 0x55b3a86fcaf0 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe00eca0740 10 client.26078 fetch_fsmap learned FSMap version 31 2024-09-12T02:02:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.095+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b3a877cc50 con 0x55b3a86fcaf0 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdffc00ec50 con 0x55b3a86fcaf0 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdff409adc0 con 0x55b3a86fcaf0 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 10 client.26078 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 10 client.26078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 20 client.26078 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a877d630 0x55b3a877fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 4 client.26078 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3a865ed70 con 0x55b3a877d630 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.096+0000 7fe009ca6640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a877d630 0x55b3a877fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.097+0000 7fe009ca6640 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a877d630 0x55b3a877fa50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725ab2f977cf262a server_cookie=d89654d088dea46c in_seq=0 out_seq=0 2024-09-12T02:02:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.097+0000 7fdfed7fa640 10 client.26078 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.108+0000 7fdfed7fa640 1 -- 172.21.15.39:0/105078887 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3a865ed70 con 0x55b3a877d630 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.108+0000 7fdfed7fa640 10 client.26078 handle_command_reply: tid=0 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.108+0000 7fe00eca0740 1 client.26078 shutdown 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.108+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 msgr2=0x55b3a870b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.108+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000c00 tx=0x7fdff40cf300 comp rx=0 tx=0).stop 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 shutdown_connections 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55b3a877d630 0x55b3a877fa50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55b3a8701b80 0x55b3a870c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b3a86fcaf0 0x55b3a870b780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fdfed7fa640 0 client.26078 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 --2- 172.21.15.39:0/105078887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a86fc1b0 0x55b3a870b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 >> 172.21.15.39:0/105078887 conn(0x55b3a86f7820 msgr2=0x55b3a86f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 shutdown_connections 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 1 -- 172.21.15.39:0/105078887 wait complete. 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00eca0740 20 client.26078 trim_cache size 0 max 16384 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:02:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:02:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:02:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 msgr2=0x7fdff00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.111 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.109+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 0x7fdff00a5260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009b80 tx=0x7fdffc004ab0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 msgr2=0x7fe00419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe00419a570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005fd0 tx=0x7fdff400ed90 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 shutdown_connections 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe004102600 0x7fe0041a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe004101c40 0x7fe00419a570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fdff00a2da0 0x7fdff00a5260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 --2- 172.21.15.39:0/3797436567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe004100a50 0x7fe00419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 >> 172.21.15.39:0/3797436567 conn(0x7fe0040fc1b0 msgr2=0x7fe0040fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 shutdown_connections 2024-09-12T02:02:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:19.110+0000 7fe00bf0a640 1 -- 172.21.15.39:0/3797436567 wait complete. 2024-09-12T02:02:19.305 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:19 smithi172 ceph-mon[35073]: pgmap v500: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:02:19.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:19 smithi039 ceph-mon[31204]: pgmap v500: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:02:19.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:19 smithi044 ceph-mon[35259]: pgmap v500: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-12T02:02:21.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:21 smithi039 ceph-mon[31204]: pgmap v501: 97 pgs: 97 active+clean; 66 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.9 MiB/s wr, 1.10k op/s 2024-09-12T02:02:21.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:21 smithi044 ceph-mon[35259]: pgmap v501: 97 pgs: 97 active+clean; 66 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.9 MiB/s wr, 1.10k op/s 2024-09-12T02:02:21.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:21 smithi172 ceph-mon[35073]: pgmap v501: 97 pgs: 97 active+clean; 66 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.9 MiB/s wr, 1.10k op/s 2024-09-12T02:02:22.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:22.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:02:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:22.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:02:22.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:02:22.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:02:22.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:02:22.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:02:23.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:23 smithi039 ceph-mon[31204]: pgmap v502: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 961 op/s 2024-09-12T02:02:23.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:23 smithi044 ceph-mon[35259]: pgmap v502: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 961 op/s 2024-09-12T02:02:23.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:23 smithi172 ceph-mon[35073]: pgmap v502: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 961 op/s 2024-09-12T02:02:24.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:24 smithi039 ceph-mon[31204]: pgmap v503: 97 pgs: 97 active+clean; 68 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 1.16k op/s 2024-09-12T02:02:24.423 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:24 smithi044 ceph-mon[35259]: pgmap v503: 97 pgs: 97 active+clean; 68 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 1.16k op/s 2024-09-12T02:02:24.503 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:24 smithi172 ceph-mon[35073]: pgmap v503: 97 pgs: 97 active+clean; 68 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.0 MiB/s wr, 1.16k op/s 2024-09-12T02:02:26.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:26 smithi039 ceph-mon[31204]: pgmap v504: 97 pgs: 97 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 978 op/s 2024-09-12T02:02:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:26 smithi044 ceph-mon[35259]: pgmap v504: 97 pgs: 97 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 978 op/s 2024-09-12T02:02:26.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:26 smithi172 ceph-mon[35073]: pgmap v504: 97 pgs: 97 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 978 op/s 2024-09-12T02:02:28.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:28 smithi039 ceph-mon[31204]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.03k op/s 2024-09-12T02:02:28.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:28 smithi044 ceph-mon[35259]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.03k op/s 2024-09-12T02:02:28.685 INFO:tasks.workunit.client.0.smithi039.stdout:All 50000 operations completed A-OK! 2024-09-12T02:02:28.686 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:02:28.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:02:28.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:28 smithi172 ceph-mon[35073]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.03k op/s 2024-09-12T02:02:29.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:29 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:29.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:29 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:29.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:29 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:30.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:30 smithi172 ceph-mon[35073]: pgmap v506: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-12T02:02:30.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:30 smithi039 ceph-mon[31204]: pgmap v506: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-12T02:02:30.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:30 smithi044 ceph-mon[35259]: pgmap v506: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-12T02:02:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- 172.21.15.39:0/868064622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0101c30 msgr2=0x7f09a01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 --2- 172.21.15.39:0/868064622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0101c30 0x7f09a01020b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0994009900 tx=0x7f099402a410 comp rx=0 tx=0).stop 2024-09-12T02:02:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- 172.21.15.39:0/868064622 shutdown_connections 2024-09-12T02:02:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 --2- 172.21.15.39:0/868064622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 0x7f09a0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 --2- 172.21.15.39:0/868064622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0101c30 0x7f09a01020b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 --2- 172.21.15.39:0/868064622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0100a40 0x7f09a0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- 172.21.15.39:0/868064622 >> 172.21.15.39:0/868064622 conn(0x7f09a00fc1e0 msgr2=0x7f09a00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- 172.21.15.39:0/868064622 shutdown_connections 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- 172.21.15.39:0/868064622 wait complete. 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 Processor -- start 2024-09-12T02:02:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.201+0000 7f09a6918640 1 -- start start 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0101c30 0x7f09a019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 0x7f09a01a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09a010c6c0 con 0x7f09a0100a40 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09a010c540 con 0x7f09a01025f0 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a6918640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09a010c840 con 0x7f09a0101c30 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36324/0 (socket says 172.21.15.39:36324) 2024-09-12T02:02:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 -- 172.21.15.39:0/269732030 learned_addr learned my addr 172.21.15.39:0/269732030 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099f7fe640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0101c30 0x7f09a019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 0x7f09a01a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 -- 172.21.15.39:0/269732030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0101c30 msgr2=0x7f09a019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0101c30 0x7f09a019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 -- 172.21.15.39:0/269732030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 msgr2=0x7f09a01a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 0x7f09a01a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.202+0000 7f099ffff640 1 -- 172.21.15.39:0/269732030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a01a1ca0 con 0x7f09a0100a40 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f099ffff640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f099000e9c0 tx=0x7f099000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f099d7fa640 1 -- 172.21.15.39:0/269732030 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099000cd80 con 0x7f09a0100a40 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f099d7fa640 1 -- 172.21.15.39:0/269732030 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09900035f0 con 0x7f09a0100a40 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f099d7fa640 1 -- 172.21.15.39:0/269732030 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990010690 con 0x7f09a0100a40 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a01a1f30 con 0x7f09a0100a40 2024-09-12T02:02:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.203+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a01a2340 con 0x7f09a0100a40 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f099d7fa640 1 -- 172.21.15.39:0/269732030 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f09900037a0 con 0x7f09a0100a40 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 Processor -- start 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 -- start start 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26089a0 0x55c8f2608da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c8f256c2f0 con 0x55c8f260e370 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8f2514270 con 0x55c8f26089a0 2024-09-12T02:02:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.205+0000 7f09a96b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8f25682b0 con 0x55c8f26092e0 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36336/0 (socket says 172.21.15.39:36336) 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:54834/0 (socket says 172.21.15.39:54834) 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 -- 172.21.15.39:0/2138166311 learned_addr learned my addr 172.21.15.39:0/2138166311 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26089a0 0x55c8f2608da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099d7fa640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 0x7f09880a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 -- 172.21.15.39:0/2138166311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 msgr2=0x55c8f260dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 -- 172.21.15.39:0/2138166311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26089a0 msgr2=0x55c8f2608da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26089a0 0x55c8f2608da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 -- 172.21.15.39:0/2138166311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f2513340 con 0x55c8f260e370 2024-09-12T02:02:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099ffff640 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 0x7f09880a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099d7fa640 1 -- 172.21.15.39:0/269732030 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f09900cf320 con 0x7f09a0100a40 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f099402a930 tx=0x7f0994032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2603750741e31350 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f09867fc640 1 -- 172.21.15.39:0/2138166311 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994040070 con 0x55c8f260e370 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f09867fc640 1 -- 172.21.15.39:0/2138166311 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994032e20 con 0x55c8f260e370 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.206+0000 7f09867fc640 1 -- 172.21.15.39:0/2138166311 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994035040 con 0x55c8f260e370 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- 172.21.15.39:0/2138166311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 msgr2=0x55c8f2610830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f099402a930 tx=0x7f0994032c30 comp rx=0 tx=0).stop 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 0x7f09880a5120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0998005fd0 tx=0x7f0998004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- 172.21.15.39:0/2138166311 shutdown_connections 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f2610830 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26092e0 0x55c8f260dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2138166311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26089a0 0x55c8f2608da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- 172.21.15.39:0/2138166311 >> 172.21.15.39:0/2138166311 conn(0x55c8f2604010 msgr2=0x55c8f2604410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- 172.21.15.39:0/2138166311 shutdown_connections 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- 172.21.15.39:0/2138166311 wait complete. 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.207+0000 7f09a96b2740 1 -- start start 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 Processor -- start 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f2612b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2613080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f261a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c8f26112e0 con 0x55c8f260e370 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8f24f5290 con 0x55c8f26092e0 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8f2611460 con 0x55c8f26089a0 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a96b2740 10 client.0 _ll_register_callbacks cb 0x55c8f2526140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a4eb5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f261a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f2612b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a4eb5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f261a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36338/0 (socket says 172.21.15.39:36338) 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f09a4eb5640 1 -- 172.21.15.39:0/2186271657 learned_addr learned my addr 172.21.15.39:0/2186271657 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2613080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 -- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 msgr2=0x55c8f2613080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2613080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 -- 172.21.15.39:0/2186271657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 msgr2=0x55c8f261a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f261a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.208+0000 7f099ffff640 1 -- 172.21.15.39:0/2186271657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f227f210 con 0x55c8f26089a0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f099ffff640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f2612b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09900cce80 tx=0x7f09900097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f978d89373c5e72b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099009b6d0 con 0x55c8f26089a0 2024-09-12T02:02:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f09900a4370 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0994032e20 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f09900b4070 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 10 client.25918 fetch_fsmap learned FSMap version 32 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c8f234b620 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994032e20 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f09900ce030 con 0x55c8f26089a0 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 10 client.25918 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 10 client.25918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 20 client.25918 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f261e830 0x55c8f2620c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 4 client.25918 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8f2579a20 con 0x55c8f261e830 2024-09-12T02:02:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.209+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f261e830 0x55c8f2620c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.210+0000 7f099f7fe640 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f261e830 0x55c8f2620c60 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8adf08f84611d9ad server_cookie=70b365fde10e3145 in_seq=0 out_seq=0 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.210+0000 7f097f7fe640 10 client.25918 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.210+0000 7f097f7fe640 1 -- 172.21.15.39:0/2186271657 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f099404fe80 con 0x55c8f261e830 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.210+0000 7f097f7fe640 10 client.25918 handle_command_reply: tid=0 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 client.25918 shutdown 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 msgr2=0x55c8f2612b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f2612b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09900cce80 tx=0x7f09900097a0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 shutdown_connections 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f261e830 0x55c8f2620c60 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f260e370 0x55c8f261a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2613080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f097f7fe640 0 client.25918 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 --2- 172.21.15.39:0/2186271657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f2612b40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 >> 172.21.15.39:0/2186271657 conn(0x55c8f2604010 msgr2=0x55c8f2605820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 shutdown_connections 2024-09-12T02:02:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 1 -- 172.21.15.39:0/2186271657 wait complete. 2024-09-12T02:02:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.211+0000 7f09a96b2740 20 client.25918 trim_cache size 0 max 16384 2024-09-12T02:02:32.228 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 Processor -- start 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 -- start start 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f26120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f260e370 0x55c8f2613000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01ad9c0 con 0x55c8f26092e0 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01ab260 con 0x55c8f260e370 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a96b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01a90b0 con 0x55c8f26089a0 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36352/0 (socket says 172.21.15.39:36352) 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 -- 172.21.15.39:0/1861613038 learned_addr learned my addr 172.21.15.39:0/1861613038 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f26120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.229 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f260e370 0x55c8f2613000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 -- 172.21.15.39:0/1861613038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 msgr2=0x55c8f26120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f26120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 -- 172.21.15.39:0/1861613038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f260e370 msgr2=0x55c8f2613000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f260e370 0x55c8f2613000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 -- 172.21.15.39:0/1861613038 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f2610ce0 con 0x55c8f26092e0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099ffff640 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f26120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.226+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x55c8f2604e90 tx=0x7f099402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23269446e707d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f0985ffb640 1 -- 172.21.15.39:0/1861613038 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994053070 con 0x55c8f26092e0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f0985ffb640 1 -- 172.21.15.39:0/1861613038 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099404a040 con 0x55c8f26092e0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f0985ffb640 1 -- 172.21.15.39:0/1861613038 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994035040 con 0x55c8f26092e0 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 -- 172.21.15.39:0/1861613038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 msgr2=0x55c8f261a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x55c8f2604e90 tx=0x7f099402a410 comp rx=0 tx=0).stop 2024-09-12T02:02:32.230 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 -- 172.21.15.39:0/1861613038 shutdown_connections 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f260e370 0x55c8f2613000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26092e0 0x55c8f261a080 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1861613038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f26089a0 0x55c8f26120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 -- 172.21.15.39:0/1861613038 >> 172.21.15.39:0/1861613038 conn(0x55c8f2604010 msgr2=0x55c8f26128f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 -- 172.21.15.39:0/1861613038 shutdown_connections 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.227+0000 7f09a96b2740 1 -- 172.21.15.39:0/1861613038 wait complete. 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 -- start start 2024-09-12T02:02:32.231 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 Processor -- start 2024-09-12T02:02:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2617ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.233 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f260e370 0x55c8f2618af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01a9720 con 0x55c8f26089a0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01aab90 con 0x55c8f26092e0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01a9df0 con 0x55c8f260e370 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a96b2740 10 client.0 _ll_register_callbacks cb 0x7f09900045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f099ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f099ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36360/0 (socket says 172.21.15.39:36360) 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f099ffff640 1 -- 172.21.15.39:0/1128064552 learned_addr learned my addr 172.21.15.39:0/1128064552 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f09a4eb5640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f260e370 0x55c8f2618af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.228+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2617ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 -- 172.21.15.39:0/1128064552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f260e370 msgr2=0x55c8f2618af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f260e370 0x55c8f2618af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.234 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 -- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 msgr2=0x55c8f2617ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2617ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 -- 172.21.15.39:0/1128064552 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f2619100 con 0x55c8f26089a0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f099ffff640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0990098510 tx=0x7f09900cf6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633aeff3d7d5ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099009b4f0 con 0x55c8f26089a0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f099009afe0 con 0x55c8f26089a0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f099404a040 con 0x55c8f26089a0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f099009b6d0 con 0x55c8f26089a0 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 10 client.16551 fetch_fsmap learned FSMap version 32 2024-09-12T02:02:32.235 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c8f2619100 con 0x55c8f26089a0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099404a040 con 0x55c8f26089a0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 32) ==== 8350+0+0 (secure 0 0 0) 0x7f09900ce070 con 0x55c8f26089a0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 10 client.16551 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 20 client.16551 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f26899f0 0x55c8f268be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 4 client.16551 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.229+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c8f2573d70 con 0x55c8f26899f0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.230+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f26899f0 0x55c8f268be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.230+0000 7f099f7fe640 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f26899f0 0x55c8f268be10 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1cb7a88848adab server_cookie=401d91972a0da303 in_seq=0 out_seq=0 2024-09-12T02:02:32.236 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.230+0000 7f097f7fe640 10 client.16551 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.247+0000 7f097f7fe640 1 -- 172.21.15.39:0/1128064552 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c8f2573d70 con 0x55c8f26899f0 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.247+0000 7f097f7fe640 10 client.16551 handle_command_reply: tid=0 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.247+0000 7f09a96b2740 1 client.16551 shutdown 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 msgr2=0x55c8f26175a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0990098510 tx=0x7f09900cf6b0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 shutdown_connections 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x55c8f26899f0 0x55c8f268be10 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8f260e370 0x55c8f2618af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f097f7fe640 0 client.16551 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:32.249 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f26092e0 0x55c8f2617ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 --2- 172.21.15.39:0/1128064552 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8f26089a0 0x55c8f26175a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 >> 172.21.15.39:0/1128064552 conn(0x55c8f2604010 msgr2=0x55c8f26029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 shutdown_connections 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 1 -- 172.21.15.39:0/1128064552 wait complete. 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a96b2740 20 client.16551 trim_cache size 0 max 16384 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:{ 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "message": "", 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout: "return_code": 0 2024-09-12T02:02:32.250 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stdout:} 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 msgr2=0x7f09880a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 0x7f09880a5120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0998005fd0 tx=0x7f0998004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 msgr2=0x7f09a006a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.248+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f099000e9c0 tx=0x7f099000ee80 comp rx=0 tx=0).stop 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 shutdown_connections 2024-09-12T02:02:32.251 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09a01025f0 0x7f09a01a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f09880a2c60 0x7f09880a5120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a0101c30 0x7f09a019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 --2- 172.21.15.39:0/269732030 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09a0100a40 0x7f09a006a410 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 >> 172.21.15.39:0/269732030 conn(0x7f09a00fc1e0 msgr2=0x7f09a0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 shutdown_connections 2024-09-12T02:02:32.252 INFO:teuthology.task.background_exec.ubuntu@smithi039.front.sepia.ceph.com.smithi039.stderr:2024-09-12T02:02:32.249+0000 7f09a6918640 1 -- 172.21.15.39:0/269732030 wait complete. 2024-09-12T02:02:32.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:32 smithi172 ceph-mon[35073]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 905 op/s 2024-09-12T02:02:32.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:32 smithi039 ceph-mon[31204]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 905 op/s 2024-09-12T02:02:32.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:32 smithi044 ceph-mon[35259]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.3 MiB/s wr, 905 op/s 2024-09-12T02:02:34.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:34 smithi172 ceph-mon[35073]: pgmap v508: 97 pgs: 97 active+clean; 60 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 925 op/s 2024-09-12T02:02:34.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:34 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:34.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:34 smithi039 ceph-mon[31204]: pgmap v508: 97 pgs: 97 active+clean; 60 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 925 op/s 2024-09-12T02:02:34.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:34 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:34.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:34 smithi044 ceph-mon[35259]: pgmap v508: 97 pgs: 97 active+clean; 60 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.5 MiB/s wr, 925 op/s 2024-09-12T02:02:34.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:34 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:35.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:35 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:35.811 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:35 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:35.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:35 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:36.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:36 smithi172 ceph-mon[35073]: pgmap v509: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 693 op/s 2024-09-12T02:02:36.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:36 smithi039 ceph-mon[31204]: pgmap v509: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 693 op/s 2024-09-12T02:02:36.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:36 smithi044 ceph-mon[35259]: pgmap v509: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 693 op/s 2024-09-12T02:02:38.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:38 smithi172 ceph-mon[35073]: pgmap v510: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-12T02:02:38.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:38 smithi039 ceph-mon[31204]: pgmap v510: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-12T02:02:38.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:38 smithi044 ceph-mon[35259]: pgmap v510: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.8 MiB/s wr, 635 op/s 2024-09-12T02:02:40.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:40 smithi172 ceph-mon[35073]: pgmap v511: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.7 MiB/s wr, 582 op/s 2024-09-12T02:02:40.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:40 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:40.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:40 smithi039 ceph-mon[31204]: pgmap v511: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.7 MiB/s wr, 582 op/s 2024-09-12T02:02:40.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:40 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:40.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:40 smithi044 ceph-mon[35259]: pgmap v511: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.7 MiB/s wr, 582 op/s 2024-09-12T02:02:40.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:40 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:41.362 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-12T02:02:41.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:02:41.671 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:41.671 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:02:41.706 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:02:41.706 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T02:02:41.719 INFO:tasks.quiescer:joining Quiescers 2024-09-12T02:02:41.719 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T02:02:41.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:02:42.004 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:42.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1353197114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 msgr2=0x7f5dd41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:42.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1353197114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd41029b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009900 tx=0x7f5dbc02a480 comp rx=0 tx=0).stop 2024-09-12T02:02:42.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1353197114 shutdown_connections 2024-09-12T02:02:42.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1353197114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 0x7f5dd410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1353197114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd41029b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1353197114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 0x7f5dd4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1353197114 >> 172.21.15.39:0/1353197114 conn(0x7f5dd40fc7d0 msgr2=0x7f5dd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.553+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1353197114 shutdown_connections 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1353197114 wait complete. 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 Processor -- start 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 -- start start 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 0x7f5dd419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 0x7f5dd419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4110fa0 con 0x7f5dd4102570 2024-09-12T02:02:42.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4110e20 con 0x7f5dd4102ef0 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dd96bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4111120 con 0x7f5dd4100e20 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.554+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58092/0 (socket says 172.21.15.39:58092) 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 -- 172.21.15.39:0/1586742600 learned_addr learned my addr 172.21.15.39:0/1586742600 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd37fe640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 0x7f5dd419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd2ffd640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 0x7f5dd419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 -- 172.21.15.39:0/1586742600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 msgr2=0x7f5dd419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 0x7f5dd419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 -- 172.21.15.39:0/1586742600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 msgr2=0x7f5dd419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:42.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 0x7f5dd419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 -- 172.21.15.39:0/1586742600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd419f700 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dcbfff640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc006010 tx=0x7f5dbc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc03f070 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dbc031c30 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd419f990 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc035030 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.555+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd41a72d0 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.556+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd4101200 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.558+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5dbc042070 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.558+0000 7f5dd0ff9640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 0x7f5dc00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.559+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5dbc0ef6c0 con 0x7f5dd4102570 2024-09-12T02:02:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.559+0000 7f5dd2ffd640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 0x7f5dc00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:42.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.559+0000 7f5dd2ffd640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 0x7f5dc00a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009990 tx=0x7f5dc4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:42.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.563+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dbc0bc630 con 0x7f5dd4102570 2024-09-12T02:02:42.694 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:42 smithi039 ceph-mon[31204]: pgmap v512: 97 pgs: 97 active+clean; 59 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-12T02:02:42.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:42 smithi172 ceph-mon[35073]: pgmap v512: 97 pgs: 97 active+clean; 59 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-12T02:02:42.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.777+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dd41a74a0 con 0x7f5dd4102570 2024-09-12T02:02:42.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.778+0000 7f5dd0ff9640 1 -- 172.21.15.39:0/1586742600 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11913 (secure 0 0 0) 0x7f5dbc031de0 con 0x7f5dd4102570 2024-09-12T02:02:42.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:02:42.779 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":35,"btime":"2024-09-12T02:02:39:455793+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:02:38.670364+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24503,24467,24463]},"id":1}]} 2024-09-12T02:02:42.779 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 35 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.780+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 msgr2=0x7f5dc00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.780+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 0x7f5dc00a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009990 tx=0x7f5dc4009110 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.780+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 msgr2=0x7f5dd419ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.780+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc006010 tx=0x7f5dbc003c10 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 shutdown_connections 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dd4102ef0 0x7f5dd419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5dd4102570 0x7f5dd419ac90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f5dc00a2c00 0x7f5dc00a50c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 --2- 172.21.15.39:0/1586742600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dd4100e20 0x7f5dd419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 >> 172.21.15.39:0/1586742600 conn(0x7f5dd40fc7d0 msgr2=0x7f5dd406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 shutdown_connections 2024-09-12T02:02:42.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:42.781+0000 7f5dd96bb640 1 -- 172.21.15.39:0/1586742600 wait complete. 2024-09-12T02:02:42.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:42 smithi044 ceph-mon[35259]: pgmap v512: 97 pgs: 97 active+clean; 59 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 422 op/s 2024-09-12T02:02:43.554 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24503 quiesce db --cancel --all' 2024-09-12T02:02:43.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24503 quiesce db --cancel --all 2024-09-12T02:02:43.733 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:43 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1586742600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:02:43.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:43 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1586742600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:02:43.819 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:43.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:43 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1586742600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:02:44.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 -- 172.21.15.39:0/203105680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5250100ca0 msgr2=0x7f5250106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 --2- 172.21.15.39:0/203105680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5250100ca0 0x7f5250106840 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5240009930 tx=0x7f524002a420 comp rx=0 tx=0).stop 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 -- 172.21.15.39:0/203105680 shutdown_connections 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 --2- 172.21.15.39:0/203105680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250106f50 0x7f525010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 --2- 172.21.15.39:0/203105680 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5250100ca0 0x7f5250106840 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 --2- 172.21.15.39:0/203105680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52501002f0 0x7f52501006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 -- 172.21.15.39:0/203105680 >> 172.21.15.39:0/203105680 conn(0x7f5250077210 msgr2=0x7f52500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 -- 172.21.15.39:0/203105680 shutdown_connections 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.315+0000 7f5257a6d640 1 -- 172.21.15.39:0/203105680 wait complete. 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 Processor -- start 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 -- start start 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250100ca0 0x7f5250198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 0x7f525019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5250111fa0 con 0x7f52501002f0 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5250111e20 con 0x7f5250100ca0 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5257a6d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5250112120 con 0x7f5250106f50 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5255809640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5255809640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58110/0 (socket says 172.21.15.39:58110) 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f5255809640 1 -- 172.21.15.39:0/2046921564 learned_addr learned my addr 172.21.15.39:0/2046921564 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.316+0000 7f525600a640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 0x7f525019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255008640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250100ca0 0x7f5250198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 -- 172.21.15.39:0/2046921564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 msgr2=0x7f525019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 0x7f525019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 -- 172.21.15.39:0/2046921564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250100ca0 msgr2=0x7f5250198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250100ca0 0x7f5250198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 -- 172.21.15.39:0/2046921564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525019d4f0 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f525600a640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 0x7f525019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5255809640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d950 tx=0x7f524c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5246ffd640 1 -- 172.21.15.39:0/2046921564 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c017070 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5246ffd640 1 -- 172.21.15.39:0/2046921564 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524c009c30 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525019d7e0 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5246ffd640 1 -- 172.21.15.39:0/2046921564 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c00f6b0 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.317+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52501a50c0 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.319+0000 7f5246ffd640 1 -- 172.21.15.39:0/2046921564 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f524c0109d0 con 0x7f52501002f0 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 Processor -- start 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 -- start start 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba8fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b6b9f4200 con 0x564b6ba9abe0 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b6b99adc0 con 0x564b6ba90320 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5259e46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b6b9f01c0 con 0x564b6ba8fa00 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.320+0000 7f5255008640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58124/0 (socket says 172.21.15.39:58124) 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 -- 172.21.15.39:0/2610232430 learned_addr learned my addr 172.21.15.39:0/2610232430 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5246ffd640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 0x7f523c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f525600a640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba8fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255809640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba9a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f525600a640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 0x7f523c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 -- 172.21.15.39:0/2610232430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 msgr2=0x564b6ba8fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba8fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 -- 172.21.15.39:0/2610232430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 msgr2=0x564b6ba9a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba9a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5246ffd640 1 -- 172.21.15.39:0/2046921564 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f524c0cecd0 con 0x7f52501002f0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 -- 172.21.15.39:0/2610232430 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6b765620 con 0x564b6ba9abe0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255809640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f5255008640 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e35103082a138cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f525600a640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 0x7f523c0a50c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5248012810 tx=0x7f5248004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.321+0000 7f523bfff640 1 -- 172.21.15.39:0/2610232430 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524003f070 con 0x564b6ba9abe0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f523bfff640 1 -- 172.21.15.39:0/2610232430 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5240031870 con 0x564b6ba9abe0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f523bfff640 1 -- 172.21.15.39:0/2610232430 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240035070 con 0x564b6ba9abe0 2024-09-12T02:02:44.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 -- 172.21.15.39:0/2610232430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 msgr2=0x564b6ba9cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240032d60 comp rx=0 tx=0).stop 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 -- 172.21.15.39:0/2610232430 shutdown_connections 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba9cfd0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 --2- 172.21.15.39:0/2610232430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba8fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 -- 172.21.15.39:0/2610232430 >> 172.21.15.39:0/2610232430 conn(0x564b6ba8bf90 msgr2=0x564b6ba8c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 -- 172.21.15.39:0/2610232430 shutdown_connections 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.322+0000 7f5259e46740 1 -- 172.21.15.39:0/2610232430 wait complete. 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 -- start start 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 Processor -- start 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba9a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba977f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564b6baa1bc0 con 0x564b6ba9abe0 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b6b98ec50 con 0x564b6ba90320 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b6baa1d40 con 0x564b6ba8fa00 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f5259e46740 10 client.0 _ll_register_callbacks cb 0x564b6b9a0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f525600a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f525600a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58128/0 (socket says 172.21.15.39:58128) 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.323+0000 7f525600a640 1 -- 172.21.15.39:0/4214256217 learned_addr learned my addr 172.21.15.39:0/4214256217 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5255008640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5255809640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba9a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 -- 172.21.15.39:0/4214256217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 msgr2=0x564b6ba9a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba9a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 -- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 msgr2=0x564b6ba977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 -- 172.21.15.39:0/4214256217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6ba98580 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5255809640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba9a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f525600a640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f524800f6c0 tx=0x7f5248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb32207563301f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f52397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248018070 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5248027600 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5240031870 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5248027800 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5259e46740 10 client.16569 fetch_fsmap learned FSMap version 35 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564b6baad790 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.324+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5240031870 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f524801f8f0 con 0x564b6ba9abe0 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 10 client.16569 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 10 client.16569 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:02:44.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 20 client.16569 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6baaec50 0x564b6bab1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 4 client.16569 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b6ba01770 con 0x564b6baaec50 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5255809640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6baaec50 0x564b6bab1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f5255809640 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6baaec50 0x564b6bab1040 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d032410ee5d4e162 server_cookie=9bb464b9d1b2b706 in_seq=0 out_seq=0 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.325+0000 7f52397fa640 10 client.16569 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.326+0000 7f52397fa640 1 -- 172.21.15.39:0/4214256217 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b6ba01770 con 0x564b6baaec50 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.326+0000 7f52397fa640 10 client.16569 handle_command_reply: tid=0 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.326+0000 7f5259e46740 1 client.16569 shutdown 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.326+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 msgr2=0x564b6ba97d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.326+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f524800f6c0 tx=0x7f5248004a40 comp rx=0 tx=0).stop 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 shutdown_connections 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6baaec50 0x564b6bab1040 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6ba97d50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba90320 0x564b6ba977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 --2- 172.21.15.39:0/4214256217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba8fa00 0x564b6ba9a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f52397fa640 0 client.16569 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 >> 172.21.15.39:0/4214256217 conn(0x564b6ba8bf90 msgr2=0x564b6ba8b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 shutdown_connections 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 1 -- 172.21.15.39:0/4214256217 wait complete. 2024-09-12T02:02:44.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.327+0000 7f5259e46740 20 client.16569 trim_cache size 0 max 16384 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 Processor -- start 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 -- start start 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba8fa00 0x564b6ba996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6ba960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f52501adc20 con 0x564b6ba9abe0 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52501ab4f0 con 0x564b6ba8fa00 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.344+0000 7f5259e46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52501a9360 con 0x564b6ba90320 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58138/0 (socket says 172.21.15.39:58138) 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 -- 172.21.15.39:0/3417597820 learned_addr learned my addr 172.21.15.39:0/3417597820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f5255809640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba8fa00 0x564b6ba996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f5255008640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6ba960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 -- 172.21.15.39:0/3417597820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 msgr2=0x564b6ba960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6ba960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 -- 172.21.15.39:0/3417597820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba8fa00 msgr2=0x564b6ba996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba8fa00 0x564b6ba996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 -- 172.21.15.39:0/3417597820 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6bab1670 con 0x564b6ba9abe0 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f5255008640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6ba960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:44.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f525600a640 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f524801fd90 tx=0x7f524800a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf2f955fdd68903 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f523b7fe640 1 -- 172.21.15.39:0/3417597820 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248018070 con 0x564b6ba9abe0 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f523b7fe640 1 -- 172.21.15.39:0/3417597820 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524800fb80 con 0x564b6ba9abe0 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.345+0000 7f523b7fe640 1 -- 172.21.15.39:0/3417597820 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524801f880 con 0x564b6ba9abe0 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- 172.21.15.39:0/3417597820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 msgr2=0x564b6baaae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f524801fd90 tx=0x7f524800a520 comp rx=0 tx=0).stop 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- 172.21.15.39:0/3417597820 shutdown_connections 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba9abe0 0x564b6baaae20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6ba960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 --2- 172.21.15.39:0/3417597820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba8fa00 0x564b6ba996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- 172.21.15.39:0/3417597820 >> 172.21.15.39:0/3417597820 conn(0x564b6ba8bf90 msgr2=0x564b6ba92d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- 172.21.15.39:0/3417597820 shutdown_connections 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- 172.21.15.39:0/3417597820 wait complete. 2024-09-12T02:02:44.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.346+0000 7f5259e46740 1 -- start start 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 Processor -- start 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6baa3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba9abe0 0x564b6bb18890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f52501a99b0 con 0x564b6ba8fa00 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52501aae20 con 0x564b6ba9abe0 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52501aa080 con 0x564b6ba90320 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5259e46740 10 client.0 _ll_register_callbacks cb 0x7f524800ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58154/0 (socket says 172.21.15.39:58154) 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 -- 172.21.15.39:0/3489458895 learned_addr learned my addr 172.21.15.39:0/3489458895 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:44.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f525600a640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba9abe0 0x564b6bb18890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255008640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6baa3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 -- 172.21.15.39:0/3489458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 msgr2=0x564b6baa3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6baa3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 -- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba9abe0 msgr2=0x564b6bb18890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba9abe0 0x564b6bb18890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255809640 1 -- 172.21.15.39:0/3489458895 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6bb18dd0 con 0x564b6ba8fa00 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.347+0000 7f5255008640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6baa3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5255809640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f524c09b4d0 tx=0x7f524c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4283043b450ab4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c020040 con 0x564b6ba8fa00 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f524c099840 con 0x564b6ba8fa00 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f524800fb80 con 0x564b6ba8fa00 2024-09-12T02:02:44.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f524c09f8f0 con 0x564b6ba8fa00 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 10 client.16575 fetch_fsmap learned FSMap version 35 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564b6bb1a0f0 con 0x564b6ba8fa00 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524800fb80 con 0x564b6ba8fa00 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 35) ==== 8354+0+0 (secure 0 0 0) 0x7f524c09f560 con 0x564b6ba8fa00 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 10 client.16575 fetch_fsmap finished waiting for FSMap version 35 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 10 client.16575 resolve_mds: validated gid 24503 aka daemon mds.b 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 20 client.16575 populate_metadata read hostname 'smithi039' 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6bb1a770 0x564b6bb1cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 4 client.16575 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.348+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 --> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x564b6b9fbc80 con 0x564b6bb1a770 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.349+0000 7f5255008640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6bb1a770 0x564b6bb1cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.349+0000 7f52397fa640 10 client.16575 ms_handle_connect on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.349+0000 7f5255008640 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6bb1a770 0x564b6bb1cb60 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1693983e0d9214bb server_cookie=78b5f0577e9603db in_seq=0 out_seq=0 2024-09-12T02:02:44.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.349+0000 7f52397fa640 1 -- 172.21.15.39:0/3489458895 <== mds.0 v2:172.21.15.44:6838/321221291 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x564b6b9fbc80 con 0x564b6bb1a770 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.349+0000 7f52397fa640 10 client.16575 handle_command_reply: tid=0 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 client.16575 shutdown 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 msgr2=0x564b6baa33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f524c09b4d0 tx=0x7f524c010d70 comp rx=0 tx=0).stop 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 shutdown_connections 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:6838/321221291,v1:172.21.15.44:6839/321221291] conn(0x564b6bb1a770 0x564b6bb1cb60 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b6ba9abe0 0x564b6bb18890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b6ba90320 0x564b6baa3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f52397fa640 0 client.16575 ms_handle_reset on v2:172.21.15.44:6838/321221291 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 --2- 172.21.15.39:0/3489458895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564b6ba8fa00 0x564b6baa33d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 >> 172.21.15.39:0/3489458895 conn(0x564b6ba8bf90 msgr2=0x564b6ba92d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 shutdown_connections 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 1 -- 172.21.15.39:0/3489458895 wait complete. 2024-09-12T02:02:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5259e46740 20 client.16575 trim_cache size 0 max 16384 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 35, 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout: "leader": 24503, 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout: "set_version": 20, 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout: "sets": {} 2024-09-12T02:02:44.356 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 msgr2=0x7f523c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 0x7f523c0a50c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5248012810 tx=0x7f5248004ab0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 msgr2=0x7f5250198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.350+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d950 tx=0x7f524c00de10 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 shutdown_connections 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f523c0a2c00 0x7f523c0a50c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5250106f50 0x7f525019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5250100ca0 0x7f5250198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 --2- 172.21.15.39:0/2046921564 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52501002f0 0x7f5250198540 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 >> 172.21.15.39:0/2046921564 conn(0x7f5250077210 msgr2=0x7f5250105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 shutdown_connections 2024-09-12T02:02:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:44.351+0000 7f5257a6d640 1 -- 172.21.15.39:0/2046921564 wait complete. 2024-09-12T02:02:44.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:44 smithi039 ceph-mon[31204]: pgmap v513: 97 pgs: 97 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 472 op/s 2024-09-12T02:02:44.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:44 smithi172 ceph-mon[35073]: pgmap v513: 97 pgs: 97 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 472 op/s 2024-09-12T02:02:44.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:44 smithi044 ceph-mon[35259]: pgmap v513: 97 pgs: 97 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 472 op/s 2024-09-12T02:02:45.156 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T02:02:45.156 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T02:02:45.166 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:02:45.175 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T02:02:45.211 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T02:02:45.211 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-12T02:02:45.212 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:02:45.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 -- 172.21.15.39:0/2039632437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2044101c20 msgr2=0x7f20441020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2039632437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2044101c20 0x7f20441020a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2034009900 tx=0x7f203402a410 comp rx=0 tx=0).stop 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 -- 172.21.15.39:0/2039632437 shutdown_connections 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2039632437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20441025e0 0x7f2044108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2039632437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2044101c20 0x7f20441020a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2039632437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f2044100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 -- 172.21.15.39:0/2039632437 >> 172.21.15.39:0/2039632437 conn(0x7f20440fc1b0 msgr2=0x7f20440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:45.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 -- 172.21.15.39:0/2039632437 shutdown_connections 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 -- 172.21.15.39:0/2039632437 wait complete. 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.331+0000 7f204b6c9640 1 Processor -- start 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 -- start start 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f204406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2044101c20 0x7f204419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f204410c710 con 0x7f20441025e0 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f204410c590 con 0x7f2044100a30 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f204410c890 con 0x7f2044101c20 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58166/0 (socket says 172.21.15.39:58166) 2024-09-12T02:02:45.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 -- 172.21.15.39:0/2010690383 learned_addr learned my addr 172.21.15.39:0/2010690383 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2048c64640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2044101c20 0x7f204419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049465640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f204406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 -- 172.21.15.39:0/2010690383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2044101c20 msgr2=0x7f204419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2044101c20 0x7f204419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 -- 172.21.15.39:0/2010690383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 msgr2=0x7f204406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f204406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 -- 172.21.15.39:0/2010690383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204419fab0 con 0x7f20441025e0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049465640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f204406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f2049c66640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f203c00b970 tx=0x7f203c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c019070 con 0x7f20441025e0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203c00cb40 con 0x7f20441025e0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204419fd40 con 0x7f20441025e0 2024-09-12T02:02:45.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.332+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c007650 con 0x7f20441025e0 2024-09-12T02:02:45.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.333+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20441a0280 con 0x7f20441025e0 2024-09-12T02:02:45.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.333+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2044107dc0 con 0x7f20441025e0 2024-09-12T02:02:45.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.335+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f203c01c070 con 0x7f20441025e0 2024-09-12T02:02:45.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.336+0000 7f203a7fc640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 0x7f20300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.336+0000 7f2049465640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 0x7f20300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.336+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f203c0cea70 con 0x7f20441025e0 2024-09-12T02:02:45.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.336+0000 7f2049465640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 0x7f20300a50d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2044101a80 tx=0x7f2040005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.339+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f203c09b9e0 con 0x7f20441025e0 2024-09-12T02:02:45.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.515+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f204402d9c0 con 0x7f20441025e0 2024-09-12T02:02:45.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.517+0000 7f203a7fc640 1 -- 172.21.15.39:0/2010690383 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f203c09b2e0 con 0x7f20441025e0 2024-09-12T02:02:45.518 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:02:45.518 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T02:00:47.251765+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:02:45.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 msgr2=0x7f20300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 0x7f20300a50d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2044101a80 tx=0x7f2040005db0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 msgr2=0x7f204419f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f203c00b970 tx=0x7f203c00be30 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 shutdown_connections 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f20441025e0 0x7f204419f1a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f20300a2c10 0x7f20300a50d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2044101c20 0x7f204419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 --2- 172.21.15.39:0/2010690383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2044100a30 0x7f204406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 >> 172.21.15.39:0/2010690383 conn(0x7f20440fc1b0 msgr2=0x7f2044104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 shutdown_connections 2024-09-12T02:02:45.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.519+0000 7f204b6c9640 1 -- 172.21.15.39:0/2010690383 wait complete. 2024-09-12T02:02:45.531 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:50:23.669815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:55:04.470714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:55:06.558788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:02:45.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:02:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- 172.21.15.39:0/821679326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 msgr2=0x7f0270109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 --2- 172.21.15.39:0/821679326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f0270109f70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0268009ca0 tx=0x7f026802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- 172.21.15.39:0/821679326 shutdown_connections 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 --2- 172.21.15.39:0/821679326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f0270109f70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 --2- 172.21.15.39:0/821679326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 --2- 172.21.15.39:0/821679326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- 172.21.15.39:0/821679326 >> 172.21.15.39:0/821679326 conn(0x7f02700fd290 msgr2=0x7f02700ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- 172.21.15.39:0/821679326 shutdown_connections 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- 172.21.15.39:0/821679326 wait complete. 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 Processor -- start 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.638+0000 7f027791f640 1 -- start start 2024-09-12T02:02:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f027010d7b0 con 0x7f02701036e0 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f027010d630 con 0x7f0270102d20 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f027010d930 con 0x7f0270101b30 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58180/0 (socket says 172.21.15.39:58180) 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 -- 172.21.15.39:0/2347139219 learned_addr learned my addr 172.21.15.39:0/2347139219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0274eba640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f02756bb640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 -- 172.21.15.39:0/2347139219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 msgr2=0x7f0270197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 -- 172.21.15.39:0/2347139219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 msgr2=0x7f02701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 -- 172.21.15.39:0/2347139219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027019fa80 con 0x7f02701036e0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0274eba640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f02756bb640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f0275ebc640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0268005e30 tx=0x7f0268031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268003c30 con 0x7f02701036e0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0268003dd0 con 0x7f02701036e0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027019fd10 con 0x7f02701036e0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.639+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026802fde0 con 0x7f02701036e0 2024-09-12T02:02:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.640+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701a0250 con 0x7f02701036e0 2024-09-12T02:02:45.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.641+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270108f20 con 0x7f02701036e0 2024-09-12T02:02:45.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.642+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0268004050 con 0x7f02701036e0 2024-09-12T02:02:45.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.642+0000 7f02667fc640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 0x7f025c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.643+0000 7f02756bb640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 0x7f025c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.643+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f02680f0620 con 0x7f02701036e0 2024-09-12T02:02:45.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.643+0000 7f02756bb640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 0x7f025c0a50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f026c0058c0 tx=0x7f026c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.646+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02680bd590 con 0x7f02701036e0 2024-09-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.822+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0270062e90 con 0x7f02701036e0 2024-09-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.822+0000 7f02667fc640 1 -- 172.21.15.39:0/2347139219 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7f02680bce90 con 0x7f02701036e0 2024-09-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-12T02:02:45.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 msgr2=0x7f025c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 0x7f025c0a50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f026c0058c0 tx=0x7f026c005850 comp rx=0 tx=0).stop 2024-09-12T02:02:45.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 msgr2=0x7f027019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0268005e30 tx=0x7f0268031ee0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 shutdown_connections 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f02701036e0 0x7f027019f410 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0270102d20 0x7f02701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f025c0a2c10 0x7f025c0a50d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 --2- 172.21.15.39:0/2347139219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0270101b30 0x7f0270197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 >> 172.21.15.39:0/2347139219 conn(0x7f02700fd290 msgr2=0x7f02701060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 shutdown_connections 2024-09-12T02:02:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.824+0000 7f027791f640 1 -- 172.21.15.39:0/2347139219 wait complete. 2024-09-12T02:02:45.836 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:02:45.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/207375454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e8100a30 msgr2=0x7fb2e8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/207375454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e8100a30 0x7fb2e8100e30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009900 tx=0x7fb2d802a410 comp rx=0 tx=0).stop 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/207375454 shutdown_connections 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/207375454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e81025e0 0x7fb2e8108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/207375454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8101c20 0x7fb2e81020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/207375454 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e8100a30 0x7fb2e8100e30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/207375454 >> 172.21.15.39:0/207375454 conn(0x7fb2e80fc1b0 msgr2=0x7fb2e80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.947+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/207375454 shutdown_connections 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/207375454 wait complete. 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 Processor -- start 2024-09-12T02:02:45.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 -- start start 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8100a30 0x7fb2e806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 0x7fb2e819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810c6b0 con 0x7fb2e81025e0 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810c530 con 0x7fb2e8100a30 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2ed6d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810c830 con 0x7fb2e8101c20 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8100a30 0x7fb2e806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58208/0 (socket says 172.21.15.39:58208) 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.948+0000 7fb2e77fe640 1 -- 172.21.15.39:0/2055108967 learned_addr learned my addr 172.21.15.39:0/2055108967 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2dffff640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 0x7fb2e819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 -- 172.21.15.39:0/2055108967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 msgr2=0x7fb2e819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 0x7fb2e819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 -- 172.21.15.39:0/2055108967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8100a30 msgr2=0x7fb2e806aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8100a30 0x7fb2e806aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 -- 172.21.15.39:0/2055108967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e819fae0 con 0x7fb2e81025e0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2dffff640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 0x7fb2e819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e77fe640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000eaa0 tx=0x7fb2e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000cdb0 con 0x7fb2e81025e0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e819fd70 con 0x7fb2e81025e0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e0005020 con 0x7fb2e81025e0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00116d0 con 0x7fb2e81025e0 2024-09-12T02:02:45.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.949+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e81a0230 con 0x7fb2e81025e0 2024-09-12T02:02:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.951+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e8107e40 con 0x7fb2e81025e0 2024-09-12T02:02:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.952+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb2e00054d0 con 0x7fb2e81025e0 2024-09-12T02:02:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.952+0000 7fb2e4ff9640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 0x7fb2d40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:45.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.952+0000 7fb2e6ffd640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 0x7fb2d40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.953+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb2e00cf250 con 0x7fb2e81025e0 2024-09-12T02:02:45.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.953+0000 7fb2e6ffd640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 0x7fb2d40a5050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009230 tx=0x7fb2d80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:45.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:45.956+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2e0016030 con 0x7fb2e81025e0 2024-09-12T02:02:46.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.146+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb2e8062e90 con 0x7fb2e81025e0 2024-09-12T02:02:46.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.146+0000 7fb2e4ff9640 1 -- 172.21.15.39:0/2055108967 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7fb2e009c1c0 con 0x7fb2e81025e0 2024-09-12T02:02:46.147 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 msgr2=0x7fb2d40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 0x7fb2d40a5050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009230 tx=0x7fb2d80315b0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 msgr2=0x7fb2e819f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000eaa0 tx=0x7fb2e000ef60 comp rx=0 tx=0).stop 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 shutdown_connections 2024-09-12T02:02:46.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2e81025e0 0x7fb2e819f1d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fb2d40a2b90 0x7fb2d40a5050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e8101c20 0x7fb2e819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 --2- 172.21.15.39:0/2055108967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2e8100a30 0x7fb2e806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 >> 172.21.15.39:0/2055108967 conn(0x7fb2e80fc1b0 msgr2=0x7fb2e8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 shutdown_connections 2024-09-12T02:02:46.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.149+0000 7fb2ed6d2640 1 -- 172.21.15.39:0/2055108967 wait complete. 2024-09-12T02:02:46.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:02:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1099310214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9141025b0 msgr2=0x7fe9141049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1099310214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9141025b0 0x7fe9141049a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe910009900 tx=0x7fe91002a410 comp rx=0 tx=0).stop 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1099310214 shutdown_connections 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1099310214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 0x7fe914109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1099310214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914104ee0 0x7fe9141072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1099310214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9141025b0 0x7fe9141049a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.267+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1099310214 >> 172.21.15.39:0/1099310214 conn(0x7fe9140fc1b0 msgr2=0x7fe9140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1099310214 shutdown_connections 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1099310214 wait complete. 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 Processor -- start 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- start start 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9141025b0 0x7fe914197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 0x7fe91419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe91410d860 con 0x7fe914104ee0 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe91410d6e0 con 0x7fe914107810 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe91bc4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe91410d9e0 con 0x7fe9141025b0 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe9191e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.268+0000 7fe9191e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58226/0 (socket says 172.21.15.39:58226) 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 -- 172.21.15.39:0/1473507954 learned_addr learned my addr 172.21.15.39:0/1473507954 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe91a1e9640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 0x7fe91419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9199e8640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9141025b0 0x7fe914197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 -- 172.21.15.39:0/1473507954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9141025b0 msgr2=0x7fe914197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9141025b0 0x7fe914197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 -- 172.21.15.39:0/1473507954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 msgr2=0x7fe91419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 0x7fe91419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 -- 172.21.15.39:0/1473507954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91419fb90 con 0x7fe914104ee0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe9191e7640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d740 tx=0x7fe90800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908017070 con 0x7fe914104ee0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe90800de50 con 0x7fe914104ee0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91419fe80 con 0x7fe914104ee0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908004e00 con 0x7fe914104ee0 2024-09-12T02:02:46.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.269+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a02f0 con 0x7fe914104ee0 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.270+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9140fdca0 con 0x7fe914104ee0 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.272+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe908004fa0 con 0x7fe914104ee0 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.272+0000 7fe906ffd640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 0x7fe9000a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.272+0000 7fe9199e8640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 0x7fe9000a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.272+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe9080cecc0 con 0x7fe914104ee0 2024-09-12T02:02:46.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.273+0000 7fe9199e8640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 0x7fe9000a5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe910031610 tx=0x7fe910005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.275+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe90809b5e0 con 0x7fe914104ee0 2024-09-12T02:02:46.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.451+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe91402da10 con 0x7fe914104ee0 2024-09-12T02:02:46.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.452+0000 7fe906ffd640 1 -- 172.21.15.39:0/1473507954 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7fe90809f8e0 con 0x7fe914104ee0 2024-09-12T02:02:46.453 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 msgr2=0x7fe9000a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 0x7fe9000a5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe910031610 tx=0x7fe910005a20 comp rx=0 tx=0).stop 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 msgr2=0x7fe9141984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d740 tx=0x7fe90800dc00 comp rx=0 tx=0).stop 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 shutdown_connections 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe914107810 0x7fe91419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe914104ee0 0x7fe9141984b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe9000a2b90 0x7fe9000a5050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 --2- 172.21.15.39:0/1473507954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9141025b0 0x7fe914197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 >> 172.21.15.39:0/1473507954 conn(0x7fe9140fc1b0 msgr2=0x7fe914103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 shutdown_connections 2024-09-12T02:02:46.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.454+0000 7fe91bc4c640 1 -- 172.21.15.39:0/1473507954 wait complete. 2024-09-12T02:02:46.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.570+0000 7f97649cf640 1 -- 172.21.15.39:0/76694334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760101b30 msgr2=0x7f9760101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.570+0000 7f97649cf640 1 --2- 172.21.15.39:0/76694334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760101b30 0x7f9760101f30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9750009900 tx=0x7f975002a410 comp rx=0 tx=0).stop 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 -- 172.21.15.39:0/76694334 shutdown_connections 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 --2- 172.21.15.39:0/76694334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97601036e0 0x7f9760109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 --2- 172.21.15.39:0/76694334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9760102d20 0x7f97601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 --2- 172.21.15.39:0/76694334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760101b30 0x7f9760101f30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 -- 172.21.15.39:0/76694334 >> 172.21.15.39:0/76694334 conn(0x7f97600fd2b0 msgr2=0x7f97600ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 -- 172.21.15.39:0/76694334 shutdown_connections 2024-09-12T02:02:46.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 -- 172.21.15.39:0/76694334 wait complete. 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 Processor -- start 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.571+0000 7f97649cf640 1 -- start start 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 0x7f9760197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601036e0 0x7f976019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f976010d800 con 0x7f9760102d20 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f976010d680 con 0x7f97601036e0 2024-09-12T02:02:46.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f976010d980 con 0x7f9760101b30 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58240/0 (socket says 172.21.15.39:58240) 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 -- 172.21.15.39:0/2999068869 learned_addr learned my addr 172.21.15.39:0/2999068869 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975ed9d640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601036e0 0x7f976019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975e59c640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 0x7f9760197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 -- 172.21.15.39:0/2999068869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 msgr2=0x7f9760197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 0x7f9760197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 -- 172.21.15.39:0/2999068869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601036e0 msgr2=0x7f976019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601036e0 0x7f976019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 -- 172.21.15.39:0/2999068869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976019faa0 con 0x7f9760102d20 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975e59c640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 0x7f9760197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:02:46.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f975dd9b640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f975400d950 tx=0x7f975400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754017030 con 0x7f9760102d20 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9754004020 con 0x7f9760102d20 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976019fd90 con 0x7f9760102d20 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540047a0 con 0x7f9760102d20 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.572+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97601a0280 con 0x7f9760102d20 2024-09-12T02:02:46.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.573+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9760108e70 con 0x7f9760102d20 2024-09-12T02:02:46.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.575+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97540041d0 con 0x7f9760102d20 2024-09-12T02:02:46.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.575+0000 7f974f7fe640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 0x7f97480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:02:46.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.575+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f97540ceb30 con 0x7f9760102d20 2024-09-12T02:02:46.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.575+0000 7f975e59c640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 0x7f97480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:02:46.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.576+0000 7f975e59c640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 0x7f97480a5050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f975002a930 tx=0x7f9750000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:02:46.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.580+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f975409baa0 con 0x7f9760102d20 2024-09-12T02:02:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:46 smithi172 ceph-mon[35073]: pgmap v514: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-09-12T02:02:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:46 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2010690383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:02:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:46 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2347139219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:02:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:46 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2055108967' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:02:46.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:46 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1473507954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:02:46.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.807+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9760062e90 con 0x7f9760102d20 2024-09-12T02:02:46.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.815+0000 7f974f7fe640 1 -- 172.21.15.39:0/2999068869 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740367 (secure 0 0 0) 0x7f975409b3a0 con 0x7f9760102d20 2024-09-12T02:02:46.826 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 18, 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "active_gid": 14150, 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "active_name": "x", 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addrs": { 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6800", 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 571724551 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.827 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6801", 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 571724551 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addr": "172.21.15.39:6801/571724551", 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "active_change": "2024-09-12T01:48:03.155672+0000", 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "available": true, 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: "standbys": [ 2024-09-12T02:02:46.828 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24106, 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "z", 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.829 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.830 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.831 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.832 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.833 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.834 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.835 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.836 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.837 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.839 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:02:46.840 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.841 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:02:46.842 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:02:46.843 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.844 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.845 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:02:46.846 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.847 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.849 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:02:46.850 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:02:46.851 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.852 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.853 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.854 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.855 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.856 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.857 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.859 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:02:46.860 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.861 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:46.862 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:46.863 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.864 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:02:46.865 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:02:46.866 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:02:46.867 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.868 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:46.870 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.871 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.872 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.873 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.874 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.875 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:02:46.876 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.877 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.878 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.879 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.880 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.881 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.882 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.883 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.884 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.885 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:02:46.886 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.887 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.888 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.889 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.890 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.891 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.892 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:02:46.893 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:02:46.894 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.895 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.895 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.896 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:02:46.897 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.898 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.899 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:02:46.900 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.901 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.902 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.903 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:02:46.904 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.905 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.906 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.907 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.908 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.909 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:46.910 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:46.911 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.912 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.913 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.914 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:46.919 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:02:46.922 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.923 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.924 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.925 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.926 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.927 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.928 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.929 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.930 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.931 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:02:46.932 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:02:46.933 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:02:46.934 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.935 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.936 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.937 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.938 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.939 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:46.940 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:02:46.941 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.942 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.944 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.945 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.946 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.947 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.948 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.949 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:02:46.950 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:02:46.951 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.952 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.953 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.954 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.955 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.956 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.957 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.958 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.959 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.960 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.961 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.962 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.963 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.964 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.965 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.966 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.967 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.968 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.969 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:02:46.970 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:02:46.971 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:02:46.972 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:02:46.973 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.975 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.976 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.977 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.978 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.979 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.980 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:02:46.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.982 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.983 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.984 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.985 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.986 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.987 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:02:46.988 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:02:46.989 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.990 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.991 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.992 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.993 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.994 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.995 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:46.998 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:46.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.000 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:02:47.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.002 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.003 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.004 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.006 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.007 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:47.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.009 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:02:47.010 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.012 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.014 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.015 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.017 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.018 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.022 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.024 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.025 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.027 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.028 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.029 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.030 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:02:47.033 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:02:47.034 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.035 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.036 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:02:47.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.039 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.040 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.041 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.043 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:02:47.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.045 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.046 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.048 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.053 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.054 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.057 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:02:47.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:02:47.070 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.072 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:02:47.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.079 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.080 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:02:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.082 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.083 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.085 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.086 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.088 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.089 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.091 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.092 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.099 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.103 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.106 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:02:47.108 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.109 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.110 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.112 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.115 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.116 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.124 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.126 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.127 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.128 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.134 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.150 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:02:47.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.155 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.156 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.157 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.158 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.159 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.164 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.165 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.166 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.167 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.170 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.173 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.174 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.178 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.181 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.184 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.188 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.190 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.191 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:02:47.194 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:02:47.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:02:47.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:02:47.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.209 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.223 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.224 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.228 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.229 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.231 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:02:47.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:02:47.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.237 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.245 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.247 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.251 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:02:47.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.254 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.256 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.259 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.261 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.262 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.266 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:02:47.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:02:47.269 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:02:47.272 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:02:47.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:02:47.274 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.276 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.277 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.280 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.285 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24110, 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "y", 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.286 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.288 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.292 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:02:47.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:02:47.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.296 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.297 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.299 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.301 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:47.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:02:47.305 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.313 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.314 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:02:47.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.319 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.322 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:02:47.325 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:02:47.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.328 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:02:47.330 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:02:47.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:02:47.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.336 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:02:47.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:02:47.343 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:02:47.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:02:47.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.350 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.351 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.352 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.353 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:02:47.355 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.357 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.360 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:02:47.360 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.360 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.360 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.360 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.361 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.365 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.369 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.372 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:02:47.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.378 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.379 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:02:47.383 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.384 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.386 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.390 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.396 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:02:47.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:02:47.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.400 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.408 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:02:47.410 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:02:47.411 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:02:47.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.413 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.416 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.417 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.418 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.420 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.421 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.423 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.425 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:02:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:02:47.427 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:02:47.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.429 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.431 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.432 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.433 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.435 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.436 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.437 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.439 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.442 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:02:47.444 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:02:47.445 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:02:47.446 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.453 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.461 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.462 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:47.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.465 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.466 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.467 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.469 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.473 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.477 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:02:47.478 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:02:47.479 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.484 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.485 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.486 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.487 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.489 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.490 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.492 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.497 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.498 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:02:47.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.500 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.504 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.505 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.511 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.513 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.514 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.515 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.517 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.518 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.519 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.521 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.523 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.525 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.528 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.529 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.530 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.533 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.535 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.536 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.537 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.538 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.540 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.541 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.542 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.543 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.544 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.545 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.546 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.547 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.548 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:02:47.549 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.550 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.552 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.554 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:47.555 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:02:47.556 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.557 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.558 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.559 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.560 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.561 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.562 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.564 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.565 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.566 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.567 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.568 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.569 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.570 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.571 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.572 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.573 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.574 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.576 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.577 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.578 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.579 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.580 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.581 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.582 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:02:47.583 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.584 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.585 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.586 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.587 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.588 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.589 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.590 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:02:47.591 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.592 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.594 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.595 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.596 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.597 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.598 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.599 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.600 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.601 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.602 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.603 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.604 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.605 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:02:47.606 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:47.607 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.608 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.609 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.610 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.611 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.612 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.613 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.614 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:02:47.615 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.618 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.620 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.621 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.623 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.624 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.626 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.627 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.628 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.629 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.630 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.631 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.632 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.633 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.635 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.636 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.637 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.638 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.639 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.640 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.642 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.644 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.645 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.647 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:02:47.648 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:02:47.649 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.650 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:02:47.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.652 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.653 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.654 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.655 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.656 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.657 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.658 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.659 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.660 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.661 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.662 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.663 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.664 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.665 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.666 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.667 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.668 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.669 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.670 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.671 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.672 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.673 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.675 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.676 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.677 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.678 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:02:47.679 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.680 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.681 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.682 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.683 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.684 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.685 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.686 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:02:47.687 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:02:47.688 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.689 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.690 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.691 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.692 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.693 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.694 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.695 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.696 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.699 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.703 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.704 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.705 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.706 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.707 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.708 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.709 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.710 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.711 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.712 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.713 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.714 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:02:47.715 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.716 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.717 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.718 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.719 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.720 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:02:47.721 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.722 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.723 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.724 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.726 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.727 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.728 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.729 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.730 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.731 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.732 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.733 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.734 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.735 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.736 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "modules": [ 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:02:47.737 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "iostat", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "nfs", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "restful" 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.738 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.739 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.740 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.741 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.742 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.743 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.744 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.745 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.746 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.747 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.748 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.749 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.750 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.751 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.752 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.753 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.754 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:47.755 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:02:47.756 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.757 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:02:47.758 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:02:47.759 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.761 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.762 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.763 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.764 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.765 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.766 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.767 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:02:47.768 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.769 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.770 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.771 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.772 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.773 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:02:47.774 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.775 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.776 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.777 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:47.778 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.779 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.780 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.781 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.784 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.786 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.787 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:02:47.788 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.789 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.790 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.791 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.792 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:02:47.793 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.794 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:02:47.795 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.796 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.797 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.798 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.799 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.800 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.801 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.802 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:02:47.803 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.804 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.805 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.806 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.807 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.808 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.809 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:02:47.810 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:02:47.811 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.812 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:02:47.813 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.814 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.815 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.816 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.817 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.818 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.819 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.820 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.821 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.822 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:02:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.824 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.825 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.826 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.827 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.828 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:02:47.829 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:02:47.830 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.831 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.832 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.833 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.834 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.835 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.836 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.844 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:02:47.850 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:02:47.851 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:02:47.852 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.853 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.854 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.855 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.856 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.857 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.858 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.859 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.860 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.861 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.862 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.863 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.864 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.865 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.866 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.867 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.869 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.870 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.871 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:02:47.872 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:02:47.873 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:02:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:02:47.875 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.876 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.877 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.879 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.880 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.881 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.882 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.883 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.884 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.885 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.886 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.887 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.888 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.889 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.890 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.891 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:02:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:02:47.893 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:02:47.894 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.895 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.897 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.898 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.899 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.900 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.902 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.904 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:02:47.905 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:47.906 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:47.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.908 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.909 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.910 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.911 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.912 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.913 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.914 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.916 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.917 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.918 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.919 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.920 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.921 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.922 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.923 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.924 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.927 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.928 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.929 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.930 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.931 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.932 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.933 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.934 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.935 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:02:47.936 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.937 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:02:47.938 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:02:47.939 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.940 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.941 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.942 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.943 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.944 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.947 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.950 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:02:47.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.952 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.953 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:02:47.954 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.955 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.956 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.957 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.958 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.959 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.960 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.962 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.964 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.966 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:02:47.967 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:47.968 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.969 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.970 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.971 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.973 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.974 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.975 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.976 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.977 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.978 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.979 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.980 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:02:47.981 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:02:47.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:02:47.983 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:02:47.984 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.985 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.987 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.988 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.990 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.991 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.992 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.993 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.994 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.995 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.996 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:47.997 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:47.998 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:47.999 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.000 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.004 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.006 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.007 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.008 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.009 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.011 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.013 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.014 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.020 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.021 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.022 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.023 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.024 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.025 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.026 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.027 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:48.029 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.030 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.031 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.032 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.033 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.035 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.036 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.037 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.038 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.039 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:02:48.041 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.042 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.047 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.051 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.054 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.055 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.056 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.058 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.060 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.061 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.062 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.063 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.065 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.067 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.070 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.072 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.074 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.075 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:02:48.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:02:48.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.078 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.082 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.085 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.089 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.091 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.092 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.094 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:02:48.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:02:48.101 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:02:48.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:02:48.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.104 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.106 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:02:48.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:02:48.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.112 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.113 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.122 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.127 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:02:48.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.135 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.138 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.139 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.142 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:02:48.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.157 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.164 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.166 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.167 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.168 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.170 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.171 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:02:48.173 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.175 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:02:48.176 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:02:48.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.178 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.179 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.180 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.181 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.182 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:02:48.184 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.185 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.186 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:02:48.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.188 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "services": { 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard": "https://172.21.15.39:8443/" 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "always_on_modules": { 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "octopus": [ 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:02:48.189 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "pacific": [ 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:02:48.190 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "quincy": [ 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "reef": [ 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:02:48.192 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "squid": [ 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "last_failure_osd_epoch": 3, 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "active_clients": [ 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2597866499 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "libcephsqlite", 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2590649112 2024-09-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1825046745 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 494997534 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 msgr2=0x7f97480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 0x7f97480a5050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f975002a930 tx=0x7f9750000bc0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 msgr2=0x7f97601983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f975400d950 tx=0x7f975400de10 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 shutdown_connections 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601036e0 0x7f976019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9760102d20 0x7f97601983c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f97480a2b90 0x7f97480a5050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 --2- 172.21.15.39:0/2999068869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9760101b30 0x7f9760197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 >> 172.21.15.39:0/2999068869 conn(0x7f97600fd2b0 msgr2=0x7f9760106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 shutdown_connections 2024-09-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:02:46.821+0000 7f97649cf640 1 -- 172.21.15.39:0/2999068869 wait complete. 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:47 smithi172 ceph-mon[35073]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:47 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2999068869' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:46 smithi039 ceph-mon[31204]: pgmap v514: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:46 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2010690383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:46 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2347139219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:46 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2055108967' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:46 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1473507954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:46 smithi044 ceph-mon[35259]: pgmap v514: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 404 op/s 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2010690383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2347139219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2055108967' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:46 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1473507954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:47 smithi044 ceph-mon[35259]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:48.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:47 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2999068869' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:02:48.260 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:02:48.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:02:48.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:47 smithi039 ceph-mon[31204]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:02:48.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:47 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2999068869' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:02:48.531 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:48.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:48 smithi039 ceph-mon[31204]: pgmap v515: 97 pgs: 97 active+clean; 47 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 952 KiB/s wr, 361 op/s 2024-09-12T02:02:48.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:48 smithi044 ceph-mon[35259]: pgmap v515: 97 pgs: 97 active+clean; 47 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 952 KiB/s wr, 361 op/s 2024-09-12T02:02:49.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:48 smithi172 ceph-mon[35073]: pgmap v515: 97 pgs: 97 active+clean; 47 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 952 KiB/s wr, 361 op/s 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:02:49.075 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001453004, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000292680, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:49.076 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 98, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 95728, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T02:02:49.077 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.008309641, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.006039509, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001177486, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 96, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004268635, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000044464 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.078 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 95728 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 136, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 131, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 456096, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 79216, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.020590071, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.008646746, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.014843419, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:49.079 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 131, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.010336755, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000078906 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 456096, 2024-09-12T02:02:49.080 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 79216 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:49.081 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:49.082 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:49.083 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148840, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 28, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:02:49.084 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:02:49.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 133, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 434473, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 133, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 133, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 434473, 2024-09-12T02:02:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:49.087 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:49.996 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-12T02:02:49.996 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-12T02:02:49.996 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-12T02:02:49.997 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:02:49.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:02:50.261 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:50.648 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:50 smithi039 ceph-mon[31204]: pgmap v516: 97 pgs: 97 active+clean; 37 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 940 KiB/s wr, 320 op/s 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:02:50.754 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001357286, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000271024, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:50.755 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 142, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 137, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 457824, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 82720, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:02:50.756 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.020642710, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.008262522, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.015410789, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 137, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.010008635, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000073055 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:50.757 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 457824, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 82720 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 103, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 96608, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.007877327, 2024-09-12T02:02:50.758 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.005673743, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001122278, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 101, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004861120, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000048129 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:50.759 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 96608 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:50.760 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:50.761 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:02:50.762 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148903, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 29, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:50.763 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:50.764 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 139, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 435356, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 139, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 139, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 435356, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:50.765 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:50.766 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:50.766 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:50.766 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:50.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:50 smithi172 ceph-mon[35073]: pgmap v516: 97 pgs: 97 active+clean; 37 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 940 KiB/s wr, 320 op/s 2024-09-12T02:02:50.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:50 smithi044 ceph-mon[35259]: pgmap v516: 97 pgs: 97 active+clean; 37 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 940 KiB/s wr, 320 op/s 2024-09-12T02:02:51.530 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T02:02:51.531 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T02:02:51.531 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-12T02:02:51.531 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:02:51.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:02:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:52.313 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:52.313 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 138, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 133, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 456640, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 80496, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.020836407, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.007803723, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.015234722, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 133, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.010092769, 2024-09-12T02:02:52.314 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000075885 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 456640, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 80496 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 100, 2024-09-12T02:02:52.315 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 96080, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.008022253, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.005721355, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001316160, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 98, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004426132, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000045164 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.316 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 96080 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:02:52.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.000369351, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000285546, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:52.318 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:52.319 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:52.320 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:52.321 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148840, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 28, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:02:52.322 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:52.323 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 135, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 434733, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 135, 2024-09-12T02:02:52.324 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 135, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 434733, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:52.325 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:52.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:52 smithi039 ceph-mon[31204]: pgmap v517: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 508 KiB/s wr, 207 op/s 2024-09-12T02:02:52.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:52 smithi044 ceph-mon[35259]: pgmap v517: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 508 KiB/s wr, 207 op/s 2024-09-12T02:02:53.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:52 smithi172 ceph-mon[35073]: pgmap v517: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 508 KiB/s wr, 207 op/s 2024-09-12T02:02:53.077 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T02:02:53.077 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T02:02:53.077 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-12T02:02:53.078 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:02:53.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:02:53.341 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001310884, 2024-09-12T02:02:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000248035, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.864 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 144, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 139, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 458368, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 84000, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.021193087, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.008570324, 2024-09-12T02:02:53.865 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.015926296, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 139, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.010946803, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000078753 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.866 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 458368, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 84000 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 104, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 96784, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 3, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.007870082, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.005748429, 2024-09-12T02:02:53.867 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001094558, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 102, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.004903516, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000048073 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:53.868 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 96784 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:53.869 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:53.870 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:53.871 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148967, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 29, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:02:53.872 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:02:53.873 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 141, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 435616, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 141, 2024-09-12T02:02:53.874 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 141, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 435616, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:02:53.875 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:02:54.638 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:02:54.638 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:02:54.638 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-12T02:02:54.638 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:02:54.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:02:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:02:54.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:54 smithi039 ceph-mon[31204]: pgmap v518: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 496 KiB/s wr, 167 op/s 2024-09-12T02:02:54.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:54 smithi044 ceph-mon[35259]: pgmap v518: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 496 KiB/s wr, 167 op/s 2024-09-12T02:02:55.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:54 smithi172 ceph-mon[35073]: pgmap v518: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 496 KiB/s wr, 167 op/s 2024-09-12T02:02:55.433 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 36221, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 32675, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 10272468, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 65802319, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 121, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 2.216545032, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.902956765, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.682606608, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.571408671, 2024-09-12T02:02:55.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 32677, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.895019848, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000119197 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10410, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001745823, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000167 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:02:55.435 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 68145, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 121238, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 21206201, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 78205605, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 12, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 4.106240315, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 1.650953138, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 2.906133302, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.577218236, 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:55.436 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 121233, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 8.438387230, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000069604 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 109236, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.020228629, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000185 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 49504, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 287152 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:55.437 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 29118, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 22574, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 9608178, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 16585294, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 10, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 1.514424188, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.596537221, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.658772719, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.312874406, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 22573, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2.791655011, 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000123672 2024-09-12T02:02:55.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 19409, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002585872, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000133 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 544432, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 91824 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:02:55.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 91990, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 25.861621371, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000281135 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:55.440 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2845, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.612741215, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000215374 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 19480, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 19464, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 19464, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 63.115846530, 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003242696 2024-09-12T02:02:55.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 16, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 30, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 10, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 892, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 23, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 1, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 33, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 8, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 10, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 15, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 21, 2024-09-12T02:02:55.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 5851, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 3, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 3, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 5, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 21669, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 21011, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 10, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 1, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 1346, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 128, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 4691, 2024-09-12T02:02:55.443 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 1, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 3193, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 2534, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 79216734, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 3193, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:02:55.444 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 152, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 5, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 147, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 3041, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 9, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 10931, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 17082, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 7863, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 17176, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 13572, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 484, 2024-09-12T02:02:55.445 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 12415 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 147, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 1, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 1893, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 1889, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 3, 2024-09-12T02:02:55.446 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 5, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 4647, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 5, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 129, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 24, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:02:55.447 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 43408, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 43357, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 43357, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 51, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 1307, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 71, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 70, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 70, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 1, 2024-09-12T02:02:55.448 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 1, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 2, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 96153868, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 96268984, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 25975, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 50.859863422, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001958031 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 33, 2024-09-12T02:02:55.449 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 6605, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 6572, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 31, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 295, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 264, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 33, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 7930, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 7897, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 3, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 6527, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 6524, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 107896, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 231712 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:02:55.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 37207, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 1597, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 19480, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 140, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 3196, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6432, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 26.111807629, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004059671 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 37, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.147989770, 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003999723 2024-09-12T02:02:55.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.006709328, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002236442 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1357, 2024-09-12T02:02:55.452 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.349618732, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002468399 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000222553, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000111276 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:02:55.453 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.454 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 73, 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.058414867, 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000800203 2024-09-12T02:02:55.455 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:02:55.456 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 425, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.081549262, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000191880 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 200, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.568374919, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002841874 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 94, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.179074624, 2024-09-12T02:02:55.457 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001905049 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 15, 2024-09-12T02:02:55.458 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.065992489, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004399499 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8982, 2024-09-12T02:02:55.459 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 29.417613286, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003275174 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002390070, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000298758 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.460 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 7, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.019606344, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002800906 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004056598, 2024-09-12T02:02:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000676099 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1823, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.102426059, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001701824 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.462 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 3641, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 3641, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 359, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 240, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 240, 2024-09-12T02:02:55.463 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:55.464 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:55.465 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 306297, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 98, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:55.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7496, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 154, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 143978, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 1014, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.467 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 74778, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 100813283, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 31, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 74778, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 74778, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 795.612685497, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.010639662 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 74778, 2024-09-12T02:02:55.468 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 86585 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 74778, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 3292, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 71486, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 628, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 5074, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 54, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 26024, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 127, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:02:55.469 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 7, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 2494, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 3237, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 10152, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:02:55.470 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 36717, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:02:55.471 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 83, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 3, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 1887, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 80, 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 104 2024-09-12T02:02:55.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 4641 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 27, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:02:55.473 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 10, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 1916, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 1889, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 133480, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 29055210, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 133480, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:55.474 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 133480, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 29055210, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.475 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 74778, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 101003552, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 74778, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 101003552, 2024-09-12T02:02:55.476 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:55.477 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 74778, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 74778, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 74778, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 74778, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 1889, 2024-09-12T02:02:55.478 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 190789, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 1889, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 49, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 190789, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55c0c2162960": { 2024-09-12T02:02:55.479 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 599, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 43408, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 92074680, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 43408, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 25975, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 92074081, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:55.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:55.481 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.481 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:55.481 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:02:56.543 INFO:tasks.check_counter:Daemon mds.b mds.exported=128 2024-09-12T02:02:56.543 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-12T02:02:56.543 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=23 2024-09-12T02:02:56.543 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:02:56.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:02:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:02:56.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:56 smithi039 ceph-mon[31204]: pgmap v519: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 161 KiB/s wr, 61 op/s 2024-09-12T02:02:56.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:56 smithi044 ceph-mon[35259]: pgmap v519: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 161 KiB/s wr, 61 op/s 2024-09-12T02:02:57.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:56 smithi172 ceph-mon[35073]: pgmap v519: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 161 KiB/s wr, 61 op/s 2024-09-12T02:02:57.327 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:02:57.327 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:57.327 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 622, 2024-09-12T02:02:57.327 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 604, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 682464, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 230364, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.070785193, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.027605024, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.029439438, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.012191214, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 604, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.034225324, 2024-09-12T02:02:57.328 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000056664 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 528576, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 84720 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 24, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 126, 2024-09-12T02:02:57.329 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 2601853, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 261936, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.009368499, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.004448548, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.003130999, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000608851, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 124, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.006258906, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050475 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:57.330 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 254560 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 873, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 875, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 12813492, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 277621, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-09-12T02:02:57.331 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.058564666, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.012516892, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.022330951, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.020181206, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 873, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.021589923, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000024730 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2291, 2024-09-12T02:02:57.333 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.053760512, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000023465 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.334 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:02:57.335 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 3745, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 106, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 3639, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 3593, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 3, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-12T02:02:57.336 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:02:57.337 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:02:57.338 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:02:57.339 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:02:57.340 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-12T02:02:57.341 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7927, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 11, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:02:57.342 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 19372915, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 19370631, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 7927 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 20, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 2694, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 2674, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 88, 2024-09-12T02:02:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 234, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 146, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 3745, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 5691, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 1946, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 56140, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-12T02:02:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.347 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.349 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.350 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:02:57.352 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.356 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:02:57.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:02:57.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 1713, 2024-09-12T02:02:57.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:57.360 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:57.361 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 189367, 2024-09-12T02:02:57.362 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 52, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7496, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 154, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:57.363 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 2799483, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 16930, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 1354, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-09-12T02:02:57.364 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 1354, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1354, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.439977700, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001063499 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1354, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1355 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 1354, 2024-09-12T02:02:57.365 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 1354, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 847, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 505, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:02:57.366 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-12T02:02:57.367 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:02:57.368 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 83, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 3, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 5, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 5, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-12T02:02:57.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:02:57.370 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 1515, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 15950303, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 1515, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:57.371 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1515, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 15950303, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:57.372 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 1354, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 15186257, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1354, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 15186257, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:57.373 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 1354, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 1354, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1354, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1354, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.374 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.375 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x560048e0eb40": { 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:02:57.376 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:57.377 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:02:58.154 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T02:02:58.154 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T02:02:58.154 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-12T02:02:58.154 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:02:58.155 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:02:58.406 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:02:58.846 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:02:58 smithi044 ceph-mon[35259]: pgmap v520: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T02:02:58.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:02:58 smithi039 ceph-mon[31204]: pgmap v520: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 6473, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 10014, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4310552, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 16111773, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 13, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.610538426, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.298794375, 2024-09-12T02:02:58.956 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.235855291, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.080806936, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10012, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.509760214, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050914 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10113, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002233803, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000220 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:02:58.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 11818, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 20412, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4337438, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 11553506, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 20, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.737756821, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.329150774, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.378359887, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.055506946, 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:58.958 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 20410, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.656404739, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000032160 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 21741, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004772498, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000219 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 543968, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 108288 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 6879, 2024-09-12T02:02:58.959 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 4453, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 2220977, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 3742964, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 10, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.349370187, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.122745290, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.251906006, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.035079915, 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:02:58.960 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4453, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.202085040, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000045381 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8276, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001109887, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000134 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:02:58.961 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 256096 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3065, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.994449956, 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001303246 2024-09-12T02:02:58.962 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4408, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.514925936, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000116816 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 5692, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 5629, 2024-09-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5629, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 6.487906233, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001152585 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 63, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 11, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:02:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 345, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 7, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 338, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 334, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 6, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 4, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 9053, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 8142, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 12, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 9, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:02:58.965 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 1, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 128, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 3000, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 2367, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4570, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 145709071, 2024-09-12T02:02:58.966 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 2367, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 1, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 1, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 2366, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 11, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 3344, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 3172, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:02:58.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 3517, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 613, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 95, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 4256 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 209, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-12T02:02:58.968 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 3, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 2670, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 2667, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 5, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 8231, 2024-09-12T02:02:58.969 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 1, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 1, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 7927, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:02:58.970 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7927, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 11, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 11, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 19372915, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:02:58.971 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1077, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 9.580038038, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.008895114 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 25, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 2695, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 2670, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 93, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 236, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 143, 2024-09-12T02:02:58.972 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 345, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 5697, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 5352, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 5062, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 5062, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 78164, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 223520 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 7097, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 2357, 2024-09-12T02:02:58.973 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 5692, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 8, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 5433, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 330, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.477721504, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001447640 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000175156, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000175156 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:02:58.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2459, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.772107094, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000313992 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.975 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:02:58.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 15, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.007004122, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000466941 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 154, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.144480938, 2024-09-12T02:02:58.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000938187 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.980 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 58, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.765054714, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.030431977 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.982 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.983 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:02:58.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2612, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.321362705, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001271578 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:58.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 4352, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 4352, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 1716, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:02:58.987 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:02:58.988 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:02:58.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 287126, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 98, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:02:58.990 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7496, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 154, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 450417, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 3520, 2024-09-12T02:02:58.991 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 6435, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 15581138, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 31, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 6435, 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:02:58.992 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6435, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 13.536787132, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002103618 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6435, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 6510 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 6435, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2426, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 4009, 2024-09-12T02:02:58.993 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 10, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 59, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 1136, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 39, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 2773, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:02:58.994 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 2367, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 20, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-12T02:02:58.995 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:02:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 83, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 3, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 82, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 24 2024-09-12T02:02:58.997 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 8236 2024-09-12T02:02:58.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 65, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 10, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 2758, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 2667, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:58.999 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 25166, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 8591025, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 25166, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 25166, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 8591025, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:59.000 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 6435, 2024-09-12T02:02:59.001 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 15850537, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6435, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 15850537, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:02:59.002 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 6435, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 6435, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6435, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 6435, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:59.003 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2667, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 269399, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2667, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 59, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 269399, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:59.004 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x559f64232960": { 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 7927, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 15178611, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 7927, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:02:59.005 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1077, 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 15178611, 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:02:59.006 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:02:59.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:02:58 smithi172 ceph-mon[35073]: pgmap v520: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T02:02:59.756 INFO:tasks.check_counter:Daemon mds.h mds.exported=1 2024-09-12T02:02:59.756 INFO:tasks.check_counter:Daemon mds.h mds.imported=128 2024-09-12T02:02:59.756 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-12T02:02:59.756 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:02:59.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:03:00.008 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:03:00.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:00 smithi039 ceph-mon[31204]: pgmap v521: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-12T02:03:00.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:00 smithi044 ceph-mon[35259]: pgmap v521: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-12T02:03:01.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:00 smithi172 ceph-mon[35073]: pgmap v521: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-12T02:03:01.633 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:03:01.633 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:03:01.633 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 4, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 4, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 448, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 0, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.003136051, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.000049305, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.002243724, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3, 2024-09-12T02:03:01.634 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004039270, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001346423 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 106, 2024-09-12T02:03:01.635 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 160, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 97136, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 3, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 2, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.006197650, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.004178940, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.000858019, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 104, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.006311611, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000060688 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:01.636 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 97136 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 143, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 140, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 456192, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 85472, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 2, 2024-09-12T02:03:01.637 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.020336797, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.008537144, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.016826631, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 139, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.006986762, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050264 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:03:01.638 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 456192, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 85472 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:03:01.639 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:03:01.640 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:03:01.641 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 148945, 2024-09-12T02:03:01.642 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 29, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 0, 2024-09-12T02:03:01.643 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 928, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 2, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:03:01.644 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 144, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 436006, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 144, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 144, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 436006, 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:03:01.645 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:03:01.646 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:03:02.413 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T02:03:02.413 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T02:03:02.413 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-12T02:03:02.413 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:03:02.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:03:02.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:02 smithi044 ceph-mon[35259]: pgmap v522: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:03:02.675 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:02.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:02 smithi172 ceph-mon[35073]: pgmap v522: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:03:02.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:02 smithi039 ceph-mon[31204]: pgmap v522: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:03:03.196 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 232, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 226, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 243656, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 81612, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.025373350, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.008153709, 2024-09-12T02:03:03.197 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.010581531, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.005730234, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 225, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.011567547, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000051411 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.198 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 186640, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 24368 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 242, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 272, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 16645155, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 213543, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.025632899, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.006379749, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.012533004, 2024-09-12T02:03:03.199 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.005121317, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 270, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.009271296, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000034338 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:03:03.200 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 136848 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 81, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 81, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4162568, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 24950, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.010461854, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.002378831, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.005912266, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.001607636, 2024-09-12T02:03:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 80, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008400380, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000105004 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:03:03.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 834, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.019527983, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000023414 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:03.203 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 32, 2024-09-12T02:03:03.205 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 2, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 30, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 29, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:03:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 2534, 2024-09-12T02:03:03.207 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 79216734, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:03:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-12T02:03:03.209 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:03:03.210 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:03:03.211 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 9792, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 9, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 96153868, 2024-09-12T02:03:03.212 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 96275489, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 96273468, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 9792 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 11, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 23, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 12, 2024-09-12T02:03:03.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 10, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 12, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 2, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 32, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 33, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 47620, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215328 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-12T02:03:03.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.215 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.216 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:03:03.217 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.218 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.219 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.220 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:03:03.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:03:03.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-12T02:03:03.226 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1691, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:03:03.227 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:03:03.228 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:03:03.229 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 205667, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 55, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:03:03.230 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7496, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 154, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 60745, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 350, 2024-09-12T02:03:03.231 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 498, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 498, 2024-09-12T02:03:03.232 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 498, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.315992436, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000634522 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 498, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 499 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 498, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 498, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:03:03.233 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 270, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 225, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:03:03.234 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:03:03.235 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:03:03.236 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 7, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 7, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:03:03.238 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 551, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 20996148, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 551, 2024-09-12T02:03:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 551, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 20996148, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:03.240 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 498, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 20722833, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 498, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 20722833, 2024-09-12T02:03:03.241 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:03:03.242 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 498, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 498, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 498, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 498, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.243 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:03:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55a7e45466e0": { 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:03.245 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:03.246 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:03:04.410 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:03:04.410 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T02:03:04.410 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-12T02:03:04.411 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:03:04.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:03:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:04.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:04 smithi172 ceph-mon[35073]: pgmap v523: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-12T02:03:04.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:04 smithi039 ceph-mon[31204]: pgmap v523: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-12T02:03:04.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:04 smithi044 ceph-mon[35259]: pgmap v523: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-12T02:03:05.179 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:03:05.179 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:03:05.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 256, 2024-09-12T02:03:05.179 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 258, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4261647, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 81472, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.028219428, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.007002042, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.010740541, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.007389435, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 256, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.011158645, 2024-09-12T02:03:05.180 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000043588 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 379, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 480, 2024-09-12T02:03:05.181 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 5535157, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 375737, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.043064939, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.013597367, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.015042641, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.010535961, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 479, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.024689266, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000051543 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:05.182 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 256800 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 851, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 835, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4932106, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 304654, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-12T02:03:05.183 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.088876209, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.028530927, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.035711241, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.023132014, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 834, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.037612176, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000045098 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.184 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 526128, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 85552 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:05.185 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2223, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.062975117, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000028328 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.186 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-12T02:03:05.187 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 2725, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 2725, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 2725, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-12T02:03:05.188 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:03:05.189 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:03:05.190 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-12T02:03:05.191 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:03:05.192 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:03:05.193 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 8124, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 11, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 18017913, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 18016775, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.194 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 8124 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 12, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2748, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2736, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 10, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 127, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 117, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 2725, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 5054, 2024-09-12T02:03:05.195 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 2329, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 56924, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215328 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.196 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:03:05.197 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.198 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.199 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.200 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.201 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.202 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:03:05.203 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.204 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.205 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.207 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:03:05.208 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1689, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:03:05.209 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:03:05.210 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:03:05.211 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 206384, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 62, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7496, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 154, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:03:05.212 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 1958488, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 11017, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1319, 2024-09-12T02:03:05.213 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1319, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1319, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.293969129, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000981022 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1319, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1320 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1319, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1319, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 825, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 492, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:03:05.215 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:03:05.216 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:03:05.217 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 83, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 3, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 7, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 7, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-12T02:03:05.218 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:03:05.219 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1482, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 14584270, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1482, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:05.220 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1482, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 14584270, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:05.221 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1319, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 13824464, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1319, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 13824464, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:03:05.222 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1319, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1319, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1319, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1319, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:03:05.224 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x5559d86aab40": { 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:05.225 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:05.226 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:03:06.009 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:03:06.009 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:03:06.009 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-12T02:03:06.010 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:03:06.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:03:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:06.653 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:06 smithi172 ceph-mon[35073]: pgmap v524: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 11788, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 20950, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4342930, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 14017968, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 20, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-12T02:03:06.762 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.694503289, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.309106781, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.362000578, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.043809279, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 20949, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.513843002, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024528 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 22353, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003674852, 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000164 2024-09-12T02:03:06.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 536336, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 95344 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3050, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3152, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1073371, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 4902820, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 14, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.243842418, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.105010938, 2024-09-12T02:03:06.764 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.055520345, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.066306233, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3150, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.167467379, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000053164 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000653, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000108 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T02:03:06.765 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 257888 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 12113, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 21168, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 5904055, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 10680601, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.737592272, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.306882499, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.389830148, 2024-09-12T02:03:06.766 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.059241494, 2024-09-12T02:03:06.768 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:06.768 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 21167, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.497902557, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000023522 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27545, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004256105, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000154 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:03:06.769 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3436, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.401943518, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001281124 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.770 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4335, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.638239141, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000147229 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 6032, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 6025, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6025, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.290837234, 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001044122 2024-09-12T02:03:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 7, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 3, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 12, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 1, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 11, 2024-09-12T02:03:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 11, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 678, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 12512, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 8751, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 6, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 38, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:03:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 100, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 618, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 100, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 2309, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 3510, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 1, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4570, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 145709071, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-12T02:03:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 3510, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 3510, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 3043, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 3176, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:03:06.775 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 3050, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 615, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 38, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 5579 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 38, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 100, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:03:06.776 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 2716, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 2716, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 5, 2024-09-12T02:03:06.777 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 8104, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 100, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 8124, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 8124, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:03:06.778 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 11, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 11, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 18017913, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1231, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 17.777645522, 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014441629 2024-09-12T02:03:06.779 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 16, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2787, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2771, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 14, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 126, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 112, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 12, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 5098, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 5086, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-12T02:03:06.780 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 4991, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 4991, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 83740, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223520 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 10857, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 4, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 6032, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 5, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 3254, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 445, 2024-09-12T02:03:06.781 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.456607176, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001026083 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.782 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2714, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.834078807, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000307324 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.783 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.785 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.786 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:03:06.787 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.787 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.787 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.787 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 150, 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.104618633, 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000697457 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:03:06.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:03:06.793 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2716, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.895532618, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001802478 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.794 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:03:06.795 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 4402, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 4402, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 347, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:03:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:03:06.797 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:03:06.798 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 286940, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 95, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:03:06.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7496, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 154, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 401905, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 5045, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:03:06.800 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 7608, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 14275841, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 32, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 7608, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7608, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 18.848549780, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002477464 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7608, 2024-09-12T02:03:06.801 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 7662 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 7608, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3545, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 4063, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 32, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 1263, 2024-09-12T02:03:06.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 21, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 2731, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 3510, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:03:06.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 83, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 3, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 56, 2024-09-12T02:03:06.806 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 6, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 13 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 8109 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:03:06.807 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 10, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 10, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 2716, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 2716, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 26947, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 8882320, 2024-09-12T02:03:06.808 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 26947, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 26947, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8882320, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:06.809 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 7608, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 14550109, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 7608, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 14550109, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.810 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 7608, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 7608, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 7608, 2024-09-12T02:03:06.811 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 7608, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2716, 2024-09-12T02:03:06.812 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 274316, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2716, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 32, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 274316, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:06.813 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55e14ab52960": { 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 8124, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 13823609, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 8124, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1231, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 13823609, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:06.814 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:06.815 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:06.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.815 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:06.815 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:03:06.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:06 smithi039 ceph-mon[31204]: pgmap v524: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:03:06.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:06 smithi044 ceph-mon[35259]: pgmap v524: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-12T02:03:07.737 INFO:tasks.check_counter:Daemon mds.i mds.exported=100 2024-09-12T02:03:07.738 INFO:tasks.check_counter:Daemon mds.i mds.imported=100 2024-09-12T02:03:07.738 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-12T02:03:07.738 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:03:07.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:03:07.988 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:03:08.516 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.001174248, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000243498, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:08.517 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.518 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 5, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 110, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3152, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 97936, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.007961663, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.004441247, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.002558156, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 109, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008769775, 2024-09-12T02:03:08.519 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000080456 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 97936 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 145, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 142, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 456736, 2024-09-12T02:03:08.520 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 86752, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.020181783, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.008664728, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.016017915, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 141, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.007852612, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000055692 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:08.521 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 456736, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 86752 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:03:08.522 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:03:08.523 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:03:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 148984, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 30, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:03:08.525 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:03:08.526 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 928, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 146, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 436266, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 146, 2024-09-12T02:03:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 146, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 436266, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:03:08.528 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:03:08.753 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:08 smithi172 ceph-mon[35073]: pgmap v525: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:03:08.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:08 smithi039 ceph-mon[31204]: pgmap v525: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:03:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:08 smithi044 ceph-mon[35259]: pgmap v525: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-12T02:03:09.180 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-12T02:03:09.180 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-12T02:03:09.180 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-12T02:03:09.181 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:03:09.192 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:03:09.192 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:03:09.192 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:09.215 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:03:09.215 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:09.275 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:03:09.586 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 -- 172.21.15.39:0/3678947878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c100a80 msgr2=0x7f454c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 --2- 172.21.15.39:0/3678947878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c100a80 0x7f454c100ee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4534009930 tx=0x7f453402a420 comp rx=0 tx=0).stop 2024-09-12T02:03:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 -- 172.21.15.39:0/3678947878 shutdown_connections 2024-09-12T02:03:10.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 --2- 172.21.15.39:0/3678947878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c101420 0x7f454c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 --2- 172.21.15.39:0/3678947878 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c100a80 0x7f454c100ee0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 --2- 172.21.15.39:0/3678947878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c106a80 0x7f454c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 -- 172.21.15.39:0/3678947878 >> 172.21.15.39:0/3678947878 conn(0x7f454c0fc7a0 msgr2=0x7f454c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 -- 172.21.15.39:0/3678947878 shutdown_connections 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.104+0000 7f4552364640 1 -- 172.21.15.39:0/3678947878 wait complete. 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 Processor -- start 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 -- start start 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 0x7f454c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c101420 0x7f454c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f454c111fa0 con 0x7f454c106a80 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f454c111e20 con 0x7f454c100a80 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.105+0000 7f4552364640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f454c112120 con 0x7f454c101420 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36144/0 (socket says 172.21.15.39:36144) 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 -- 172.21.15.39:0/3591671790 learned_addr learned my addr 172.21.15.39:0/3591671790 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4543fff640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c101420 0x7f454c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f454bfff640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 0x7f454c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 -- 172.21.15.39:0/3591671790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c101420 msgr2=0x7f454c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c101420 0x7f454c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 -- 172.21.15.39:0/3591671790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 msgr2=0x7f454c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 0x7f454c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 -- 172.21.15.39:0/3591671790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c19d470 con 0x7f454c106a80 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f454bfff640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 0x7f454c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4550901640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f454400eaa0 tx=0x7f454400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454400cdb0 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4544005020 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c19d760 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45440116b0 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.106+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c1a5040 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.107+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c100ee0 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.108+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4544005560 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.109+0000 7f4549ffb640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 0x7f45380a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.109+0000 7f454bfff640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 0x7f45380a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.109+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f45440cf250 con 0x7f454c106a80 2024-09-12T02:03:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.110+0000 7f454bfff640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 0x7f45380a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f453c005e00 tx=0x7f453c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.114+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4544016030 con 0x7f454c106a80 2024-09-12T02:03:10.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.301+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f454c109050 con 0x7f454c106a80 2024-09-12T02:03:10.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.301+0000 7f4549ffb640 1 -- 172.21.15.39:0/3591671790 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+592 (secure 0 0 0) 0x7f454409c1c0 con 0x7f454c106a80 2024-09-12T02:03:10.301 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2335103066 2024-09-13T01:48:03.155570+0000 2024-09-12T02:03:10.301 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/3802572076 2024-09-13T01:48:03.155570+0000 2024-09-12T02:03:10.301 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/3476444139 2024-09-13T01:47:38.554416+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/3476444139 2024-09-13T01:47:38.554416+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/3619036511 2024-09-13T01:48:03.155570+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/3026209487 2024-09-13T01:47:38.554416+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/4201782244 2024-09-13T01:48:03.155570+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/3215796392 2024-09-13T01:47:38.554416+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/4201782244 2024-09-13T01:48:03.155570+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2035365900 2024-09-13T01:47:38.554416+0000 2024-09-12T02:03:10.302 INFO:teuthology.orchestra.run.smithi039.stderr:listed 10 entries 2024-09-12T02:03:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 msgr2=0x7f45380a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 0x7f45380a50c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f453c005e00 tx=0x7f453c005c70 comp rx=0 tx=0).stop 2024-09-12T02:03:10.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 msgr2=0x7f454c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f454400eaa0 tx=0x7f454400ef60 comp rx=0 tx=0).stop 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 shutdown_connections 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f454c106a80 0x7f454c19cd90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f45380a2c00 0x7f45380a50c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f454c101420 0x7f454c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 --2- 172.21.15.39:0/3591671790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c100a80 0x7f454c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 >> 172.21.15.39:0/3591671790 conn(0x7f454c0fc7a0 msgr2=0x7f454c0fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 shutdown_connections 2024-09-12T02:03:10.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:10.304+0000 7f4552364640 1 -- 172.21.15.39:0/3591671790 wait complete. 2024-09-12T02:03:10.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:10 smithi039 ceph-mon[31204]: pgmap v526: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T02:03:10.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:10 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3591671790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:03:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:10 smithi044 ceph-mon[35259]: pgmap v526: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T02:03:10.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:10 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3591671790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:03:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:10 smithi172 ceph-mon[35073]: pgmap v526: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-12T02:03:11.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:10 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3591671790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:03:11.125 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:03:11.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:03:11.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:03:11.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.262 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:03:11.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.300 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:03:11.362 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:03:11.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.363 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:03:11.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-12T02:03:11.524 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:03:11.525 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:03:11.525 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:03:11.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3484 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/1b26510e2fb2a0384fc3eb973240c8331de080dc0d5d6dd2c36f5952506ce8ea/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/1b26510e2fb2a0384fc3eb973240c8331de080dc0d5d6dd2c36f5952506ce8ea/diff,workdir=/var/lib/containers/storage/overlay/1b26510e2fb2a0384fc3eb973240c8331de080dc0d5d6dd2c36f5952506ce8ea/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1109f0355953963346d53ca6877e973017d8fb5e50dca94f2400aaa0fce93038/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/1109f0355953963346d53ca6877e973017d8fb5e50dca94f2400aaa0fce93038/diff,workdir=/var/lib/containers/storage/overlay/1109f0355953963346d53ca6877e973017d8fb5e50dca94f2400aaa0fce93038/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/4338e6bbf2be49e1f93134b76bab0be9d8b4150d34f0ed9d9bf8d032cc788b03/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/4338e6bbf2be49e1f93134b76bab0be9d8b4150d34f0ed9d9bf8d032cc788b03/diff,workdir=/var/lib/containers/storage/overlay/4338e6bbf2be49e1f93134b76bab0be9d8b4150d34f0ed9d9bf8d032cc788b03/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5604650ac64339fe7e5e72b5cece2c3f41dc274c9cf68c5db78ff084fbbf2d9b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/5604650ac64339fe7e5e72b5cece2c3f41dc274c9cf68c5db78ff084fbbf2d9b/diff,workdir=/var/lib/containers/storage/overlay/5604650ac64339fe7e5e72b5cece2c3f41dc274c9cf68c5db78ff084fbbf2d9b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/004f0aed1e36d40606cb1196498e5122413ea39d1d2af0676fc7838e5035d787/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/004f0aed1e36d40606cb1196498e5122413ea39d1d2af0676fc7838e5035d787/diff,workdir=/var/lib/containers/storage/overlay/004f0aed1e36d40606cb1196498e5122413ea39d1d2af0676fc7838e5035d787/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/77a1bcc6d24eb6429154d98081b7e67a2fd7b650423cc66f65f6fae4a1b33125/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/77a1bcc6d24eb6429154d98081b7e67a2fd7b650423cc66f65f6fae4a1b33125/diff,workdir=/var/lib/containers/storage/overlay/77a1bcc6d24eb6429154d98081b7e67a2fd7b650423cc66f65f6fae4a1b33125/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/712f4dd3b4f7b51cc81d42af4acd1f736f10b70a8c09227e08fde015345a963a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/712f4dd3b4f7b51cc81d42af4acd1f736f10b70a8c09227e08fde015345a963a/diff,workdir=/var/lib/containers/storage/overlay/712f4dd3b4f7b51cc81d42af4acd1f736f10b70a8c09227e08fde015345a963a/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/da78a367859e076e84038473d99c9477f251d7a56a35420eb3b393bd0903546d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/da78a367859e076e84038473d99c9477f251d7a56a35420eb3b393bd0903546d/diff,workdir=/var/lib/containers/storage/overlay/da78a367859e076e84038473d99c9477f251d7a56a35420eb3b393bd0903546d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/484147a5e6cfbb7074e552cb74781ef832f6a847a84bd7206bc5fef10508bf99/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/484147a5e6cfbb7074e552cb74781ef832f6a847a84bd7206bc5fef10508bf99/diff,workdir=/var/lib/containers/storage/overlay/484147a5e6cfbb7074e552cb74781ef832f6a847a84bd7206bc5fef10508bf99/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3554bb36189bf01acad2ba5cead830a616f4a0703d09a9a1f89d1ff3e8368d70/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4E5FWGKQXGEGZSM5VEXZ5ZNK4D:/var/lib/containers/storage/overlay/l/OZZVLOQHEOMWGCNXCCEXTFQOTC,upperdir=/var/lib/containers/storage/overlay/3554bb36189bf01acad2ba5cead830a616f4a0703d09a9a1f89d1ff3e8368d70/diff,workdir=/var/lib/containers/storage/overlay/3554bb36189bf01acad2ba5cead830a616f4a0703d09a9a1f89d1ff3e8368d70/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-12T02:03:11.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.542 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:03:11.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:03:11.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-12T02:03:11.668 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-09-12T02:03:11.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:03:11.670 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:03:11.685 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:03:11.685 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:03:11.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:03:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 -- 172.21.15.39:0/4149123848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 msgr2=0x7f884410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 --2- 172.21.15.39:0/4149123848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884410ea90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f883c009ca0 tx=0x7f883c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 -- 172.21.15.39:0/4149123848 shutdown_connections 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 --2- 172.21.15.39:0/4149123848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884410ea90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 --2- 172.21.15.39:0/4149123848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844102790 0x7f88441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 --2- 172.21.15.39:0/4149123848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844101de0 0x7f88441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 -- 172.21.15.39:0/4149123848 >> 172.21.15.39:0/4149123848 conn(0x7f88440fd8c0 msgr2=0x7f88440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 -- 172.21.15.39:0/4149123848 shutdown_connections 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.446+0000 7f8848a8b640 1 -- 172.21.15.39:0/4149123848 wait complete. 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 Processor -- start 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 -- start start 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844101de0 0x7f884419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844102790 0x7f884419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8844111f70 con 0x7f8844106f10 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8844111df0 con 0x7f8844101de0 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8848a8b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88441120f0 con 0x7f8844102790 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8842d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8842d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53290/0 (socket says 172.21.15.39:53290) 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f8842d9d640 1 -- 172.21.15.39:0/3615240460 learned_addr learned my addr 172.21.15.39:0/3615240460 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.447+0000 7f883bfff640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844102790 0x7f884419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f884259c640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844101de0 0x7f884419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 -- 172.21.15.39:0/3615240460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844102790 msgr2=0x7f884419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844102790 0x7f884419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 -- 172.21.15.39:0/3615240460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844101de0 msgr2=0x7f884419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844101de0 0x7f884419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 -- 172.21.15.39:0/3615240460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884419f570 con 0x7f8844106f10 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8842d9d640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f883c031a20 tx=0x7f883c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c003c30 con 0x7f8844106f10 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f883c003dd0 con 0x7f8844106f10 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884419f800 con 0x7f8844106f10 2024-09-12T02:03:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c02fcf0 con 0x7f8844106f10 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.448+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441a7140 con 0x7f8844106f10 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.449+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88441021c0 con 0x7f8844106f10 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.450+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f883c004050 con 0x7f8844106f10 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.451+0000 7f883b7fe640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 0x7f88300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.451+0000 7f884259c640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 0x7f88300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.451+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f883c0f03a0 con 0x7f8844106f10 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.452+0000 7f884259c640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 0x7f88300a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.456+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f883c0bd460 con 0x7f8844106f10 2024-09-12T02:03:12.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.668+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88441a73a0 con 0x7f8844106f10 2024-09-12T02:03:12.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.669+0000 7f883b7fe640 1 -- 172.21.15.39:0/3615240460 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11914 (secure 0 0 0) 0x7f883c02fe90 con 0x7f8844106f10 2024-09-12T02:03:12.669 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:03:12.669 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":36,"btime":"2024-09-12T02:02:46:484007+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:02:46.228153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T02:03:12.670 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 36 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 msgr2=0x7f88300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 0x7f88300a50c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8834005fd0 tx=0x7f8834005850 comp rx=0 tx=0).stop 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 msgr2=0x7f884419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f883c031a20 tx=0x7f883c031a50 comp rx=0 tx=0).stop 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 shutdown_connections 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844106f10 0x7f884419ee90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f88300a2c00 0x7f88300a50c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844102790 0x7f884419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 --2- 172.21.15.39:0/3615240460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844101de0 0x7f884419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 >> 172.21.15.39:0/3615240460 conn(0x7f88440fd8c0 msgr2=0x7f88440fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 shutdown_connections 2024-09-12T02:03:12.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:12.671+0000 7f8848a8b640 1 -- 172.21.15.39:0/3615240460 wait complete. 2024-09-12T02:03:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:12 smithi172 ceph-mon[35073]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:03:13.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:12 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3615240460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:13.121 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:12 smithi039 ceph-mon[31204]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:03:13.121 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:12 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3615240460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:12 smithi044 ceph-mon[35259]: pgmap v527: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-12T02:03:13.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:12 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3615240460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:13.359 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:03:13.621 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 -- 172.21.15.39:0/1406575779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe068100ca0 msgr2=0x7fe068106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 --2- 172.21.15.39:0/1406575779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe068100ca0 0x7fe068106840 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009930 tx=0x7fe05c02a420 comp rx=0 tx=0).stop 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 -- 172.21.15.39:0/1406575779 shutdown_connections 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 --2- 172.21.15.39:0/1406575779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068106f50 0x7fe06810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 --2- 172.21.15.39:0/1406575779 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe068100ca0 0x7fe068106840 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 --2- 172.21.15.39:0/1406575779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0681002f0 0x7fe0681006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 -- 172.21.15.39:0/1406575779 >> 172.21.15.39:0/1406575779 conn(0x7fe068077210 msgr2=0x7fe0680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 -- 172.21.15.39:0/1406575779 shutdown_connections 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 -- 172.21.15.39:0/1406575779 wait complete. 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.089+0000 7fe0706bc640 1 Processor -- start 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 -- start start 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 0x7fe068198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe068106f50 0x7fe06819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe068111fa0 con 0x7fe0681002f0 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe068111e20 con 0x7fe068100ca0 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe0706bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe068112120 con 0x7fe068106f50 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53304/0 (socket says 172.21.15.39:53304) 2024-09-12T02:03:14.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 -- 172.21.15.39:0/893801783 learned_addr learned my addr 172.21.15.39:0/893801783 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06dc57640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 0x7fe068198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06ec59640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe068106f50 0x7fe06819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 -- 172.21.15.39:0/893801783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe068106f50 msgr2=0x7fe06819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe068106f50 0x7fe06819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 -- 172.21.15.39:0/893801783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 msgr2=0x7fe068198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 0x7fe068198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 -- 172.21.15.39:0/893801783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06819d4d0 con 0x7fe0681002f0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06dc57640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 0x7fe068198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.090+0000 7fe06e458640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d770 tx=0x7fe06000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.091+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017070 con 0x7fe0681002f0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.091+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06819d7c0 con 0x7fe0681002f0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.091+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe060005500 con 0x7fe0681002f0 2024-09-12T02:03:14.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.091+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060004e00 con 0x7fe0681002f0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.091+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0681a50a0 con 0x7fe0681002f0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.092+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0681033b0 con 0x7fe0681002f0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.093+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe060004fa0 con 0x7fe0681002f0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.093+0000 7fe0677fe640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 0x7fe0500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.094+0000 7fe06dc57640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 0x7fe0500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.094+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe0600cef90 con 0x7fe0681002f0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.094+0000 7fe06dc57640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 0x7fe0500a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe05c006010 tx=0x7fe05c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:14.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.096+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe06009bf00 con 0x7fe0681002f0 2024-09-12T02:03:14.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.309+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe06810a120 con 0x7fe0681002f0 2024-09-12T02:03:14.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.309+0000 7fe0677fe640 1 -- 172.21.15.39:0/893801783 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11914 (secure 0 0 0) 0x7fe06009b800 con 0x7fe0681002f0 2024-09-12T02:03:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:03:14.310 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":36,"btime":"2024-09-12T02:02:46:484007+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/371087519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":371087519},{"type":"v1","addr":"172.21.15.39:6835","nonce":371087519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/1615113005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":1615113005},{"type":"v1","addr":"172.21.15.39:6837","nonce":1615113005}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/3465657492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":3465657492},{"type":"v1","addr":"172.21.15.39:6839","nonce":3465657492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/1943939637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":1943939637},{"type":"v1","addr":"172.21.15.39:6841","nonce":1943939637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1133915680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1133915680},{"type":"v1","addr":"172.21.15.172:6833","nonce":1133915680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2844392088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2844392088},{"type":"v1","addr":"172.21.15.44:6833","nonce":2844392088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:55:08.326488+0000","modified":"2024-09-12T02:02:46.228153+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24503,"mds_1":24467,"mds_2":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1679490719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1679490719},{"type":"v1","addr":"172.21.15.172:6835","nonce":1679490719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4061596538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4061596538},{"type":"v1","addr":"172.21.15.44:6835","nonce":4061596538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.172:6839/3543698961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3543698961},{"type":"v1","addr":"172.21.15.172:6839","nonce":3543698961}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":75,"addr":"172.21.15.44:6837/3549353612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3549353612},{"type":"v1","addr":"172.21.15.44:6837","nonce":3549353612}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/321221291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":321221291},{"type":"v1","addr":"172.21.15.44:6839","nonce":321221291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25723":{"gid":25723,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/4225205486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":4225205486},{"type":"v1","addr":"172.21.15.172:6837","nonce":4225205486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24503,"qdb_cluster":[24463,24467,24503]},"id":1}]} 2024-09-12T02:03:14.310 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 36 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 msgr2=0x7fe0500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 0x7fe0500a5040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe05c006010 tx=0x7fe05c005a20 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 msgr2=0x7fe068198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d770 tx=0x7fe06000dc30 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 shutdown_connections 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fe0500a2b80 0x7fe0500a5040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe068106f50 0x7fe06819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe068100ca0 0x7fe068198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 --2- 172.21.15.39:0/893801783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0681002f0 0x7fe068198520 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 >> 172.21.15.39:0/893801783 conn(0x7fe068077210 msgr2=0x7fe068105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 shutdown_connections 2024-09-12T02:03:14.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:14.312+0000 7fe0706bc640 1 -- 172.21.15.39:0/893801783 wait complete. 2024-09-12T02:03:14.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:14 smithi039 ceph-mon[31204]: pgmap v528: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:03:14.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:14 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/893801783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:14.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:03:15.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:14 smithi172 ceph-mon[35073]: pgmap v528: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:03:15.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:14 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/893801783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:14 smithi044 ceph-mon[35259]: pgmap v528: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:03:15.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:14 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/893801783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:03:15.198 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 -- 172.21.15.39:0/3204549182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c106f20 msgr2=0x7f843c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:15.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 --2- 172.21.15.39:0/3204549182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c106f20 0x7f843c10eaa0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8434009900 tx=0x7f843402a410 comp rx=0 tx=0).stop 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 -- 172.21.15.39:0/3204549182 shutdown_connections 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 --2- 172.21.15.39:0/3204549182 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c106f20 0x7f843c10eaa0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 --2- 172.21.15.39:0/3204549182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c1027a0 0x7f843c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 --2- 172.21.15.39:0/3204549182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 -- 172.21.15.39:0/3204549182 >> 172.21.15.39:0/3204549182 conn(0x7f843c0fd8b0 msgr2=0x7f843c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 -- 172.21.15.39:0/3204549182 shutdown_connections 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.706+0000 7f8440e5c640 1 -- 172.21.15.39:0/3204549182 wait complete. 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 Processor -- start 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 -- start start 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c106f20 0x7f843c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:15.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f843c111f80 con 0x7f843c1027a0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f843c111e00 con 0x7f843c106f20 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.707+0000 7f8440e5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f843c112100 con 0x7f843c101df0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53316/0 (socket says 172.21.15.39:53316) 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 -- 172.21.15.39:0/1810933514 learned_addr learned my addr 172.21.15.39:0/1810933514 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f843ad9d640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c106f20 0x7f843c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f843a59c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 -- 172.21.15.39:0/1810933514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 msgr2=0x7f843c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 -- 172.21.15.39:0/1810933514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c106f20 msgr2=0x7f843c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c106f20 0x7f843c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 -- 172.21.15.39:0/1810933514 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c19d330 con 0x7f843c1027a0 2024-09-12T02:03:15.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f843a59c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8439d9b640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f842400ebc0 tx=0x7f842400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424010630 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8424010cb0 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843c19d620 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424018bd0 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.708+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843c1a4f00 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.709+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843c1021d0 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.710+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f84240107d0 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.711+0000 7f84337fe640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 0x7f84280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.711+0000 7f843a59c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 0x7f84280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.711+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f84240cf6f0 con 0x7f843c1027a0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.712+0000 7f843a59c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 0x7f84280a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f842c009b50 tx=0x7f842c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:15.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.715+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f842409c660 con 0x7f843c1027a0 2024-09-12T02:03:15.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.892+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f843c1a5130 con 0x7f843c1027a0 2024-09-12T02:03:15.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.894+0000 7f84337fe640 1 -- 172.21.15.39:0/1810933514 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f842409bf60 con 0x7f843c1027a0 2024-09-12T02:03:15.894 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:03:15.894 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"d27de812-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:47:06.648036+0000","modified":"2024-09-12T02:00:47.251765+0000","last_up_change":"2024-09-12T01:54:15.483018+0000","last_in_change":"2024-09-12T01:53:52.222690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:50:23.669815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:55:04.470714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:55:06.558788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d18ca71-ba65-4f79-b839-a26243a98b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6803","nonce":2221897702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6805","nonce":2221897702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6809","nonce":2221897702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2221897702},{"type":"v1","addr":"172.21.15.39:6807","nonce":2221897702}]},"public_addr":"172.21.15.39:6803/2221897702","cluster_addr":"172.21.15.39:6805/2221897702","heartbeat_back_addr":"172.21.15.39:6809/2221897702","heartbeat_front_addr":"172.21.15.39:6807/2221897702","state":["exists","up"]},{"osd":1,"uuid":"14cf552e-8b4c-4d78-af25-1e5e24854694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6801","nonce":2339719980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6803","nonce":2339719980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6807","nonce":2339719980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2339719980},{"type":"v1","addr":"172.21.15.44:6805","nonce":2339719980}]},"public_addr":"172.21.15.44:6801/2339719980","cluster_addr":"172.21.15.44:6803/2339719980","heartbeat_back_addr":"172.21.15.44:6807/2339719980","heartbeat_front_addr":"172.21.15.44:6805/2339719980","state":["exists","up"]},{"osd":2,"uuid":"357cc6a5-5b47-4c23-8e6b-0d75cdbda81c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6801","nonce":3618957048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6803","nonce":3618957048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6807","nonce":3618957048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3618957048},{"type":"v1","addr":"172.21.15.172:6805","nonce":3618957048}]},"public_addr":"172.21.15.172:6801/3618957048","cluster_addr":"172.21.15.172:6803/3618957048","heartbeat_back_addr":"172.21.15.172:6807/3618957048","heartbeat_front_addr":"172.21.15.172:6805/3618957048","state":["exists","up"]},{"osd":3,"uuid":"4e0ee5c8-c842-4b5b-b4c4-42693348b505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6811","nonce":3975673341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6813","nonce":3975673341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6817","nonce":3975673341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":3975673341},{"type":"v1","addr":"172.21.15.39:6815","nonce":3975673341}]},"public_addr":"172.21.15.39:6811/3975673341","cluster_addr":"172.21.15.39:6813/3975673341","heartbeat_back_addr":"172.21.15.39:6817/3975673341","heartbeat_front_addr":"172.21.15.39:6815/3975673341","state":["exists","up"]},{"osd":4,"uuid":"a4f59844-9cd8-46ff-a56c-d9a5558939c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6809","nonce":1948738957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6811","nonce":1948738957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6815","nonce":1948738957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1948738957},{"type":"v1","addr":"172.21.15.44:6813","nonce":1948738957}]},"public_addr":"172.21.15.44:6809/1948738957","cluster_addr":"172.21.15.44:6811/1948738957","heartbeat_back_addr":"172.21.15.44:6815/1948738957","heartbeat_front_addr":"172.21.15.44:6813/1948738957","state":["exists","up"]},{"osd":5,"uuid":"d6acde19-c23f-487a-97a0-63622abd31c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6809","nonce":104325530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6811","nonce":104325530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6815","nonce":104325530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":104325530},{"type":"v1","addr":"172.21.15.172:6813","nonce":104325530}]},"public_addr":"172.21.15.172:6809/104325530","cluster_addr":"172.21.15.172:6811/104325530","heartbeat_back_addr":"172.21.15.172:6815/104325530","heartbeat_front_addr":"172.21.15.172:6813/104325530","state":["exists","up"]},{"osd":6,"uuid":"a2fc9230-8812-41b0-a3f4-6a5723e0a68f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6819","nonce":3666498594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6821","nonce":3666498594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6825","nonce":3666498594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3666498594},{"type":"v1","addr":"172.21.15.39:6823","nonce":3666498594}]},"public_addr":"172.21.15.39:6819/3666498594","cluster_addr":"172.21.15.39:6821/3666498594","heartbeat_back_addr":"172.21.15.39:6825/3666498594","heartbeat_front_addr":"172.21.15.39:6823/3666498594","state":["exists","up"]},{"osd":7,"uuid":"d7e20a32-eae3-49a7-9c4e-e3d581b5aef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6817","nonce":849440422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6819","nonce":849440422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6823","nonce":849440422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":849440422},{"type":"v1","addr":"172.21.15.44:6821","nonce":849440422}]},"public_addr":"172.21.15.44:6817/849440422","cluster_addr":"172.21.15.44:6819/849440422","heartbeat_back_addr":"172.21.15.44:6823/849440422","heartbeat_front_addr":"172.21.15.44:6821/849440422","state":["exists","up"]},{"osd":8,"uuid":"a9110f1b-fd90-436e-a1c3-234f94c1bffb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6817","nonce":586436553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6819","nonce":586436553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6823","nonce":586436553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":586436553},{"type":"v1","addr":"172.21.15.172:6821","nonce":586436553}]},"public_addr":"172.21.15.172:6817/586436553","cluster_addr":"172.21.15.172:6819/586436553","heartbeat_back_addr":"172.21.15.172:6823/586436553","heartbeat_front_addr":"172.21.15.172:6821/586436553","state":["exists","up"]},{"osd":9,"uuid":"f2b585a6-7a63-46fa-a8cc-7da114411b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6827","nonce":3100759551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6829","nonce":3100759551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6833","nonce":3100759551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":3100759551},{"type":"v1","addr":"172.21.15.39:6831","nonce":3100759551}]},"public_addr":"172.21.15.39:6827/3100759551","cluster_addr":"172.21.15.39:6829/3100759551","heartbeat_back_addr":"172.21.15.39:6833/3100759551","heartbeat_front_addr":"172.21.15.39:6831/3100759551","state":["exists","up"]},{"osd":10,"uuid":"6bf3e359-92ab-4cea-8324-7be533216576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6825","nonce":2721109342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6827","nonce":2721109342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6831","nonce":2721109342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2721109342},{"type":"v1","addr":"172.21.15.44:6829","nonce":2721109342}]},"public_addr":"172.21.15.44:6825/2721109342","cluster_addr":"172.21.15.44:6827/2721109342","heartbeat_back_addr":"172.21.15.44:6831/2721109342","heartbeat_front_addr":"172.21.15.44:6829/2721109342","state":["exists","up"]},{"osd":11,"uuid":"4246243b-00ad-474b-9b8f-5dca402c7de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6825","nonce":4178516458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6827","nonce":4178516458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6831","nonce":4178516458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4178516458},{"type":"v1","addr":"172.21.15.172:6829","nonce":4178516458}]},"public_addr":"172.21.15.172:6825/4178516458","cluster_addr":"172.21.15.172:6827/4178516458","heartbeat_back_addr":"172.21.15.172:6831/4178516458","heartbeat_front_addr":"172.21.15.172:6829/4178516458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:30.082244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:55.299363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:20.357333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:50:45.970698+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:12.079702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:51:37.181783+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:04.366480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:31.070285+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:52:55.837152+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:22.932551+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:53:47.831897+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:54:13.759994+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/2335103066":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3802572076":"2024-09-13T01:48:03.155570+0000","172.21.15.39:6801/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/3476444139":"2024-09-13T01:47:38.554416+0000","172.21.15.39:0/3619036511":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3026209487":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6800/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/3215796392":"2024-09-13T01:47:38.554416+0000","172.21.15.39:6801/4201782244":"2024-09-13T01:48:03.155570+0000","172.21.15.39:0/2035365900":"2024-09-13T01:47:38.554416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:03:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 msgr2=0x7f84280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 0x7f84280a5040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f842c009b50 tx=0x7f842c005f90 comp rx=0 tx=0).stop 2024-09-12T02:03:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 msgr2=0x7f843c1988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f842400ebc0 tx=0x7f842400c6a0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 shutdown_connections 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f843c106f20 0x7f843c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f843c1027a0 0x7f843c1988c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f84280a2b80 0x7f84280a5040 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 --2- 172.21.15.39:0/1810933514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f843c101df0 0x7f843c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 >> 172.21.15.39:0/1810933514 conn(0x7f843c0fd8b0 msgr2=0x7f843c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 shutdown_connections 2024-09-12T02:03:15.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:15.896+0000 7f8440e5c640 1 -- 172.21.15.39:0/1810933514 wait complete. 2024-09-12T02:03:16.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:03:16.829 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:16 smithi039 ceph-mon[31204]: pgmap v529: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:03:16.910 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:16 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1810933514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:03:16.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:16 smithi044 ceph-mon[35259]: pgmap v529: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:03:16.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:16 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1810933514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:03:17.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:16 smithi172 ceph-mon[35073]: pgmap v529: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-12T02:03:17.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:16 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1810933514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 -- 172.21.15.39:0/2291669958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f945810c170 msgr2=0x7f945810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 --2- 172.21.15.39:0/2291669958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f945810c170 0x7f945810e610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9450009900 tx=0x7f945002a480 comp rx=0 tx=0).stop 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 -- 172.21.15.39:0/2291669958 shutdown_connections 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 --2- 172.21.15.39:0/2291669958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f945810c170 0x7f945810e610 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 --2- 172.21.15.39:0/2291669958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9458103660 0x7f945810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 --2- 172.21.15.39:0/2291669958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 0x7f9458103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 -- 172.21.15.39:0/2291669958 >> 172.21.15.39:0/2291669958 conn(0x7f94580fc7a0 msgr2=0x7f94580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 -- 172.21.15.39:0/2291669958 shutdown_connections 2024-09-12T02:03:17.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.298+0000 7f945f0ce640 1 -- 172.21.15.39:0/2291669958 wait complete. 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 Processor -- start 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 -- start start 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 0x7f945819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 0x7f945819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9458112000 con 0x7f9458103660 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9458111e80 con 0x7f945810c170 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945f0ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9458112180 con 0x7f9458102d40 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53340/0 (socket says 172.21.15.39:53340) 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 -- 172.21.15.39:0/3104480390 learned_addr learned my addr 172.21.15.39:0/3104480390 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945d66b640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 0x7f945819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:17.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945ce6a640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 0x7f945819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 -- 172.21.15.39:0/3104480390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 msgr2=0x7f945819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 0x7f945819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 -- 172.21.15.39:0/3104480390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 msgr2=0x7f945819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 0x7f945819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f9457fff640 1 -- 172.21.15.39:0/3104480390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945819f650 con 0x7f9458103660 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.299+0000 7f945d66b640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 0x7f945819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f9457fff640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f944800eb10 tx=0x7f944800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944800ce20 con 0x7f9458103660 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9448010910 con 0x7f9458103660 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945819f940 con 0x7f9458103660 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448018a80 con 0x7f9458103660 2024-09-12T02:03:17.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.300+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94581a7220 con 0x7f9458103660 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.301+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9458103120 con 0x7f9458103660 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.302+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9448010ac0 con 0x7f9458103660 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.303+0000 7f9455ffb640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 0x7f94440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.303+0000 7f945ce6a640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 0x7f94440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.303+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f94480cf9a0 con 0x7f9458103660 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.304+0000 7f945ce6a640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 0x7f94440a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9440009990 tx=0x7f9440009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:17.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.307+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f944809c8b0 con 0x7f9458103660 2024-09-12T02:03:17.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.520+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f94581a7550 con 0x7f9458103660 2024-09-12T02:03:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.523+0000 7f9455ffb640 1 -- 172.21.15.39:0/3104480390 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f944809c1b0 con 0x7f9458103660 2024-09-12T02:03:17.523 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:03:17.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 msgr2=0x7f94440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:17.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 0x7f94440a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9440009990 tx=0x7f9440009110 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 msgr2=0x7f945819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f944800eb10 tx=0x7f944800ef10 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 shutdown_connections 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f945810c170 0x7f945819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9458103660 0x7f945819abe0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7f94440a2b80 0x7f94440a5040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 --2- 172.21.15.39:0/3104480390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9458102d40 0x7f945819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 >> 172.21.15.39:0/3104480390 conn(0x7f94580fc7a0 msgr2=0x7f945810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 shutdown_connections 2024-09-12T02:03:17.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:17.526+0000 7f945f0ce640 1 -- 172.21.15.39:0/3104480390 wait complete. 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T02:03:17.521+0000 7fa9565f8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:03:17.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:17 smithi039 ceph-mon[31204]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:03:17.923 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:17.923 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:17.923 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mds[64862]: -- 172.21.15.44:0/1077427684 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2c63f7c20 con 0x55c2c63d5400 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: starting mds.h at 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mds[64548]: -- 172.21.15.44:0/3709107617 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bfe17b3860 con 0x55bfe1791000 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: starting mds.e at 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:03:17.924 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mon[35259]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-mds[65165]: -- 172.21.15.44:0/1852829083 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1076bbc20 con 0x55a107699400 2024-09-12T02:03:17.925 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:03:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: starting mds.b at 2024-09-12T02:03:18.003 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:18.003 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mds[65026]: -- 172.21.15.172:0/1311538429 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a869033860 con 0x55a869010800 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: starting mds.f at 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mds[65329]: -- 172.21.15.172:0/4006135592 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a8efbe5860 con 0x55a8efbc2800 2024-09-12T02:03:18.004 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: starting mds.c at 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/3104480390' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:03:18.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mon[35073]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:03:18.006 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: ignoring --setuser ceph since I am not root 2024-09-12T02:03:18.006 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: ignoring --setgroup ceph since I am not root 2024-09-12T02:03:18.006 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-mds[65645]: -- 172.21.15.172:0/3146555928 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631d10a1860 con 0x5631d107e800 2024-09-12T02:03:18.006 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:03:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: starting mds.i at 2024-09-12T02:03:18.191 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:03:18.447 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: pgmap v530: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6834/1664777683,v1:172.21.15.44:6835/1664777683] up:boot 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6834/3613970835,v1:172.21.15.172:6835/3613970835] up:boot 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6836/3984939436,v1:172.21.15.44:6837/3984939436] up:boot 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6837/3660390320,v1:172.21.15.172:6839/3660390320] up:boot 2024-09-12T02:03:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.172:6836/3155669743,v1:172.21.15.172:6838/3155669743] up:boot 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: mds.? [v2:172.21.15.44:6838/2895948452,v1:172.21.15.44:6839/2895948452] up:boot 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:03:18.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:18 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:03:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.934+0000 7fba50798640 1 -- 172.21.15.39:0/407837402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48106f10 msgr2=0x7fba4810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.934+0000 7fba50798640 1 --2- 172.21.15.39:0/407837402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48106f10 0x7fba4810ea90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ca0 tx=0x7fba4002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- 172.21.15.39:0/407837402 shutdown_connections 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- 172.21.15.39:0/407837402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48106f10 0x7fba4810ea90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- 172.21.15.39:0/407837402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- 172.21.15.39:0/407837402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48101de0 0x7fba481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- 172.21.15.39:0/407837402 >> 172.21.15.39:0/407837402 conn(0x7fba480fd8c0 msgr2=0x7fba480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- 172.21.15.39:0/407837402 shutdown_connections 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- 172.21.15.39:0/407837402 wait complete. 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 Processor -- start 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- start start 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 0x7fba48074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:18.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111f70 con 0x7fba48101de0 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba48111df0 con 0x7fba48102790 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.935+0000 7fba50798640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba481120f0 con 0x7fba48106f10 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53358/0 (socket says 172.21.15.39:53358) 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 -- 172.21.15.39:0/2212304683 learned_addr learned my addr 172.21.15.39:0/2212304683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4dd33640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4ed35640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 0x7fba48074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 -- 172.21.15.39:0/2212304683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 msgr2=0x7fba48074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 0x7fba48074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 -- 172.21.15.39:0/2212304683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 msgr2=0x7fba48074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba48074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 -- 172.21.15.39:0/2212304683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481a6890 con 0x7fba48101de0 2024-09-12T02:03:18.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4ed35640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 0x7fba48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4dd33640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba4e534640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fba4400d770 tx=0x7fba4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44017070 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba44005500 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481a6b80 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44004e00 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.936+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481a70c0 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.937+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba481021c0 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.939+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fba44004fa0 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.939+0000 7fba3b7fe640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 0x7fba340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.940+0000 7fba4dd33640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 0x7fba340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.940+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fba440cef30 con 0x7fba48101de0 2024-09-12T02:03:18.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.940+0000 7fba4dd33640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 0x7fba340a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fba48075f80 tx=0x7fba3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:18.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:18.943+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba4409be20 con 0x7fba48101de0 2024-09-12T02:03:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: pgmap v530: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:03:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6834/1664777683,v1:172.21.15.44:6835/1664777683] up:boot 2024-09-12T02:03:19.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6834/3613970835,v1:172.21.15.172:6835/3613970835] up:boot 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6836/3984939436,v1:172.21.15.44:6837/3984939436] up:boot 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6837/3660390320,v1:172.21.15.172:6839/3660390320] up:boot 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.172:6836/3155669743,v1:172.21.15.172:6838/3155669743] up:boot 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: mds.? [v2:172.21.15.44:6838/2895948452,v1:172.21.15.44:6839/2895948452] up:boot 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:03:19.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:18 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:03:19.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.157+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fba48109bc0 con 0x7fba48101de0 2024-09-12T02:03:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: pgmap v530: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T02:03:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6834/1664777683,v1:172.21.15.44:6835/1664777683] up:boot 2024-09-12T02:03:19.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6834/3613970835,v1:172.21.15.172:6835/3613970835] up:boot 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6836/3984939436,v1:172.21.15.44:6837/3984939436] up:boot 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6837/3660390320,v1:172.21.15.172:6839/3660390320] up:boot 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.172:6836/3155669743,v1:172.21.15.172:6838/3155669743] up:boot 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: mds.? [v2:172.21.15.44:6838/2895948452,v1:172.21.15.44:6839/2895948452] up:boot 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:03:19.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:18 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:03:19.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.704+0000 7fba3b7fe640 1 -- 172.21.15.39:0/2212304683 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7fba4409b720 con 0x7fba48101de0 2024-09-12T02:03:19.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.707+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 msgr2=0x7fba340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.707+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 0x7fba340a50c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fba48075f80 tx=0x7fba3c005f90 comp rx=0 tx=0).stop 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.707+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 msgr2=0x7fba480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.707+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fba4400d770 tx=0x7fba4400dc30 comp rx=0 tx=0).stop 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 shutdown_connections 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fba340a2c00 0x7fba340a50c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48106f10 0x7fba48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba48102790 0x7fba48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 --2- 172.21.15.39:0/2212304683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba48101de0 0x7fba480744f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:19.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 >> 172.21.15.39:0/2212304683 conn(0x7fba480fd8c0 msgr2=0x7fba480feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:19.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 shutdown_connections 2024-09-12T02:03:19.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:19.708+0000 7fba50798640 1 -- 172.21.15.39:0/2212304683 wait complete. 2024-09-12T02:03:20.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:19 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:03:20.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:19 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:03:20.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:19 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:03:20.409 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:03:20.674 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:20.959 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: pgmap v532: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:03:20.960 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:03:20.960 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:03:20.960 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: Cluster is now healthy 2024-09-12T02:03:20.960 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:03:20.960 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:20 smithi039 ceph-mon[31204]: fsmap 12 up:standby 2024-09-12T02:03:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: pgmap v532: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:03:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:03:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:03:21.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: Cluster is now healthy 2024-09-12T02:03:21.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:03:21.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:20 smithi172 ceph-mon[35073]: fsmap 12 up:standby 2024-09-12T02:03:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: pgmap v532: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-12T02:03:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:03:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:03:21.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: Cluster is now healthy 2024-09-12T02:03:21.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2212304683' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:03:21.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:20 smithi044 ceph-mon[35259]: fsmap 12 up:standby 2024-09-12T02:03:21.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 -- 172.21.15.39:0/2795640349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 msgr2=0x7fac2810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 --2- 172.21.15.39:0/2795640349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac2810da40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fac18009ca0 tx=0x7fac1802a950 comp rx=0 tx=0).stop 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 -- 172.21.15.39:0/2795640349 shutdown_connections 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 --2- 172.21.15.39:0/2795640349 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac2810da40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 --2- 172.21.15.39:0/2795640349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28102570 0x7fac281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 --2- 172.21.15.39:0/2795640349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28100e20 0x7fac28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 -- 172.21.15.39:0/2795640349 >> 172.21.15.39:0/2795640349 conn(0x7fac280fc7d0 msgr2=0x7fac280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 -- 172.21.15.39:0/2795640349 shutdown_connections 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.171+0000 7fac2cd00640 1 -- 172.21.15.39:0/2795640349 wait complete. 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 Processor -- start 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 -- start start 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28100e20 0x7fac28199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28102570 0x7fac281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac28110f80 con 0x7fac28102ef0 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac28110e00 con 0x7fac28102570 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2cd00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac28111100 con 0x7fac28100e20 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53370/0 (socket says 172.21.15.39:53370) 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 -- 172.21.15.39:0/1294369056 learned_addr learned my addr 172.21.15.39:0/1294369056 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac2659c640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28100e20 0x7fac28199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac25d9b640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28102570 0x7fac281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 -- 172.21.15.39:0/1294369056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28100e20 msgr2=0x7fac28199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28100e20 0x7fac28199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.172+0000 7fac26d9d640 1 -- 172.21.15.39:0/1294369056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28102570 msgr2=0x7fac281997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac26d9d640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28102570 0x7fac281997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac26d9d640 1 -- 172.21.15.39:0/1294369056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac281a4850 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac26d9d640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fac1802ae70 tx=0x7fac1802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18034040 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac18030920 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac281a4a20 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18045480 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.173+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac281a4e70 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.174+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac28101200 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.175+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fac18037020 con 0x7fac28102ef0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.176+0000 7fac1f7fe640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 0x7fac140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.176+0000 7fac2659c640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 0x7fac140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:21.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.176+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fac180f0040 con 0x7fac28102ef0 2024-09-12T02:03:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.176+0000 7fac2659c640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 0x7fac140a5040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac20005d00 tx=0x7fac2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:21.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.180+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac180bceb0 con 0x7fac28102ef0 2024-09-12T02:03:21.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.355+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac281a50d0 con 0x7fac28102ef0 2024-09-12T02:03:21.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.710+0000 7fac1f7fe640 1 -- 172.21.15.39:0/1294369056 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) ==== 181+0+0 (secure 0 0 0) 0x7fac180bc7b0 con 0x7fac28102ef0 2024-09-12T02:03:21.710 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:03:21.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 msgr2=0x7fac140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 0x7fac140a5040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac20005d00 tx=0x7fac2000b410 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 msgr2=0x7fac281a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fac1802ae70 tx=0x7fac1802f5d0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 shutdown_connections 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac28102ef0 0x7fac281a4310 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.712+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac28102570 0x7fac281997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.713+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fac140a2b80 0x7fac140a5040 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.713+0000 7fac2cd00640 1 --2- 172.21.15.39:0/1294369056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac28100e20 0x7fac28199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.713+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 >> 172.21.15.39:0/1294369056 conn(0x7fac280fc7d0 msgr2=0x7fac28106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.713+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 shutdown_connections 2024-09-12T02:03:21.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:21.713+0000 7fac2cd00640 1 -- 172.21.15.39:0/1294369056 wait complete. 2024-09-12T02:03:22.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:21 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:22.038 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:21 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:22.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:21 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:22.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid d27de812-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:03:22.654 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:03:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: pgmap v533: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:03:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:23.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:03:23.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:23.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:22 smithi172 ceph-mon[35073]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:03:23.060 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: pgmap v533: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:03:23.060 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:23.060 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:03:23.061 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:23.061 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.061 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.061 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:22 smithi039 ceph-mon[31204]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:03:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: pgmap v533: 97 pgs: 97 active+clean; 33 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-12T02:03:23.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/1294369056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:23.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:03:23.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:03:23.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:23.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:03:23.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:22 smithi044 ceph-mon[35259]: from='mgr.14150 172.21.15.39:0/1819149478' entity='mgr.x' 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 -- 172.21.15.39:0/3612269189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102ef0 msgr2=0x7fede810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 --2- 172.21.15.39:0/3612269189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102ef0 0x7fede810da40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fede0009ca0 tx=0x7fede002a950 comp rx=0 tx=0).stop 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 -- 172.21.15.39:0/3612269189 shutdown_connections 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 --2- 172.21.15.39:0/3612269189 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102ef0 0x7fede810da40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 --2- 172.21.15.39:0/3612269189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8102570 0x7fede81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 --2- 172.21.15.39:0/3612269189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8100e20 0x7fede8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 -- 172.21.15.39:0/3612269189 >> 172.21.15.39:0/3612269189 conn(0x7fede80fc7d0 msgr2=0x7fede80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 -- 172.21.15.39:0/3612269189 shutdown_connections 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.145+0000 7feded6af640 1 -- 172.21.15.39:0/3612269189 wait complete. 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 Processor -- start 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 -- start start 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8100e20 0x7fede80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8102ef0 0x7fede80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fede8110f80 con 0x7fede8102570 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fede8110e00 con 0x7fede8102ef0 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7feded6af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fede8111100 con 0x7fede8100e20 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7fede67fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7fede67fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59682/0 (socket says 172.21.15.39:59682) 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7fede67fc640 1 -- 172.21.15.39:0/2453973405 learned_addr learned my addr 172.21.15.39:0/2453973405 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7fede77fe640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8102ef0 0x7fede80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.146+0000 7fede6ffd640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8100e20 0x7fede80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 -- 172.21.15.39:0/2453973405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8100e20 msgr2=0x7fede80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8100e20 0x7fede80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 -- 172.21.15.39:0/2453973405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8102ef0 msgr2=0x7fede80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8102ef0 0x7fede80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 -- 172.21.15.39:0/2453973405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede81a69a0 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fede67fc640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7feddc00d950 tx=0x7feddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc017070 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc009c30 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede81a6c90 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc00f6b0 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.147+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede81a71c0 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.148+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede8101200 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.149+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feddc0109d0 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.150+0000 7fedcffff640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 0x7fedd00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.150+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7915+0+0 (secure 0 0 0) 0x7feddc0ce920 con 0x7fede8102570 2024-09-12T02:03:23.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.150+0000 7fede6ffd640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 0x7fedd00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.151+0000 7fede6ffd640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 0x7fedd00a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009bd0 tx=0x7fedd8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:23.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.154+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feddc009de0 con 0x7fede8102570 2024-09-12T02:03:23.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.331+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fede81a73f0 con 0x7fede8102570 2024-09-12T02:03:23.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.724+0000 7fedcffff640 1 -- 172.21.15.39:0/2453973405 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) ==== 169+0+0 (secure 0 0 0) 0x7feddc09b3c0 con 0x7fede8102570 2024-09-12T02:03:23.725 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 msgr2=0x7fedd00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 0x7fedd00a50c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009bd0 tx=0x7fedd8005f90 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 msgr2=0x7fede80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7feddc00d950 tx=0x7feddc00de10 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 shutdown_connections 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fede8102ef0 0x7fede80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fede8102570 0x7fede80fd1c0 secure :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7feddc00d950 tx=0x7feddc00de10 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.39:6800/571724551,v1:172.21.15.39:6801/571724551] conn(0x7fedd00a2c00 0x7fedd00a50c0 secure :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009bd0 tx=0x7fedd8005f90 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 --2- 172.21.15.39:0/2453973405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fede8100e20 0x7fede80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:23.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.727+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 >> 172.21.15.39:0/2453973405 conn(0x7fede80fc7d0 msgr2=0x7fede8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.728+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 shutdown_connections 2024-09-12T02:03:23.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:03:23.728+0000 7feded6af640 1 -- 172.21.15.39:0/2453973405 wait complete. 2024-09-12T02:03:24.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:23 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:24.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:23 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:24.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:23 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:03:24.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:03:24.451 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:03:24.482 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:03:24.514 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:03:24.515 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:03:24.532 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:03:24.552 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:03:24.572 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:03:24.573 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:03:24.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:03:24.660 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 systemd[1]: Stopping Ceph mon.a for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:24 smithi172 ceph-mon[35073]: pgmap v535: 65 pgs: 65 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:03:25.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:24 smithi172 ceph-mon[35073]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:25.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:24 smithi172 ceph-mon[35073]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:03:25.129 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 ceph-mon[31204]: pgmap v535: 65 pgs: 65 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:03:25.129 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 ceph-mon[31204]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:25.129 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 ceph-mon[31204]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:03:25.130 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T02:03:24.893+0000 7fa95be03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:25.130 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a[31200]: 2024-09-12T02:03:24.893+0000 7fa95be03640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:03:25.173 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:24 smithi044 ceph-mon[35259]: pgmap v535: 65 pgs: 65 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:03:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:24 smithi044 ceph-mon[35259]: from='client.? 172.21.15.39:0/2453973405' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:03:25.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:24 smithi044 ceph-mon[35259]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:03:25.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:25 smithi039 podman[112512]: 2024-09-12 02:03:25.129830195 +0000 UTC m=+0.354541716 container died dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:03:25.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:25 smithi039 podman[112512]: 2024-09-12 02:03:25.544914835 +0000 UTC m=+0.769626360 container cleanup dabe1095c0b11bf0115c20f48e0242b70e6e38d9c24ccdadaecc54d673a162da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:03:25.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:03:25 smithi039 bash[112512]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:03:25.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:03:26.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:26.020 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:03:26.020 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:03:26.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:03:26.378 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 systemd[1]: Stopping Ceph mon.b for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b[35255]: 2024-09-12T02:03:26.376+0000 7f0e39f2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b[35255]: 2024-09-12T02:03:26.376+0000 7f0e39f2e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:03:26.673 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 podman[68416]: 2024-09-12 02:03:26.417955738 +0000 UTC m=+0.188935948 container died c3ad14bb4e9aee1e08924a417f38d777a121620a4e177f928f45ae81d14b6bcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:03:27.087 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 podman[68416]: 2024-09-12 02:03:26.802371689 +0000 UTC m=+0.573351898 container cleanup c3ad14bb4e9aee1e08924a417f38d777a121620a4e177f928f45ae81d14b6bcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:03:27.087 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:03:26 smithi044 bash[68416]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:03:27.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:03:27.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:27.264 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:03:27.264 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:03:27.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:03:27.606 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:27 smithi172 systemd[1]: Stopping Ceph mon.c for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c[35069]: 2024-09-12T02:03:27.605+0000 7f14f06fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c[35069]: 2024-09-12T02:03:27.605+0000 7f14f06fb640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:03:28.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:27 smithi172 podman[69209]: 2024-09-12 02:03:27.759453823 +0000 UTC m=+0.289246204 container died ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:03:28.399 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:28 smithi172 podman[69209]: 2024-09-12 02:03:28.115019048 +0000 UTC m=+0.644811429 container cleanup ed473400afabfec81e97f5461865000ce58bef90633ae733dc8320ee65f6ddf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-12T02:03:28.399 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:03:28 smithi172 bash[69209]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:03:28.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:03:28.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:28.593 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:03:28.593 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:03:28.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:03:28.910 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:28 smithi039 systemd[1]: Stopping Ceph mgr.x for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:29.243 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:28 smithi039 podman[112631]: 2024-09-12 02:03:28.940356496 +0000 UTC m=+0.148570641 container died 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:03:29.636 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 podman[112631]: 2024-09-12 02:03:29.376550987 +0000 UTC m=+0.584765177 container cleanup 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:03:29.636 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 bash[112631]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:03:29.876 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:03:29.898 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 podman[112643]: 2024-09-12 02:03:29.636800755 +0000 UTC m=+0.692124356 container remove 3d43d73b895240ffca885f8b05f0760f2d4c9c3b7b9d887a8ce8f73ba9fed051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:03:29.899 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 systemd[1]: ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-12T02:03:29.899 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 systemd[1]: Stopped Ceph mgr.x for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T02:03:29.899 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:03:29 smithi039 systemd[1]: ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.x.service: Consumed 42.959s CPU time. 2024-09-12T02:03:29.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:29.913 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:03:29.913 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:03:29.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:03:30.254 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:03:29 smithi044 systemd[1]: Stopping Ceph mgr.y for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:30.558 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:03:30 smithi044 podman[68542]: 2024-09-12 02:03:30.253697175 +0000 UTC m=+0.141614345 container died 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:03:30.910 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:03:30 smithi044 podman[68542]: 2024-09-12 02:03:30.658665948 +0000 UTC m=+0.546583112 container cleanup 5172d2c6880484dc33f01ff832988b8e4a11c20597f3a491b9b76e959cf9dc13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:03:30.910 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:03:30 smithi044 bash[68542]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:03:31.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:03:31.124 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:31.124 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:03:31.124 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:03:31.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:03:31.458 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:31 smithi172 systemd[1]: Stopping Ceph mgr.z for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:31.753 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:31 smithi172 podman[69332]: 2024-09-12 02:03:31.458047268 +0000 UTC m=+0.135975016 container died 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:03:32.173 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:31 smithi172 podman[69332]: 2024-09-12 02:03:31.879707973 +0000 UTC m=+0.557635675 container cleanup 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:03:32.173 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:31 smithi172 bash[69332]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:03:32.433 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:32 smithi172 podman[69347]: 2024-09-12 02:03:32.173510125 +0000 UTC m=+0.706695636 container remove 341da2dff46abc35064264e835117895b470e9b91feb5a4bbcef5d4e0de04da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:03:32.433 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:03:32 smithi172 systemd[1]: ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-12T02:03:32.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:03:32.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:32.494 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:03:32.494 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:03:32.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:03:32.823 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:32 smithi039 systemd[1]: Stopping Ceph osd.0 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:33.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T02:03:32.821+0000 7fbec79de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:33.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T02:03:32.821+0000 7fbec79de640 -1 osd.0 86 *** Got signal Terminated *** 2024-09-12T02:03:33.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0[42548]: 2024-09-12T02:03:32.821+0000 7fbec79de640 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:03:38.567 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:38 smithi039 podman[112750]: 2024-09-12 02:03:38.302924665 +0000 UTC m=+5.604629919 container died fade99e30310829e60a2f995707152bff26a81a0b03545c50495dc4dad095a34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:03:38.910 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:38 smithi039 podman[112750]: 2024-09-12 02:03:38.781861229 +0000 UTC m=+6.083566485 container cleanup fade99e30310829e60a2f995707152bff26a81a0b03545c50495dc4dad095a34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:03:38.910 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:38 smithi039 bash[112750]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:03:39.410 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112766]: 2024-09-12 02:03:39.066978778 +0000 UTC m=+0.757471150 container remove fade99e30310829e60a2f995707152bff26a81a0b03545c50495dc4dad095a34 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T02:03:39.712 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.321266486 +0000 UTC m=+0.016977418 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:03:39.712 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.442959061 +0000 UTC m=+0.138669992 container create 8a9857695560743dc6e52acfa518a818b1d8c570c308295bc84c13b4f026b6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:03:40.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.712831655 +0000 UTC m=+0.408542588 container init 8a9857695560743dc6e52acfa518a818b1d8c570c308295bc84c13b4f026b6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:03:40.160 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.71633627 +0000 UTC m=+0.412047202 container start 8a9857695560743dc6e52acfa518a818b1d8c570c308295bc84c13b4f026b6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:03:40.161 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.812830809 +0000 UTC m=+0.508541756 container attach 8a9857695560743dc6e52acfa518a818b1d8c570c308295bc84c13b4f026b6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:03:40.161 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:03:39 smithi039 podman[112858]: 2024-09-12 02:03:39.90791296 +0000 UTC m=+0.603623898 container died 8a9857695560743dc6e52acfa518a818b1d8c570c308295bc84c13b4f026b6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:03:40.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:03:40.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:40.952 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:03:40.952 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:03:40.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:03:41.256 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:41 smithi044 systemd[1]: Stopping Ceph osd.1 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:41.673 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T02:03:41.256+0000 7f05adb6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:41.674 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T02:03:41.256+0000 7f05adb6b640 -1 osd.1 86 *** Got signal Terminated *** 2024-09-12T02:03:41.674 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1[39739]: 2024-09-12T02:03:41.256+0000 7f05adb6b640 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:03:46.924 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:46 smithi044 podman[68664]: 2024-09-12 02:03:46.594847792 +0000 UTC m=+5.440863605 container died e4c33828c4de5cabcdb70d64c8283ee27d5d11585346907363747e50a380320b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:03:47.358 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68664]: 2024-09-12 02:03:47.106509225 +0000 UTC m=+5.952525037 container cleanup e4c33828c4de5cabcdb70d64c8283ee27d5d11585346907363747e50a380320b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T02:03:47.358 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 bash[68664]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:03:47.673 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68679]: 2024-09-12 02:03:47.358213295 +0000 UTC m=+0.756462187 container remove e4c33828c4de5cabcdb70d64c8283ee27d5d11585346907363747e50a380320b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:03:47.979 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68768]: 2024-09-12 02:03:47.583898897 +0000 UTC m=+0.015896123 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:03:47.979 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68768]: 2024-09-12 02:03:47.709352969 +0000 UTC m=+0.141350179 container create 417df6f40fb032f984590ba6041b3a5b08ddf48b0d56e333f064c82e8c0622b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:03:48.238 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68768]: 2024-09-12 02:03:47.979385931 +0000 UTC m=+0.411383155 container init 417df6f40fb032f984590ba6041b3a5b08ddf48b0d56e333f064c82e8c0622b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:03:48.238 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:47 smithi044 podman[68768]: 2024-09-12 02:03:47.983416441 +0000 UTC m=+0.415413651 container start 417df6f40fb032f984590ba6041b3a5b08ddf48b0d56e333f064c82e8c0622b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T02:03:48.529 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:48 smithi044 podman[68768]: 2024-09-12 02:03:48.23792402 +0000 UTC m=+0.669921245 container attach 417df6f40fb032f984590ba6041b3a5b08ddf48b0d56e333f064c82e8c0622b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:03:48.529 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:03:48 smithi044 podman[68768]: 2024-09-12 02:03:48.250733381 +0000 UTC m=+0.682730594 container died 417df6f40fb032f984590ba6041b3a5b08ddf48b0d56e333f064c82e8c0622b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:03:48.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:03:48.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:48.980 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:03:48.980 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:03:48.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:03:49.275 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:49 smithi172 systemd[1]: Stopping Ceph osd.2 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:49.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T02:03:49.275+0000 7f5aab2c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:49.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T02:03:49.275+0000 7f5aab2c6640 -1 osd.2 86 *** Got signal Terminated *** 2024-09-12T02:03:49.753 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2[40040]: 2024-09-12T02:03:49.275+0000 7f5aab2c6640 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:03:54.959 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:54 smithi172 podman[69458]: 2024-09-12 02:03:54.62394141 +0000 UTC m=+5.446746120 container died c0de0e100197fcd8f399bd7f505b25b4096cb277d61396cbf52c5b442923e48a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:03:55.251 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69458]: 2024-09-12 02:03:55.050233303 +0000 UTC m=+5.873038012 container cleanup c0de0e100197fcd8f399bd7f505b25b4096cb277d61396cbf52c5b442923e48a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:03:55.251 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 bash[69458]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:03:55.503 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69475]: 2024-09-12 02:03:55.25181786 +0000 UTC m=+0.630848259 container remove c0de0e100197fcd8f399bd7f505b25b4096cb277d61396cbf52c5b442923e48a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:03:55.938 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69562]: 2024-09-12 02:03:55.565208773 +0000 UTC m=+0.016338150 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:03:55.938 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69562]: 2024-09-12 02:03:55.686109591 +0000 UTC m=+0.137238954 container create c4d8ff88e28a65c3714f7690fd49b896a53ec9785787b2f8e63838a7fd54c4d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:03:55.940 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69562]: 2024-09-12 02:03:55.938918345 +0000 UTC m=+0.390047707 container init c4d8ff88e28a65c3714f7690fd49b896a53ec9785787b2f8e63838a7fd54c4d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T02:03:56.253 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:55 smithi172 podman[69562]: 2024-09-12 02:03:55.942805243 +0000 UTC m=+0.393934611 container start c4d8ff88e28a65c3714f7690fd49b896a53ec9785787b2f8e63838a7fd54c4d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:03:56.254 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:56 smithi172 podman[69562]: 2024-09-12 02:03:56.03900093 +0000 UTC m=+0.490130301 container attach c4d8ff88e28a65c3714f7690fd49b896a53ec9785787b2f8e63838a7fd54c4d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:03:56.254 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:03:56 smithi172 podman[69562]: 2024-09-12 02:03:56.131310896 +0000 UTC m=+0.582440270 container died c4d8ff88e28a65c3714f7690fd49b896a53ec9785787b2f8e63838a7fd54c4d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:03:56.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:03:56.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:03:56.803 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:03:56.803 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:03:56.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:03:57.157 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:03:56 smithi039 systemd[1]: Stopping Ceph osd.3 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:03:57.410 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:03:57 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T02:03:57.154+0000 7f54f7390640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:57.410 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:03:57 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T02:03:57.154+0000 7f54f7390640 -1 osd.3 86 *** Got signal Terminated *** 2024-09-12T02:03:57.410 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:03:57 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3[48974]: 2024-09-12T02:03:57.154+0000 7f54f7390640 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:03:59.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:03:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:03:58.734+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:03:59.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:03:59 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:03:59.838+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:03:59.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:03:59 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:03:59.589+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:00.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:03:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:03:59.706+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:00.004 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:03:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:03:59.642+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:00.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:00.626+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:00.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:00 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:00.828+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:01.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:00.593+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:01.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:00.713+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:01.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:01.820+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:01.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:01 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:01.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:02.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:01.571+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:02.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:01.690+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:02.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:01 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:01.862+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:02.853 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:02 smithi039 podman[112972]: 2024-09-12 02:04:02.534246123 +0000 UTC m=+5.516922818 container died af381157c6d1c7e3f67703798333146269b3a3234a0b1da4862b26fccfbf3a55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T02:04:02.853 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:02.570+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:03.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:02.572+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:03.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:02.702+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:03.160 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:02 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:02.852+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:03.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:02 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:02.845+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:03.538 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:03 smithi039 podman[112972]: 2024-09-12 02:04:03.170803996 +0000 UTC m=+6.153480733 container cleanup af381157c6d1c7e3f67703798333146269b3a3234a0b1da4862b26fccfbf3a55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:04:03.538 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:03 smithi039 bash[112972]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:04:03.538 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:03 smithi039 podman[112988]: 2024-09-12 02:04:03.405727263 +0000 UTC m=+0.869477854 container remove af381157c6d1c7e3f67703798333146269b3a3234a0b1da4862b26fccfbf3a55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T02:04:03.845 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:03 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:03.538+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:04.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:03.615+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:04.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:03 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:03.723+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:04.161 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:03 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:03.845+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:04.161 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:03 smithi039 podman[113080]: 2024-09-12 02:04:03.751370925 +0000 UTC m=+0.016563392 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:04.161 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:03 smithi039 podman[113080]: 2024-09-12 02:04:03.856687305 +0000 UTC m=+0.121879760 container create d903074f765a2766d49bc7ea9a74e5f8c93454c4f5f2ce3356812446fc9205e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:04:04.162 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:04 smithi039 podman[113080]: 2024-09-12 02:04:04.084644148 +0000 UTC m=+0.349836603 container init d903074f765a2766d49bc7ea9a74e5f8c93454c4f5f2ce3356812446fc9205e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:04:04.162 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:04 smithi039 podman[113080]: 2024-09-12 02:04:04.088289215 +0000 UTC m=+0.353481677 container start d903074f765a2766d49bc7ea9a74e5f8c93454c4f5f2ce3356812446fc9205e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T02:04:04.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:03 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:03.884+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:04.567 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:04 smithi039 podman[113080]: 2024-09-12 02:04:04.167793316 +0000 UTC m=+0.432985770 container attach d903074f765a2766d49bc7ea9a74e5f8c93454c4f5f2ce3356812446fc9205e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:04:04.567 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:04:04 smithi039 podman[113080]: 2024-09-12 02:04:04.286049204 +0000 UTC m=+0.551241669 container died d903074f765a2766d49bc7ea9a74e5f8c93454c4f5f2ce3356812446fc9205e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T02:04:04.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:04 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:04.796+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:04.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:04 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:04.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:05.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:04.648+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:05.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:04.707+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:05.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:04:05.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:05.089 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:04:05.089 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:04:05.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:04:05.118 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:04 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:04.866+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:05.412 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:05 smithi044 systemd[1]: Stopping Ceph osd.4 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:05.673 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T02:04:05.411+0000 7f4dd0924640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:05.673 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T02:04:05.411+0000 7f4dd0924640 -1 osd.4 86 *** Got signal Terminated *** 2024-09-12T02:04:05.673 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T02:04:05.411+0000 7f4dd0924640 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:05.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:05.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:05.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:05 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:05.747+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:06.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:05.665+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:06.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:05.743+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:06.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:05 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:05.914+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:06.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:06 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:06.767+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:06.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:06 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:06.593+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:07.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:06.673+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:07.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:06.731+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:07.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:06.731+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:07.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:06 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:06.870+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:07.747 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:07 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:07.658+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:07.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:07 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:07.590+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:07.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:07 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:07.724+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:07.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:07 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:07.724+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:08.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:07 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:07.747+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:08.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:07 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:07.747+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:08.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:08 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:08.103+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:08.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:07 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:07.877+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:08.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:08 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:08.608+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:08.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:08 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:08.736+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:08.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:08 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:08.736+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:09.003 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:08 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:08.645+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:09.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:08 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:08.734+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:09.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:08 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:08.734+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:09.423 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:08 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T02:04:08.957+0000 7f4dc8f32640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.820917+0000 front 2024-09-12T02:03:43.820948+0000 (oldest deadline 2024-09-12T02:04:08.521049+0000) 2024-09-12T02:04:09.424 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:09 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:09.107+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:09.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:08 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:08.923+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:09.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:08 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:08.923+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:09.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:09 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:09.594+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:09.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:09 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:09.715+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:09.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:09 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:09.715+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:10.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:09 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:09.728+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:10.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:09 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:09.728+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:10.004 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:09 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:09.690+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:10.004 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:09 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:09.690+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:10.004 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:09 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:09.921+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:10.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:10 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:10.061+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:10.173 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:09 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4[46601]: 2024-09-12T02:04:09.926+0000 7f4dc8f32640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.820917+0000 front 2024-09-12T02:03:43.820948+0000 (oldest deadline 2024-09-12T02:04:08.521049+0000) 2024-09-12T02:04:10.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:09 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:09.917+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:10.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:09 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:09.917+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:10.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:10 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:10.670+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:10.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:10 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:10.670+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:10.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:10 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:10.592+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:10.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:10 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:10.592+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:10.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:10 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:10.692+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:10.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:10 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:10.692+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:10.951 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:10 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:10.666+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:10.951 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:10 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:10.666+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:11.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:11 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:11.092+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:11.174 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:10 smithi044 podman[68881]: 2024-09-12 02:04:10.912280253 +0000 UTC m=+5.619751248 container died e9a9c4adbfe50ce7fd94d76dc1f5c1c46e2daf8fb7a8643c8e26cc7130853a92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:04:11.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:10 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:10.967+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:11.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:10 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:10.967+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:11.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:10 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:10.951+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:11.563 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:11 smithi044 podman[68881]: 2024-09-12 02:04:11.278985798 +0000 UTC m=+5.986456794 container cleanup e9a9c4adbfe50ce7fd94d76dc1f5c1c46e2daf8fb7a8643c8e26cc7130853a92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T02:04:11.564 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:11 smithi044 bash[68881]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:04:11.901 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:11 smithi044 podman[68896]: 2024-09-12 02:04:11.563893399 +0000 UTC m=+0.646786543 container remove e9a9c4adbfe50ce7fd94d76dc1f5c1c46e2daf8fb7a8643c8e26cc7130853a92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:04:11.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:11 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:11.670+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:11.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:11 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:11.670+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:11.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:11 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:11.608+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:11.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:11 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:11.608+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:11.912 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:11 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:11.628+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:11.912 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:11 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:11.628+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:11.912 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:11 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:11.714+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:11.913 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:11 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:11.714+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:12.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:12 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:12.128+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:12.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:11 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:11.928+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:12.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:11 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:11.928+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:12.174 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:11 smithi044 podman[68988]: 2024-09-12 02:04:11.804038663 +0000 UTC m=+0.016638124 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:12.174 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:11 smithi044 podman[68988]: 2024-09-12 02:04:11.931375685 +0000 UTC m=+0.143975137 container create ae9f1714fdef441174df0c99242e1759813e6472062a7f16ca7ed0b7739f067a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:04:12.174 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:12 smithi044 podman[68988]: 2024-09-12 02:04:12.143101277 +0000 UTC m=+0.355700731 container init ae9f1714fdef441174df0c99242e1759813e6472062a7f16ca7ed0b7739f067a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:04:12.174 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:12 smithi044 podman[68988]: 2024-09-12 02:04:12.146642331 +0000 UTC m=+0.359241783 container start ae9f1714fdef441174df0c99242e1759813e6472062a7f16ca7ed0b7739f067a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:04:12.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:11 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:11.912+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:12.629 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:12 smithi044 podman[68988]: 2024-09-12 02:04:12.234408703 +0000 UTC m=+0.447008154 container attach ae9f1714fdef441174df0c99242e1759813e6472062a7f16ca7ed0b7739f067a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:12.629 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:04:12 smithi044 podman[68988]: 2024-09-12 02:04:12.332401187 +0000 UTC m=+0.545000656 container died ae9f1714fdef441174df0c99242e1759813e6472062a7f16ca7ed0b7739f067a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:12.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:12.628+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:12.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:12.628+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:12.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:12.571+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:12.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:12.571+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:12.912 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:12.756+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:12.912 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:12.756+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:12.912 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:12.611+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:12.912 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:12.611+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:12.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:04:13.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:13.076 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:04:13.076 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:04:13.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:04:13.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:13 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:13.114+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:13.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:12 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:12.921+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:13.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:12 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:12.921+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:13.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:12 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:12.911+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:13.253 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 systemd[1]: Stopping Ceph osd.5 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:13.753 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:13.395+0000 7f4bf019c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:13.754 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:13.395+0000 7f4bf019c640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-12T02:04:13.754 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:13.395+0000 7f4bf019c640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:13.754 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:13.590+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:13.754 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:13.590+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:13.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:13 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:13.614+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:13.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:13 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:13.614+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:13.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:13 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:13.600+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:13.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:13 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:13.600+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:14.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:13.917+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:14.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:13.775+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:14.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:13 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:13.775+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:14.423 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:14 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:14.119+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:14.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:13 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:13.930+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:14.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:13 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:13.930+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:14.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:14 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:14.605+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:14.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:14 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:14.605+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:14.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:14 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:14.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:14.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:14 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:14.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:14.924 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:14.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:14.925 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:14.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:14.925 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:14.599+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:14.925 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:14.599+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:15.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:15 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:15.113+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:15.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:14 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:14.884+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:15.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:14 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:14.884+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:15.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:14 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:14.884+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:15.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:14 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:14.924+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:15.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:15 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:15.638+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:15.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:15 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:15.638+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:15.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:15 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:15.563+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:15.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:15 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:15.563+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:15.939 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:15 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:15.760+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:15.939 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:15 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:15.760+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:15.939 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:15 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:15.628+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:15.939 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:15 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:15.628+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:16.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:16 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:16.073+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:16.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:15 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:15.846+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:16.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:15 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:15.846+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:16.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:15 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:15.846+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:16.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:15 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:15.939+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:16.900 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:16.803+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:16.900 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:16.803+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:16.900 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:16.803+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:16.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:16.627+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:16.900 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:16.627+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:16.901 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:16.627+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:54.153862+0000 front 2024-09-12T02:03:54.153918+0000 (oldest deadline 2024-09-12T02:04:16.453924+0000) 2024-09-12T02:04:16.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:16.671+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:16.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:16.671+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:16.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:16.599+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:16.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:16.599+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:16.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:16.599+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:17.091 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:16 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:16.813+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:17.091 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:16 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:16.813+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:17.091 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:16 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:16.813+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:17.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:16.899+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:17.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:16 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:16.899+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:17.360 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:17.095+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:17.360 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:17.095+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:17.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:17.655+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:17.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:17.655+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:17.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:17.655+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:17.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:17.622+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:17.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:17.622+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:17.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:17 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:17.622+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:18.003 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:17.903+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:18.004 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:17.903+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:18.004 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:17.672+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.051158+0000 front 2024-09-12T02:03:36.050997+0000 (oldest deadline 2024-09-12T02:03:59.551174+0000) 2024-09-12T02:04:18.005 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:17.672+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.152832+0000 front 2024-09-12T02:03:44.152849+0000 (oldest deadline 2024-09-12T02:04:08.852908+0000) 2024-09-12T02:04:18.005 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5[46462]: 2024-09-12T02:04:17.672+0000 7f4bec7b2640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:54.153862+0000 front 2024-09-12T02:03:54.153918+0000 (oldest deadline 2024-09-12T02:04:16.453924+0000) 2024-09-12T02:04:18.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:17.817+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:18.005 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:17.817+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:18.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:17 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:17.817+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:18.079 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:17.802+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:18.080 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:17.802+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:18.080 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:17 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:17.802+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:18.342 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:18 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:18.078+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:18.342 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:18 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:18.078+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:18.606+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:18.606+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:18.606+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:18.660+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:18.660+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:18.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:18 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:18.660+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:19.065 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:18 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:18.811+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:19.065 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:18 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:18.811+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:19.065 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:18 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:18.811+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:19.196 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:18 smithi172 podman[69678]: 2024-09-12 02:04:18.918339847 +0000 UTC m=+5.643967043 container died 480e9f9194a124bc74a8aa554096aeecd92d55beedc0dd860e56c78ef2dd01a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:04:19.197 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:18 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:18.903+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:19.197 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:18 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:18.903+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:19.197 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:18 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:18.839+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:19.197 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:18 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:18.839+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:19.197 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:18 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:18.839+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:19.423 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:19 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:19.064+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:19.423 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:19 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:19.064+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:19.503 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:19 smithi172 podman[69678]: 2024-09-12 02:04:19.287222127 +0000 UTC m=+6.012849323 container cleanup 480e9f9194a124bc74a8aa554096aeecd92d55beedc0dd860e56c78ef2dd01a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:04:19.503 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:19 smithi172 bash[69678]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:04:19.807 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:19 smithi172 podman[69693]: 2024-09-12 02:04:19.555367533 +0000 UTC m=+0.632319372 container remove 480e9f9194a124bc74a8aa554096aeecd92d55beedc0dd860e56c78ef2dd01a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:04:19.868 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:19.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:19.868 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:19.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:19.868 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:19.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:19.869 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:19.579+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:19.869 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:19.579+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:19.869 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:19 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:19.579+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:20.124 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:19.933+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:20.125 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:19.933+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:20.125 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:19.807+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:20.126 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:19.807+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:20.126 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:19 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:19.807+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:20.126 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:19 smithi172 podman[69784]: 2024-09-12 02:04:19.897906562 +0000 UTC m=+0.101108078 container create 468337bb632726e307b5757f9ce6e8726bd0eb939c0e53a77b504caa341b796e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T02:04:20.126 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:19 smithi172 podman[69784]: 2024-09-12 02:04:19.812714231 +0000 UTC m=+0.015915714 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:20.126 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:20 smithi172 podman[69784]: 2024-09-12 02:04:20.125246482 +0000 UTC m=+0.328447952 container init 468337bb632726e307b5757f9ce6e8726bd0eb939c0e53a77b504caa341b796e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:04:20.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:20 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:20.042+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:20.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:20 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:20.042+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:20.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:19 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:19.809+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:20.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:19 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:19.809+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:20.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:19 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:19.809+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:20.503 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:20 smithi172 podman[69784]: 2024-09-12 02:04:20.129119811 +0000 UTC m=+0.332321287 container start 468337bb632726e307b5757f9ce6e8726bd0eb939c0e53a77b504caa341b796e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:04:20.503 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:20 smithi172 podman[69784]: 2024-09-12 02:04:20.233613993 +0000 UTC m=+0.436815463 container attach 468337bb632726e307b5757f9ce6e8726bd0eb939c0e53a77b504caa341b796e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:04:20.504 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:04:20 smithi172 podman[69784]: 2024-09-12 02:04:20.321422947 +0000 UTC m=+0.524624428 container died 468337bb632726e307b5757f9ce6e8726bd0eb939c0e53a77b504caa341b796e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T02:04:20.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:20.620+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:20.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:20.620+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:20.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:20.620+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:20.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:20.664+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:20.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:20.664+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:20.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:20.664+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:20.970 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:20 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:20.893+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:20.971 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:20 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:20.893+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:20.971 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:20 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:20.775+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:20.971 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:20 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:20.775+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:20.971 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:20 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:20.775+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:20.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:04:21.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:21.030 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:04:21.031 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:04:21.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:04:21.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:21 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:21.082+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:21.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:21 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:21.082+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:21.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:20 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:20.857+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:21.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:20 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:20.857+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:21.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:20 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:20.857+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:21.333 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 systemd[1]: Stopping Ceph osd.6 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:21.626 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.332+0000 7fcdea4fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:21.626 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.332+0000 7fcdea4fc640 -1 osd.6 86 *** Got signal Terminated *** 2024-09-12T02:04:21.626 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.332+0000 7fcdea4fc640 -1 osd.6 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:21.626 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.577+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:21.626 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.577+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:21.627 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:21.577+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:21.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:21.625+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:21.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:21.625+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:21.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:21 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:21.625+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:22.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:22 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:22.117+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:22.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:22 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:22.117+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:22.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:21 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:21.887+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:22.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:21 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:21.887+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:22.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:21 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:21.887+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:22.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:21.920+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:22.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:21.920+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:22.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:21.796+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:22.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:21.796+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:22.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:21 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:21.796+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:22.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:22.612+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:22.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:22.612+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:22.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:22.612+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:22.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:22.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:22.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:22.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:22.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:22 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:22.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:23.178 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:23 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:23.085+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:23.178 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:23 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:23.085+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:23.178 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:22 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:22.883+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:23.178 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:22 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:22.883+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:23.178 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:22 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:22.883+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:23.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:22 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:22.887+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:23.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:22 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:22.887+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:23.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:22 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:22.785+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:23.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:22 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:22.785+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:23.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:22 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:22.785+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:23.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:23.616+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:23.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:23.616+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:23.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:23.616+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:23.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:23.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:23.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:23.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:23.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:23 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:23.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:23.901+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:23.901+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:23.901+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:23.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:23.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:23.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:24.155 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:23 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:23.799+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:24.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:24.037+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:24.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:24.037+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:24.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:23 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:23.867+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:24.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:23 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:23.867+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:24.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:23 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:23.867+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:24.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:24.581+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:24.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:24.581+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:24.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:24.581+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:24.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:24.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:24.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:24.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:24.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:24 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:24.565+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:25.166 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:24.939+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:25.166 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:24.939+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:25.166 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:24.939+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:25.167 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:24.838+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:25.167 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:24.838+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:25.167 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:24.838+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:25.167 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:24 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:24.838+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:25.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.024+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:25.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.024+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:25.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.024+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:25.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:24.899+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:25.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:24.899+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:25.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:24.899+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:25.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:25.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:25.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:25.582+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:25.574+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:33.744915+0000 front 2024-09-12T02:03:33.744730+0000 (oldest deadline 2024-09-12T02:03:59.644871+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:25.574+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.846362+0000 front 2024-09-12T02:03:44.846293+0000 (oldest deadline 2024-09-12T02:04:07.647128+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:25.574+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.449032+0000 front 2024-09-12T02:03:53.449048+0000 (oldest deadline 2024-09-12T02:04:17.548932+0000) 2024-09-12T02:04:25.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:25 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6[55860]: 2024-09-12T02:04:25.574+0000 7fcde6b12640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:59.849677+0000 front 2024-09-12T02:03:59.849763+0000 (oldest deadline 2024-09-12T02:04:25.149847+0000) 2024-09-12T02:04:26.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.997+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:26.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.997+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:26.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:25.997+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:26.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:25.922+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:26.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:25.922+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:26.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:25 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:25.922+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:26.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:25.942+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:26.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:25.942+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:26.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:25.942+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:26.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:25.880+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:26.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:25.880+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:26.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:25.880+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:26.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:25 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:25.880+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:26.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:26 smithi039 podman[113195]: 2024-09-12 02:04:26.842597389 +0000 UTC m=+5.606747735 container died 458f7e76c506389fcc3a0944e12d7f509810fe169d1fa44ba82888b28cc29145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:26.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:26.607+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:26.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:26.607+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:26.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:26.607+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:26.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:26 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:26.607+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:27.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:26.988+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:27.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:26.988+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:27.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:26.988+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:27.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:26.882+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:27.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:26.882+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:27.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:26 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:26.882+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:27.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:26.992+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:27.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:26.992+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:27.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:26.992+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:27.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:26.907+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:27.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:26.907+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:27.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:26.907+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:27.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:26 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:26.907+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:27.580 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:27 smithi039 podman[113195]: 2024-09-12 02:04:27.458373597 +0000 UTC m=+6.222523944 container cleanup 458f7e76c506389fcc3a0944e12d7f509810fe169d1fa44ba82888b28cc29145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:27.580 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:27 smithi039 bash[113195]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:04:27.910 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:27 smithi039 podman[113209]: 2024-09-12 02:04:27.71818122 +0000 UTC m=+0.869309777 container remove 458f7e76c506389fcc3a0944e12d7f509810fe169d1fa44ba82888b28cc29145 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:04:27.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:27.580+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:27.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:27.580+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:27.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:27.580+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:27.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:27 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:27.580+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:28.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:27.965+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:27.965+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:27.965+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:27.897+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:27.897+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:27.897+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:28.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:27 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:27.897+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:28.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.035+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:28.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.035+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:28.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.035+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:28.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:27.908+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:28.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:27.908+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:28.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:27.908+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:28.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:27 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:27.908+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:28.410 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.045112173 +0000 UTC m=+0.016374194 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:28.410 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.202410138 +0000 UTC m=+0.173672149 container create 21c48f29d5aa736216a4d57d2c18519a7008c023f4a7838041f55e1a4839043a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:28 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:28.559+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:28 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:28.559+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:28 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:28.559+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:28 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:28.559+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.463820242 +0000 UTC m=+0.435082254 container init 21c48f29d5aa736216a4d57d2c18519a7008c023f4a7838041f55e1a4839043a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.467290547 +0000 UTC m=+0.438552559 container start 21c48f29d5aa736216a4d57d2c18519a7008c023f4a7838041f55e1a4839043a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.546835221 +0000 UTC m=+0.518097245 container attach 21c48f29d5aa736216a4d57d2c18519a7008c023f4a7838041f55e1a4839043a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:28.911 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:04:28 smithi039 podman[113302]: 2024-09-12 02:04:28.663854635 +0000 UTC m=+0.635116654 container died 21c48f29d5aa736216a4d57d2c18519a7008c023f4a7838041f55e1a4839043a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T02:04:29.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:28.874+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:29.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:28.874+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:29.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:28.874+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:29.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:28.874+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:29.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:28.957+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:29.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:28.957+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:29.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:28 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:28.957+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:29.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.993+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:29.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.993+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:29.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:28.993+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:29.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:28.954+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:29.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:28.954+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:29.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:28.954+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:29.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:28 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:28.954+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:29.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:04:29.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:29.626 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:04:29.626 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:04:29.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:04:29.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:29 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:29.574+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:29.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:29 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:29.574+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:29.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:29 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:29.574+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:29.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:29 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:29.574+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:29.923 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 systemd[1]: Stopping Ceph osd.7 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:29.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:29.841+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:29.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:29.841+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:29.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:29.841+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:29.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:29.841+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:30.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:29.988+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:29.988+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:29.988+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:29.959+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:29.959+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:29.959+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:30.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:29 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:29.959+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:30.423 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.949+0000 7fa07bcd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:30.423 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.949+0000 7fa07bcd8640 -1 osd.7 86 *** Got signal Terminated *** 2024-09-12T02:04:30.424 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.949+0000 7fa07bcd8640 -1 osd.7 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:30.424 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.984+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:30.424 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.984+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:30.424 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:29.984+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:30.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:30.605+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:30.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:30.605+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:30.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:30.605+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:30.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:30 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:30.605+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:31.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:31.023+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:31.023+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:31.023+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:30 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:30.873+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:30 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:30.873+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:30 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:30.873+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:31.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:30 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:30.873+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:31.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:30.958+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:31.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:30.958+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:31.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:30.958+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:31.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:30.929+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:31.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:30.929+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:31.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:30.929+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:31.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:30 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:30.929+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:31.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:31 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:31.569+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:31.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:31 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:31.569+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:31.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:31 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:31.569+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:31.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:31 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:31.569+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:32.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:32.050+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:32.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:32.050+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:32.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:32.050+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:32.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:31.829+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:32.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:31.829+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:32.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:31.829+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:32.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:31 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:31.829+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:32.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:31.971+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:32.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:31.971+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:32.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:31.971+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:32.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:31.971+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:32.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:31.965+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:32.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:31.965+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:32.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:31.965+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:32.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:31 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:31.965+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:32.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:32.564+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:32.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:32.564+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:32.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:32.564+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:32.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:32 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:32.564+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:33.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:33.029+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:33.029+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:33.029+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:32.807+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:32.807+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:32.807+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:33.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:32 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:32.807+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:33.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.011+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.011+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.011+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.011+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:32 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:32.969+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:32 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:32.969+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:32 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:32.969+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:33.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:32 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:32.969+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:33.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:33.526+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:33.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:33.526+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:33.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:33.526+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:33.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:33.526+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:33.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:33 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:33.526+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:34.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:34.005+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.462532+0000 front 2024-09-12T02:03:41.462559+0000 (oldest deadline 2024-09-12T02:04:07.362702+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:34.005+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.263801+0000 front 2024-09-12T02:03:53.263824+0000 (oldest deadline 2024-09-12T02:04:16.763734+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7[53084]: 2024-09-12T02:04:34.005+0000 7fa0782ee640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.064443+0000 front 2024-09-12T02:04:02.064561+0000 (oldest deadline 2024-09-12T02:04:24.964564+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:33.791+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:33.791+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:33.791+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:34.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:33 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:33.791+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:34.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.995+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:34.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.995+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:34.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.995+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:33 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:33.995+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.015+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.015+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.015+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.015+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:34.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.015+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:34.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:34.484+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:34.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:34.484+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:34.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:34.484+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:34.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:34.484+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:34.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:34 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:34.484+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:35.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:34.818+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:35.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:34.818+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:35.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:34.818+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:35.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:34.818+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:35.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:35.039+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:35.039+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:35.039+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:35 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:35.039+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.978+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.978+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.978+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.978+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:35.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:34 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:34.978+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:35.859 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:35 smithi044 podman[69105]: 2024-09-12 02:04:35.441468757 +0000 UTC m=+5.614973189 container died 147031c00f2e5ac9da570a8d8a041f00ea429084991895d05153b196c167df71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:35.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:35.513+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:35.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:35.513+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:35.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:35.513+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:35.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:35.513+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:35.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:35 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:35.513+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:36.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:35 smithi044 podman[69105]: 2024-09-12 02:04:35.966594533 +0000 UTC m=+6.140098963 container cleanup 147031c00f2e5ac9da570a8d8a041f00ea429084991895d05153b196c167df71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:04:36.173 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:35 smithi044 bash[69105]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:04:36.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:35 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:35.859+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:36.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:35 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:35.859+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:36.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:35 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:35.859+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:36.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:35 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:35.859+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:36.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:36.051+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:36.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:36.051+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:36.051+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:36.051+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:36.013+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:36.013+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:36.013+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:36.013+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:36.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:36 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:36.013+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:36.638 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69120]: 2024-09-12 02:04:36.213176324 +0000 UTC m=+0.770345123 container remove 147031c00f2e5ac9da570a8d8a041f00ea429084991895d05153b196c167df71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:04:36.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:36.497+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:36.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:36.497+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:36.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:36.497+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:36.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:36.497+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:36.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:36 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:36.497+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:36.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:36 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:36.872+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:36.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:36 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:36.872+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:36.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:36 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:36.872+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:36 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:36.872+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:36 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:36.872+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69208]: 2024-09-12 02:04:36.541725377 +0000 UTC m=+0.015628297 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69208]: 2024-09-12 02:04:36.652484074 +0000 UTC m=+0.126387038 container create f5df9a45cf3c621a8b817d7cbf4ad406a66bcbad2495dd5566565335bb7573eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69208]: 2024-09-12 02:04:36.871694539 +0000 UTC m=+0.345597458 container init f5df9a45cf3c621a8b817d7cbf4ad406a66bcbad2495dd5566565335bb7573eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:04:36.924 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69208]: 2024-09-12 02:04:36.875010755 +0000 UTC m=+0.348913677 container start f5df9a45cf3c621a8b817d7cbf4ad406a66bcbad2495dd5566565335bb7573eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:37.342 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:36 smithi044 podman[69208]: 2024-09-12 02:04:36.963381147 +0000 UTC m=+0.437284091 container attach f5df9a45cf3c621a8b817d7cbf4ad406a66bcbad2495dd5566565335bb7573eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T02:04:37.342 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:04:37 smithi044 podman[69208]: 2024-09-12 02:04:37.061505886 +0000 UTC m=+0.535408806 container died f5df9a45cf3c621a8b817d7cbf4ad406a66bcbad2495dd5566565335bb7573eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:04:37.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:37.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:37.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:37.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:37.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:37.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:37.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:37.042+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:37.042+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:37.042+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:37.042+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:37.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:37 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:37.042+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:37.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:04:37.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:37.721 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:04:37.722 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:04:37.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:04:37.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:37.504+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:37.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:37.504+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:37.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:37.504+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:37.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:37.504+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:37.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:37 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:37.504+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:37.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:37 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:37.854+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:37.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:37 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:37.854+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:37.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:37 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:37.854+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:37.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:37 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:37.854+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:37.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:37 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:37.854+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:38.003 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:37 smithi172 systemd[1]: Stopping Ceph osd.8 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:38.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:38.053+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:38.053+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:38.053+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:38.053+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:38.053+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.037+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.037+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.037+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:38.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.037+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:38.505 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.039+0000 7fe195969640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:38.505 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.039+0000 7fe195969640 -1 osd.8 86 *** Got signal Terminated *** 2024-09-12T02:04:38.505 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:38 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:38.039+0000 7fe195969640 -1 osd.8 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:38.812 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:38.548+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:38.812 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:38.548+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:38.812 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:38.548+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:38.812 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:38.548+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:38.812 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:38 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:38.548+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:39.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:38.826+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:39.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:38.826+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:39.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:38.826+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:39.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:38.826+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:39.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:38.826+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:39.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:39.081+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:39.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:39.081+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:39.503 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:39.081+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:39.081+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.009+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.009+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.009+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.009+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:39.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.009+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:39.828 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:39 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:39.534+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:40.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:39 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:39.782+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:40.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:39 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:39.782+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:40.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:39 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:39.782+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:40.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:39 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:39.782+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:40.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:39 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:39.782+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:40.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:40.034+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:40.034+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:40.034+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:40.034+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:40.034+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:14.155994+0000 front 2024-09-12T02:04:14.156042+0000 (oldest deadline 2024-09-12T02:04:39.456079+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.972+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.972+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.972+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.972+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:40.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:39 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:39.972+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:40.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:40.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:40.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:40.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:40.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:40.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:40 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:40.487+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:41.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:40 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:40.803+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:41.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:40 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:40.803+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:41.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:40 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:40.803+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:41.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:40 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:40.803+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:41.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:40 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:40.803+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:41.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:41.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.012+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:14.155994+0000 front 2024-09-12T02:04:14.156042+0000 (oldest deadline 2024-09-12T02:04:39.456079+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:40.947+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:40.947+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:40.947+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:40.947+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:41.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:40 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:40.947+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:41.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:41 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:41.499+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:42.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:41.770+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:42.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:41.770+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:42.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:41.770+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:42.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:41.770+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:42.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:41 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:41.770+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:42.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.986+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.986+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.986+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.986+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:41.986+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:14.155994+0000 front 2024-09-12T02:04:14.156042+0000 (oldest deadline 2024-09-12T02:04:39.456079+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:42.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:41.935+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:42.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:42.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:42.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:42.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:42.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:42.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:42 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:42.518+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:43.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:42 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:42.768+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:43.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:42 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:42.768+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:43.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:42 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:42.768+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:43.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:42 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:42.768+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:43.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:42 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:42.768+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:43.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:43.003+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.650166+0000 front 2024-09-12T02:03:41.650275+0000 (oldest deadline 2024-09-12T02:04:09.250835+0000) 2024-09-12T02:04:43.253 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:43.003+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.852281+0000 front 2024-09-12T02:03:53.852341+0000 (oldest deadline 2024-09-12T02:04:16.152431+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:43.003+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.953997+0000 front 2024-09-12T02:04:01.954071+0000 (oldest deadline 2024-09-12T02:04:23.053970+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:43.003+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.155168+0000 front 2024-09-12T02:04:07.155215+0000 (oldest deadline 2024-09-12T02:04:31.255276+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8[53417]: 2024-09-12T02:04:43.003+0000 7fe191f7f640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:14.155994+0000 front 2024-09-12T02:04:14.156042+0000 (oldest deadline 2024-09-12T02:04:39.456079+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:43.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:42 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:42.926+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:43.731 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 podman[69898]: 2024-09-12 02:04:43.441106221 +0000 UTC m=+5.524155993 container died 1fd6c28fc8764dd5ba7abff27e6c4d6a0365fbf33379fa39e0286eb9fb7acafd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:43.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:43.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:43.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:43.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:43.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:43.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:43 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:43.546+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:44.003 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 podman[69898]: 2024-09-12 02:04:43.823430458 +0000 UTC m=+5.906480229 container cleanup 1fd6c28fc8764dd5ba7abff27e6c4d6a0365fbf33379fa39e0286eb9fb7acafd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T02:04:44.003 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:43 smithi172 bash[69898]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:04:44.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:44.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:44.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:44.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:44.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:44.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:43 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:43.953+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:44.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:44.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:44.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:44.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:44.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:44.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:43 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:43.727+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:44.431 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[69915]: 2024-09-12 02:04:44.09142024 +0000 UTC m=+0.646508304 container remove 1fd6c28fc8764dd5ba7abff27e6c4d6a0365fbf33379fa39e0286eb9fb7acafd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:04:44.744 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.334978566 +0000 UTC m=+0.016154840 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:44.744 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.459018697 +0000 UTC m=+0.140194970 container create 027bb21bd49c827987d0efe1f9894db853f40dc5bcdd5756d82d7a7f2ed2d1a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:04:44.744 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.644592628 +0000 UTC m=+0.325768901 container init 027bb21bd49c827987d0efe1f9894db853f40dc5bcdd5756d82d7a7f2ed2d1a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:04:44.744 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.6478792 +0000 UTC m=+0.329055476 container start 027bb21bd49c827987d0efe1f9894db853f40dc5bcdd5756d82d7a7f2ed2d1a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:04:44.744 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.744431195 +0000 UTC m=+0.425607481 container attach 027bb21bd49c827987d0efe1f9894db853f40dc5bcdd5756d82d7a7f2ed2d1a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:04:44.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:44.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:44.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:44.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:44.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:44.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:44 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:44.577+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:45.003 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:04:44 smithi172 podman[70003]: 2024-09-12 02:04:44.839722889 +0000 UTC m=+0.520899179 container died 027bb21bd49c827987d0efe1f9894db853f40dc5bcdd5756d82d7a7f2ed2d1a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:45.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:44 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:44.944+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:45.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:45.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:45.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:45.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:45.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:45.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:44 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:44.776+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:45.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:04:45.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:45.542 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:04:45.542 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:04:45.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.578+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 systemd[1]: Stopping Ceph osd.9 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:45.879 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.879+0000 7f7e231b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:45.880 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.879+0000 7f7e231b1640 -1 osd.9 86 *** Got signal Terminated *** 2024-09-12T02:04:45.880 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:45 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:45.879+0000 7f7e231b1640 -1 osd.9 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:46.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:46.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:46.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:46.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:46.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:46.004 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:45 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:45.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:46.075 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:45 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:45.822+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:46.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:46.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:46.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:46.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:46.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:46.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:46 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:46.555+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:47.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:46 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:46.847+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:47.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:47.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:47.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:47.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:47.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:47.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:47 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:47.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:47.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:47.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:47 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:47.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:25.901152+0000 front 2024-09-12T02:04:25.901169+0000 (oldest deadline 2024-09-12T02:04:46.901569+0000) 2024-09-12T02:04:48.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:48.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:48.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:48.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:48.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:48.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:47 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:47.878+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:48.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:48.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:48.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:48.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:48.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:48.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:48 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:48.086+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:48.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:48.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:48.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:48.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:48.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:48.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:48.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:48 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:48.587+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:25.901152+0000 front 2024-09-12T02:04:25.901169+0000 (oldest deadline 2024-09-12T02:04:46.901569+0000) 2024-09-12T02:04:49.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:49.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:48 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:48.907+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:49.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:49.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:49.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:49.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:49.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:49.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.039+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:49.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:49.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:49.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:49.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:49.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:49.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:49.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:49 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:49.624+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:25.901152+0000 front 2024-09-12T02:04:25.901169+0000 (oldest deadline 2024-09-12T02:04:46.901569+0000) 2024-09-12T02:04:50.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:50.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:49 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:49.903+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:50.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:50.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:50.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:50.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:50.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:50.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:49 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:49.997+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:50.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.893506+0000 front 2024-09-12T02:03:35.893584+0000 (oldest deadline 2024-09-12T02:03:58.793698+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:41.694779+0000 front 2024-09-12T02:03:41.694756+0000 (oldest deadline 2024-09-12T02:04:10.495419+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:52.196524+0000 front 2024-09-12T02:03:52.196653+0000 (oldest deadline 2024-09-12T02:04:15.696562+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:01.597549+0000 front 2024-09-12T02:04:01.597612+0000 (oldest deadline 2024-09-12T02:04:26.297707+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:07.898897+0000 front 2024-09-12T02:04:07.898913+0000 (oldest deadline 2024-09-12T02:04:33.198842+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:16.699976+0000 front 2024-09-12T02:04:16.699945+0000 (oldest deadline 2024-09-12T02:04:38.999765+0000) 2024-09-12T02:04:50.911 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:50 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9[62816]: 2024-09-12T02:04:50.586+0000 7f7e1b7bf640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:25.901152+0000 front 2024-09-12T02:04:25.901169+0000 (oldest deadline 2024-09-12T02:04:46.901569+0000) 2024-09-12T02:04:51.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:51.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:51.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:51.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:51.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:51.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:50.958+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:51.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:51.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:51.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:51.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:51.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:51.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:51.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:50 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:50.935+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:51.629 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:51 smithi039 podman[113419]: 2024-09-12 02:04:51.322629601 +0000 UTC m=+5.570056231 container died 6191101434c6aff890e6c13989f35f8eebbb2b9f05d69f5ff4183df16bf76bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:04:51.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:51 smithi039 podman[113419]: 2024-09-12 02:04:51.820416337 +0000 UTC m=+6.067842959 container cleanup 6191101434c6aff890e6c13989f35f8eebbb2b9f05d69f5ff4183df16bf76bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T02:04:51.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:51 smithi039 bash[113419]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:04:52.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:52.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:52.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:52.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:52.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:52.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:51 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:51.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:52.394 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113435]: 2024-09-12 02:04:52.055021756 +0000 UTC m=+0.728771649 container remove 6191101434c6aff890e6c13989f35f8eebbb2b9f05d69f5ff4183df16bf76bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:04:52.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:52.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:52.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:52.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:52.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:52.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:52.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:51 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:51.983+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:52.644 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.297385174 +0000 UTC m=+0.016280360 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:04:52.644 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.405951416 +0000 UTC m=+0.124846636 container create c982bfcf949be5f27576a8616596dbc708cc0485e4ebaefd7f841a9c838b4f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:04:52.644 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.641501697 +0000 UTC m=+0.360396873 container init c982bfcf949be5f27576a8616596dbc708cc0485e4ebaefd7f841a9c838b4f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:52.644 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.644800403 +0000 UTC m=+0.363695577 container start c982bfcf949be5f27576a8616596dbc708cc0485e4ebaefd7f841a9c838b4f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:04:52.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.750013767 +0000 UTC m=+0.468908946 container attach c982bfcf949be5f27576a8616596dbc708cc0485e4ebaefd7f841a9c838b4f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:04:52.910 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:04:52 smithi039 podman[113522]: 2024-09-12 02:04:52.840477143 +0000 UTC m=+0.559372325 container died c982bfcf949be5f27576a8616596dbc708cc0485e4ebaefd7f841a9c838b4f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:04:53.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:53.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:53.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:53.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:53.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:53.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:52 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:52.951+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:53.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:53.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:53.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:53.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:53.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:53.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:53.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:52 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:52.940+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:53.459 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:04:53.504 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:04:53.505 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:04:53.505 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:04:53.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:04:53.795 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 systemd[1]: Stopping Ceph osd.10 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:04:54.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.794+0000 7f16a1a17640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:04:54.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.794+0000 7f16a1a17640 -1 osd.10 86 *** Got signal Terminated *** 2024-09-12T02:04:54.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.794+0000 7f16a1a17640 -1 osd.10 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:04:54.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:54.174 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:53 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:53.987+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:54.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:54.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:54.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:54.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:54.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:54.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:53 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:53.939+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:55.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:55.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:55.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:55.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:55.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:55.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:54.943+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:55.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:55.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:55.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:55.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:55.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:55.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:55.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.013+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:56.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:56.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:55 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:55.993+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:04:56.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:56.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:55 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:55.979+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:57.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:56 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:56.969+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:57.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:57.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:57 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:57.025+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:04:58.423 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:36.453838+0000 front 2024-09-12T02:03:36.453808+0000 (oldest deadline 2024-09-12T02:04:01.753855+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:43.454598+0000 front 2024-09-12T02:03:43.454715+0000 (oldest deadline 2024-09-12T02:04:08.055356+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.757383+0000 front 2024-09-12T02:03:53.757426+0000 (oldest deadline 2024-09-12T02:04:14.857308+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:03:57.158418+0000 front 2024-09-12T02:03:57.158338+0000 (oldest deadline 2024-09-12T02:04:27.158668+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.959900+0000 front 2024-09-12T02:04:09.959954+0000 (oldest deadline 2024-09-12T02:04:35.860028+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:18.161040+0000 front 2024-09-12T02:04:18.161080+0000 (oldest deadline 2024-09-12T02:04:42.860998+0000) 2024-09-12T02:04:58.424 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:57 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10[59948]: 2024-09-12T02:04:57.950+0000 7f169e02d640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:04:24.561894+0000 front 2024-09-12T02:04:24.561982+0000 (oldest deadline 2024-09-12T02:04:48.661861+0000) 2024-09-12T02:04:58.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:58.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:58.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:58.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:58.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:58.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:58.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:58 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:58.038+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:04:59.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:04:59.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.011+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:04:59.538 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:59 smithi044 podman[69322]: 2024-09-12 02:04:59.234016431 +0000 UTC m=+5.531104533 container died 0de7f2b3cafa7222a522a1fb493755b710e2059f31e35be9518185b174cfca1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:04:59.879 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:59 smithi044 podman[69322]: 2024-09-12 02:04:59.620346103 +0000 UTC m=+5.917434188 container cleanup 0de7f2b3cafa7222a522a1fb493755b710e2059f31e35be9518185b174cfca1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:04:59.879 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:59 smithi044 bash[69322]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:05:00.173 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:04:59 smithi044 podman[69337]: 2024-09-12 02:04:59.87993965 +0000 UTC m=+0.643930013 container remove 0de7f2b3cafa7222a522a1fb493755b710e2059f31e35be9518185b174cfca1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:05:00.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:00.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:00.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:00.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:00.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:00.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:00.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:04:59 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:04:59.973+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:00.500 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.150443623 +0000 UTC m=+0.016356194 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:05:00.500 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.281038203 +0000 UTC m=+0.146950761 container create 8e79ee71c845df23e88c0beb2a0dfcd585fac10aa396540ac83e92d87eb06285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:05:00.500 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.50013322 +0000 UTC m=+0.366045793 container init 8e79ee71c845df23e88c0beb2a0dfcd585fac10aa396540ac83e92d87eb06285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T02:05:00.923 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.503486348 +0000 UTC m=+0.369398907 container start 8e79ee71c845df23e88c0beb2a0dfcd585fac10aa396540ac83e92d87eb06285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:05:00.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.583344828 +0000 UTC m=+0.449257393 container attach 8e79ee71c845df23e88c0beb2a0dfcd585fac10aa396540ac83e92d87eb06285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:05:00.924 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:05:00 smithi044 podman[69422]: 2024-09-12 02:05:00.695673673 +0000 UTC m=+0.561586232 container died 8e79ee71c845df23e88c0beb2a0dfcd585fac10aa396540ac83e92d87eb06285 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:05:01.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:01.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:00 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:00.990+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:01.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:05:01.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:01.335 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:05:01.335 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:05:01.336 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:05:01.633 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:01 smithi172 systemd[1]: Stopping Ceph osd.11 for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:02.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:01.633+0000 7ff064a30640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:02.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:01.633+0000 7ff064a30640 -1 osd.11 86 *** Got signal Terminated *** 2024-09-12T02:05:02.003 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:01 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:01.633+0000 7ff064a30640 -1 osd.11 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:05:02.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:02.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:02.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:02.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:02.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:02.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:02.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.020+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:03.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:03.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:03.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:03.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:03.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:03.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:03.254 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:02 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:02.980+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:04.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:04.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:04 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:04.027+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:05.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:05.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:05.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:05 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:05.066+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-12T02:04:38.837388+0000 front 2024-09-12T02:04:38.837364+0000 (oldest deadline 2024-09-12T02:05:04.737400+0000) 2024-09-12T02:05:06.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:03:35.023975+0000 front 2024-09-12T02:03:35.024048+0000 (oldest deadline 2024-09-12T02:03:58.523995+0000) 2024-09-12T02:05:06.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:03:44.325685+0000 front 2024-09-12T02:03:44.325742+0000 (oldest deadline 2024-09-12T02:04:06.625484+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:03:53.627205+0000 front 2024-09-12T02:03:53.627455+0000 (oldest deadline 2024-09-12T02:04:16.527347+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:04:02.129749+0000 front 2024-09-12T02:04:02.129626+0000 (oldest deadline 2024-09-12T02:04:23.229596+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:04:09.232869+0000 front 2024-09-12T02:04:09.232788+0000 (oldest deadline 2024-09-12T02:04:33.332769+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:04:13.333222+0000 front 2024-09-12T02:04:13.333278+0000 (oldest deadline 2024-09-12T02:04:41.533834+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:04:33.135983+0000 front 2024-09-12T02:04:33.135996+0000 (oldest deadline 2024-09-12T02:04:55.436280+0000) 2024-09-12T02:05:06.504 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11[60348]: 2024-09-12T02:05:06.084+0000 7ff05d03e640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-12T02:04:38.837388+0000 front 2024-09-12T02:04:38.837364+0000 (oldest deadline 2024-09-12T02:05:04.737400+0000) 2024-09-12T02:05:07.253 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:06 smithi172 podman[70119]: 2024-09-12 02:05:06.998466152 +0000 UTC m=+5.467457613 container died 8bc3afea6048600822fe9d75addb9e5e1dab00d8f4db409d12fd0ee57472e95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:05:07.534 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:07 smithi172 podman[70119]: 2024-09-12 02:05:07.349976604 +0000 UTC m=+5.818968055 container cleanup 8bc3afea6048600822fe9d75addb9e5e1dab00d8f4db409d12fd0ee57472e95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:05:07.534 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:07 smithi172 bash[70119]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:05:07.960 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:07 smithi172 podman[70134]: 2024-09-12 02:05:07.534372315 +0000 UTC m=+0.525146063 container remove 8bc3afea6048600822fe9d75addb9e5e1dab00d8f4db409d12fd0ee57472e95e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:05:08.245 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:07 smithi172 podman[70219]: 2024-09-12 02:05:07.863914114 +0000 UTC m=+0.016020841 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:05:08.245 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:07 smithi172 podman[70219]: 2024-09-12 02:05:07.968786152 +0000 UTC m=+0.120892935 container create c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:05:08.245 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:08 smithi172 podman[70219]: 2024-09-12 02:05:08.170906092 +0000 UTC m=+0.323012809 container init c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:05:08.245 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:08 smithi172 podman[70219]: 2024-09-12 02:05:08.174238064 +0000 UTC m=+0.326344787 container start c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:05:08.245 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:08 smithi172 podman[70219]: 2024-09-12 02:05:08.245885321 +0000 UTC m=+0.397992048 container attach c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:05:08.503 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:08 smithi172 podman[70219]: 2024-09-12 02:05:08.36525252 +0000 UTC m=+0.517359241 container died c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:05:08.899 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:05:08 smithi172 podman[70242]: 2024-09-12 02:05:08.882268418 +0000 UTC m=+0.511129481 container remove c30a9d1e92c700538bc5ac83c9e7b6305ffb9c62b7b4023e5bba487238aa7b26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T02:05:08.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:05:08.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:08.944 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:05:08.944 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:05:08.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:05:09.274 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:09 smithi039 systemd[1]: Stopping Ceph mds.a for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:09.552 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:09 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a[69631]: 2024-09-12T02:05:09.273+0000 7f6f1bcca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:09.552 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:09 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a[69631]: 2024-09-12T02:05:09.273+0000 7f6f1bcca640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:05:10.910 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:10 smithi039 podman[113637]: 2024-09-12 02:05:10.788764578 +0000 UTC m=+1.633753331 container died 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:05:11.410 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:11 smithi039 podman[113637]: 2024-09-12 02:05:11.258269092 +0000 UTC m=+2.103257842 container cleanup 8ce4c98e39ded297417db9a539eb4960cdef968514970fcc984c3b9fb31a46b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:05:11.410 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:05:11 smithi039 bash[113637]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:05:11.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:05:11.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:11.795 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:05:11.795 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:05:11.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:05:12.129 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:11 smithi039 systemd[1]: Stopping Ceph mds.d for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:12.410 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d[68447]: 2024-09-12T02:05:12.128+0000 7f9e89e40640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:12.410 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:12 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d[68447]: 2024-09-12T02:05:12.128+0000 7f9e89e40640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:05:15.654 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:15 smithi039 podman[113769]: 2024-09-12 02:05:15.351481178 +0000 UTC m=+3.321836131 container died a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T02:05:15.910 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:15 smithi039 podman[113769]: 2024-09-12 02:05:15.854602765 +0000 UTC m=+3.824957757 container cleanup a25fd91375214e10c4e3094e7855d2e0b315a2526ebbc4a2108301cc3a8eca5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:05:15.910 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:05:15 smithi039 bash[113769]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:05:16.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:05:16.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:16.322 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:05:16.322 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:05:16.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:05:16.660 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:16 smithi039 systemd[1]: Stopping Ceph mds.g for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:17.160 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-g[69255]: 2024-09-12T02:05:16.666+0000 7f3966be0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:17.160 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:16 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-g[69255]: 2024-09-12T02:05:16.666+0000 7f3966be0640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:05:19.626 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:19 smithi039 podman[113890]: 2024-09-12 02:05:19.344315721 +0000 UTC m=+2.791064358 container died 35dc700ef5a2580e391ae795df1d11e234a88be9de47c6e5ce684744682859ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:05:19.910 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:19 smithi039 podman[113890]: 2024-09-12 02:05:19.80060451 +0000 UTC m=+3.247353146 container cleanup 35dc700ef5a2580e391ae795df1d11e234a88be9de47c6e5ce684744682859ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:05:19.910 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:05:19 smithi039 bash[113890]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:05:20.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:05:20.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:20.280 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:05:20.280 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:05:20.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:05:20.617 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:20 smithi039 systemd[1]: Stopping Ceph mds.j for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:20.910 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j[68038]: 2024-09-12T02:05:20.620+0000 7fb9bc5f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:20.910 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:20 smithi039 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j[68038]: 2024-09-12T02:05:20.620+0000 7fb9bc5f2640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:05:23.847 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:23 smithi039 podman[114012]: 2024-09-12 02:05:23.55840004 +0000 UTC m=+3.050164910 container died 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:05:24.160 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:23 smithi039 podman[114012]: 2024-09-12 02:05:23.921586695 +0000 UTC m=+3.413351521 container cleanup 78a6dd6e79424516abeea715a1a0b9dad6ddde142a5ba8b190f3fb2faa12c534 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:05:24.160 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:05:23 smithi039 bash[114012]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:05:24.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:05:24.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:24.326 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:05:24.326 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:05:24.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:05:24.663 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:24 smithi044 systemd[1]: Stopping Ceph mds.b for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:24.923 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T02:05:24.662+0000 7f5e62768640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:24.924 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:24 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b[65161]: 2024-09-12T02:05:24.662+0000 7f5e62768640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:05:28.923 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:28 smithi044 podman[69523]: 2024-09-12 02:05:28.669607207 +0000 UTC m=+4.134206054 container died 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:05:29.422 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:29 smithi044 podman[69523]: 2024-09-12 02:05:29.121437756 +0000 UTC m=+4.586036587 container cleanup 539fa268af6c41fcf7bf50964cf7157f9025e9a3c287d3119913c4e51be6513f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:05:29.422 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:05:29 smithi044 bash[69523]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:05:29.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:05:29.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:29.604 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:05:29.604 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:05:29.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:05:29.943 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:29 smithi044 systemd[1]: Stopping Ceph mds.e for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:30.423 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: 2024-09-12T02:05:29.942+0000 7fba42239640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:30.423 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:29 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e[64544]: 2024-09-12T02:05:29.942+0000 7fba42239640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:05:33.875 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:33 smithi044 podman[69656]: 2024-09-12 02:05:33.585094929 +0000 UTC m=+3.755432865 container died 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:05:34.173 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:33 smithi044 podman[69656]: 2024-09-12 02:05:33.975598278 +0000 UTC m=+4.145936213 container cleanup 6e755a50f52375950f1822133f3dacac2b3e80d4e803c775d1ed09308086c6a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:05:34.173 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:05:33 smithi044 bash[69656]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:05:34.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:05:34.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:34.392 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:05:34.392 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:05:34.392 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:05:34.923 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:34 smithi044 systemd[1]: Stopping Ceph mds.h for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:34.923 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T02:05:34.711+0000 7f65cd52d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:34.924 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:34 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-12T02:05:34.711+0000 7f65cd52d640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:05:37.863 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:37 smithi044 podman[69779]: 2024-09-12 02:05:37.596708183 +0000 UTC m=+2.985422444 container died e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:05:38.173 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:37 smithi044 podman[69779]: 2024-09-12 02:05:37.962636519 +0000 UTC m=+3.351350780 container cleanup e4fafe3c9815dfc0c66299fe5b3dda316aa5c093437af44963bb8218149653c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T02:05:38.173 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:05:37 smithi044 bash[69779]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:05:38.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:05:38.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:38.423 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:05:38.423 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:05:38.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:05:38.750 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:38 smithi044 systemd[1]: Stopping Ceph mds.k for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:39.173 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k[64235]: 2024-09-12T02:05:38.750+0000 7f54e55c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:39.173 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:38 smithi044 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k[64235]: 2024-09-12T02:05:38.750+0000 7f54e55c9640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:05:40.673 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:40 smithi044 podman[69897]: 2024-09-12 02:05:40.420578006 +0000 UTC m=+1.774653352 container died 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T02:05:40.934 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:40 smithi044 podman[69897]: 2024-09-12 02:05:40.758628829 +0000 UTC m=+2.112704177 container cleanup 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:05:40.934 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:40 smithi044 bash[69897]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:05:41.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:05:41.201 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:40 smithi044 podman[69910]: 2024-09-12 02:05:40.934674298 +0000 UTC m=+0.516896093 container remove 4f3d36cbb2ed75be215675665f17c15c6617984b6220dc1e59c25db671dbaa04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:05:41.201 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:41 smithi044 systemd[1]: ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-12T02:05:41.201 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:05:41 smithi044 systemd[1]: Stopped Ceph mds.k for d27de812-70a8-11ef-bcea-c7b262605968. 2024-09-12T02:05:41.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:41.212 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:05:41.212 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:05:41.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:05:41.503 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:41 smithi172 systemd[1]: Stopping Ceph mds.c for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:42.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: 2024-09-12T02:05:41.506+0000 7f3db62c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:42.003 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:41 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c[65325]: 2024-09-12T02:05:41.506+0000 7f3db62c2640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:05:45.782 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:45 smithi172 podman[70321]: 2024-09-12 02:05:45.517019674 +0000 UTC m=+4.112220132 container died 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:05:46.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:45 smithi172 podman[70321]: 2024-09-12 02:05:45.872797829 +0000 UTC m=+4.467998288 container cleanup 7f112e178a3c35bbb726c8445a5ab5af5c1efb90f852c652ddf5ac6c9c18a603 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:05:46.115 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:05:45 smithi172 bash[70321]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:05:46.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:05:46.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:46.288 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:05:46.288 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:05:46.289 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:05:46.753 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:46 smithi172 systemd[1]: Stopping Ceph mds.f for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:46.754 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:46 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: 2024-09-12T02:05:46.592+0000 7f0cd6fb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:46.754 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:46 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f[65022]: 2024-09-12T02:05:46.592+0000 7f0cd6fb4640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:05:49.893 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:49 smithi172 podman[70456]: 2024-09-12 02:05:49.603627647 +0000 UTC m=+3.094893327 container died 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:05:50.210 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:50 smithi172 podman[70456]: 2024-09-12 02:05:50.017742532 +0000 UTC m=+3.509008198 container cleanup 5806b0c13a69c72edef10d404a0b293393f4aff8fed8d620f09c75fe74e16326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:05:50.210 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:05:50 smithi172 bash[70456]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:05:50.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:05:50.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:50.378 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:05:50.378 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:05:50.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:05:50.503 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:50 smithi172 systemd[1]: Stopping Ceph mds.i for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:51.003 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T02:05:50.687+0000 7f884d8d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:51.003 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:50 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i[65641]: 2024-09-12T02:05:50.687+0000 7f884d8d2640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:05:53.872 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:53 smithi172 podman[70576]: 2024-09-12 02:05:53.606176293 +0000 UTC m=+3.010474897 container died 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:05:54.213 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:53 smithi172 podman[70576]: 2024-09-12 02:05:53.963200625 +0000 UTC m=+3.367499231 container cleanup 6cf83d847c8fd68e5aa0ef416bd38a041767f2a5b7c26ce068a4cd4e4e6cd075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:05:54.213 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:05:53 smithi172 bash[70576]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:05:54.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:05:54.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:54.420 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:05:54.421 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:05:54.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:05:54.753 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:54 smithi172 systemd[1]: Stopping Ceph mds.l for d27de812-70a8-11ef-bcea-c7b262605968... 2024-09-12T02:05:54.753 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l[64714]: 2024-09-12T02:05:54.724+0000 7f793ae5a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:05:54.754 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:54 smithi172 ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l[64714]: 2024-09-12T02:05:54.724+0000 7f793ae5a640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:05:58.003 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:57 smithi172 podman[70697]: 2024-09-12 02:05:57.723698739 +0000 UTC m=+3.085686851 container died f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:05:58.334 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:58 smithi172 podman[70697]: 2024-09-12 02:05:58.125059403 +0000 UTC m=+3.487047581 container cleanup f240adfe77e767f93b524ecb8552b5ae28f1ca54010707bbafcffbf053a75ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T02:05:58.334 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:05:58 smithi172 bash[70697]: ceph-d27de812-70a8-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:05:58.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d27de812-70a8-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:05:58.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:05:58.506 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:05:58.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:05:58.717 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:06:01.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:06:01.437 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:06:03.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:06:04.090 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:06:06.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:06:06.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:06:06.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:06:06.528 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:06:06.530 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi039/crash 2024-09-12T02:06:06.531 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:06:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:06:06.571 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:06:06.573 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi044/crash 2024-09-12T02:06:06.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:06:06.615 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:06:06.615 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:06:06.617 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi172/crash 2024-09-12T02:06:06.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:06:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/d27de812-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:06:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:06:06.652 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:06:06.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T02:06:06.691 INFO:teuthology.orchestra.run.smithi039.stdout:2024-09-12T01:59:34.980886+0000 mds.h (mds.1) 5 : cluster [WRN] Scrub error on inode 0x10000001aac (/volumes/qa/sv_1/ca2bc097-600f-4540-8f33-9058f9e265df/client.0/tmp/xfstests-dev/lib/tlibio.lo) see mds.h log and `damage ls` output for details 2024-09-12T02:06:06.691 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-12T02:06:06.691 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:06:06.691 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:06:06.735 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:06:06.737 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:06:06.760 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:06:06.760 INFO:teuthology.orchestra.run.smithi039.stderr:: No such file or directory 2024-09-12T02:06:06.760 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:06:06.761 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:06:06.761 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:06:06.761 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:06:06.761 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:06:06.762 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:06:06.762 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:06:06.763 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:06:06.763 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-12T02:06:06.763 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:06:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:06:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:06:06.768 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log: 82.5% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:06:06.769 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.2% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr: 94.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:06:06.773 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.8% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr: 86.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:06:06.774 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:06:06.777 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:06:06.777 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr: 86.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log: 94.8% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:06:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:06:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:06:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:06:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:06:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:06:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:06:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% 94.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:06:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose 82.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr: -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log: 86.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr: 92.5% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log: /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log: 90.9% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:06:06.785 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/cephadm.log: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:06:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:06:06.795 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:06:06.803 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:06:06.934 INFO:teuthology.orchestra.run.smithi039.stderr: 90.0% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:06:07.125 INFO:teuthology.orchestra.run.smithi172.stderr: 91.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:06:07.139 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:06:07.459 INFO:teuthology.orchestra.run.smithi172.stderr: 95.0% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:06:07.496 INFO:teuthology.orchestra.run.smithi044.stderr: 95.2% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:06:07.723 INFO:teuthology.orchestra.run.smithi039.stderr: 90.4% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:06:08.713 INFO:teuthology.orchestra.run.smithi172.stderr: 96.0% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:06:11.415 INFO:teuthology.orchestra.run.smithi039.stderr: 92.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:06:12.622 INFO:teuthology.orchestra.run.smithi039.stderr: 91.8% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:06:12.689 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:06:14.258 INFO:teuthology.orchestra.run.smithi039.stderr: 92.1% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:06:14.990 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:06:15.673 INFO:teuthology.orchestra.run.smithi044.stderr: 91.5% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:06:16.000 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:06:16.105 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:06:16.389 INFO:teuthology.orchestra.run.smithi039.stderr: 91.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:06:16.391 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-12T02:06:16.391 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m9.643s 2024-09-12T02:06:16.392 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m27.840s 2024-09-12T02:06:16.392 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m0.904s 2024-09-12T02:06:16.924 INFO:teuthology.orchestra.run.smithi172.stderr: 94.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:06:17.194 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:06:18.078 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:06:18.080 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-12T02:06:18.080 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m11.328s 2024-09-12T02:06:18.080 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m46.458s 2024-09-12T02:06:18.080 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.435s 2024-09-12T02:06:18.111 INFO:teuthology.orchestra.run.smithi044.stderr: 94.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:06:18.132 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:06:38.370 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/d27de812-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:06:38.371 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T02:06:38.372 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m31.619s 2024-09-12T02:06:38.372 INFO:teuthology.orchestra.run.smithi044.stderr:user 1m21.559s 2024-09-12T02:06:38.372 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m2.278s 2024-09-12T02:06:38.372 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:06:38.372 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi039/log 2024-09-12T02:06:38.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:06:43.231 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi044/log 2024-09-12T02:06:43.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:06:53.738 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi172/log 2024-09-12T02:06:53.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:07:00.415 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:07:00.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:07:00.633 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:07:00.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:07:01.152 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:07:01.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d27de812-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T02:07:01.701 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d27de812-70a8-11ef-bcea-c7b262605968 2024-09-12T02:07:02.243 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:07:02.244 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:07:02.264 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:07:02.284 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:07:02.300 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:07:02.300 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:07:02.313 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:07:02.313 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:07:02.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:07:02.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:07:02.461 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:07:02.472 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:07:02.473 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:07:02.475 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:07:02.478 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:07:02.491 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:07:02.492 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:07:02.492 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:07:02.496 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:07:02.496 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-12T02:07:02.496 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -2617us[-2637us] +/- 57ms 2024-09-12T02:07:02.497 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +883us[ +863us] +/- 66ms 2024-09-12T02:07:02.497 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +3223us[+3223us] +/- 78ms 2024-09-12T02:07:02.497 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 -2801us[-2800us] +/- 57ms 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +705us[ +706us] +/- 66ms 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +3028us[+3028us] +/- 78ms 2024-09-12T02:07:02.500 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -2808us[-2805us] +/- 57ms 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +711us[ +717us] +/- 66ms 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +3028us[+3032us] +/- 78ms 2024-09-12T02:07:02.501 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:07:02.501 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:07:02.512 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:07:02.512 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:07:02.531 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:07:02.625 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:07:02.699 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:07:02.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:07:02.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:02.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:07:02.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:02.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:07:02.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:02.858 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:07:02.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:07:02.955 INFO:teuthology.task.internal:Duration was 1590.647780 seconds 2024-09-12T02:07:02.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:07:03.013 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:07:03.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:07:03.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:07:03.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:07:03.058 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:07:03.058 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:07:03.059 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:07:03.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:07:03.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:07:03.547 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:07:03.572 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T02:07:03.572 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:07:03.596 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T02:07:03.597 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:07:03.620 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:07:03.621 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:07:03.623 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:07:03.639 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:07:03.687 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:07:03.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:07:03.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:07:03.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:07:04.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:07:04.479 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:07:04.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:07:04.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:07:04.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:07:04.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:07:04.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.597 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-12T02:07:04.601 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-12T02:07:04.627 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-12T02:07:04.652 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:04.667 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:04.683 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:07:04.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:07:04.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:07:04.719 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:07:04.720 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi039 2024-09-12T02:07:04.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:07:04.772 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi044 2024-09-12T02:07:04.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:07:04.812 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901569/remote/smithi172 2024-09-12T02:07:04.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:07:04.851 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:07:04.851 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:07:04.854 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:07:04.857 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:07:04.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:07:04.912 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:07:04.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:07:04.941 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:07:04.942 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:07:04.944 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:07:04.946 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:07:04.957 INFO:teuthology.orchestra.run.smithi039.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:07 /home/ubuntu/cephtest 2024-09-12T02:07:04.961 INFO:teuthology.orchestra.run.smithi044.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:07 /home/ubuntu/cephtest 2024-09-12T02:07:04.961 INFO:teuthology.orchestra.run.smithi172.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:07 /home/ubuntu/cephtest 2024-09-12T02:07:04.963 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:07:04.975 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:07:05.050 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 1590.6477797031403 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-12T02:07:05.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:07:05.146 INFO:teuthology.run:FAIL